Prospective Study Open Access
Copyright ©The Author(s) 2024. Published by Baishideng Publishing Group Inc. All rights reserved.
World J Crit Care Med. Mar 9, 2024; 13(1): 89085
Published online Mar 9, 2024. doi: 10.5492/wjccm.v13.i1.89085
Adding vortexing to the Maki technique provides no benefit for the diagnosis of catheter colonization or catheter-related bacteremia
Leonardo Lorente, Adriana González-Mesa, Judith Oliveras-Roura, Cristina Rosado, Pablo Cabrera, María Luisa Mora, Intensive Care Unit, Hospital Universitario de Canarias, La Laguna 38320, Spain
Maria Lecuona Fernandez, Emma Casal, Ana Madueño, Microbiology and Infection Control Service, Hospital Universitario de Canarias, La Laguna 38320, Spain
Alejandro Jiménez, Research Unit, Hospital Universitario de Canarias, La Laguna 38320, Spain
ORCID number: Leonardo Lorente (0000-0003-4902-4065); Maria Lecuona Fernandez (0000-0002-7388-4842); Adriana González-Mesa (0000-0002-6882-2786); Judith Oliveras-Roura (0000-0001-9468-9141); Cristina Rosado (0009-0003-0205-1688); Pablo Cabrera (0009-0005-8143-0807); Emma Casal (0009-0000-5616-4109); Alejandro Jiménez (0000-0001-8732-2616); María Luisa Mora (0000-0001-5361-1727); Ana Madueño (0000-0002-6181-4417).
Author contributions: Lorente L conceived, designed and coordinated the study, participated in acquisition and interpretation of data, and drafted the manuscript; Lecuona M, González-Mesa, Oliveras-Roura J, Rosado C, Cabrera P, Casal E, Mora ML and Madueño A participated in acquisition of data; Jiménez A participated in the interpretation of data; all authors revised the manuscript critically for important intellectual content, made the final approval of the version to be published and were agreed to be accountable for all aspects of the work.
Institutional review board statement: The Institutional Board of Hospital Universitario de Canarias (San Cristóbal de La Laguna) approved the study protocol.
Clinical trial registration statement: This study is registered at https://www.clinicaltrials.gov/. The registration identification number is NCT06216184.
Informed consent statement: All study participants, or their legal guardian, provided informed written consent prior to study enrollment.
Conflict-of-interest statement: There are no conflicts of interest to declare.
Data sharing statement: The datasets generated during the current study are available from the corresponding author on reasonable request.
CONSORT 2010 statement: The authors have read the CONSORT 2010 statement, and the manuscript was prepared and revised according to the CONSORT 2010 statement.
Open-Access: This article is an open-access article that was selected by an in-house editor and fully peer-reviewed by external reviewers. It is distributed in accordance with the Creative Commons Attribution NonCommercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: https://creativecommons.org/Licenses/by-nc/4.0/
Corresponding author: Leonardo Lorente, MD, PhD, Medical Assistant, Intensive Care Unit, Hospital Universitario de Canarias, Ofra s/n, La Laguna 38320, Spain. lorentemartin@msn.com
Received: October 20, 2023
Peer-review started: October 20, 2023
First decision: December 28, 2023
Revised: January 12, 2024
Accepted: February 21, 2024
Article in press: February 21, 2024
Published online: March 9, 2024

Abstract
BACKGROUND

A previous study compared vortexing and Maki techniques for the diagnosis of catheter-related bloodstream infection (CRBSI), and concluded that vortexing was not superior to Maki method.

AIM

To determine whether the combined use of vortexing and Maki techniques provides profitability versus the Maki technique for the diagnosis of catheter tip colonization (CTC) and CRBSI.

METHODS

Observational and prospective study carried out in an Intensive Care Unit. Patients with suspected catheter-related infection (CRI) and with one central venous catheter for at least 7 days were included. The area under the curve (AUC) of the Maki technique, the vortexing technique and the combination of both techniques for the diagnosis of CTC and CRBSI were compared.

RESULTS

We included 136 episodes of suspected CRI. We found 21 cases of CTC of which 10 were also CRBSI cases. Of the 21 CTC episodes, 18 (85.7%) were diagnosed by Maki technique and vortexing technique, 3 (14.3%) only by the technique of Maki, and none only by technique of vortexing. Of the 10 CRBSI episodes, 9 (90.0%) were diagnosed by the techniques of Maki and vortexing, 1 (10.0%) was diagnosed only by the technique of Maki, and none only by the technique of vortexing. We no found differences in the comparison of AUC between the technique of Maki and the combination of Maki and vortexing techniques for the diagnosis of CTC (P = 0.99) and CRBSI (P = 0.99).

CONCLUSION

The novel finding of our study was that the combined use of vortexing and Maki techniques did not provide profitability to the technique of Maki alone to CRBSI diagnosis of.

Key Words: Vortexing, Maki, Bloodstream infection, Colonization

Core Tip: A previous study compared vortexing and Maki techniques for the diagnosis of catheter-related bloodstream infection (CRBSI), and concluded that vortexing was not superior to Maki the method. The novel finding of our study was that the combined use of vortexing and Maki techniques did not provide profitability to the technique of Maki alone to the diagnosis of CRBSI.



INTRODUCTION

Different motives are responsible for the need of a central venous catheter (CVC), such as the monitorization of hemodynamic status or the administration of medications, fluids, parenteral nutrition or blood products. However, different risks are attributed to the use of CVC, for example, catheter-related bloodstream infection (CRBSI) that involves increasedmortality, assistant costs and morbidity[1-3].

The semiquantitative Maki technique, due to its simplicity, is considered the standard technique for the diagnosis of catheter tip colonization (CTC)[4]. However, as it consists of rolling the catheter tip across the agar (detecting the microorganism from the outer surface of the catheter tip), it has the potential disadvantage that it could not detect the microorganism from the inner surface. Thus, false negative of CTC could appear in the Maki technique of patients with endoluminal colonization. Quantitative techniques (such as vortexing or sonication) for CTC diagnosis could have a potential advantage over the Maki technique due to their potential ability to detect CTC by endoluminal mechanism (which is important in long term catheters) and not only by exoluminal mechanism[5-8]. However, all quantitative methods are more time consuming than the Maki technique, so its use in clinical microbiology laboratories is not widespread.

To our knowledge, there is only one study reporting data about the comparison between the vortexing quantitative technique and the Maki’s semiquantitative technique for the diagnosis of CRBSI, and it concluded that vortexing was not superior to the Maki method[9].

The same strength of recommendations and quality of evidence (A-II) have been stablished for the Maki technique and the vortexing technique for the diagnosis of intravascular catheter-related infection (CRI) in recent guidelines[10,11].

A previous study were compared vortexing and Maki techniques in the diagnosis of CRBSI[9]; however, this study did not compare the combined use of vortexing and Maki over only the Maki technique for the diagnosis of CTC and CRBSI, and this was the novel objective of our study.

MATERIALS AND METHODS
Design and subjects

This prospective and observational study was carried with the approval of the Institutional Ethic Committee of the Hospital Universitario de Canarias (Tenerife, Spain). Patient recruitment was performed in the Intensive Care Unit of this hospital between April 2022 and September 2022 with informed consent signed by the patients or a member of their family.

Patients with suspicion of CRI and with long term CVC (at least 7 d) were included. CRI was suspected when a patient developed a new episode of fever (temperature ≥ 38ºC) or sepsis (according to Sepsis-3 Consensus criteria of 2016[12]). We used CVC type ARROWg+ard Blue® (Arrow, Reading, PA, United States), which were impregnated on chlorhexidine-silver sulfadiazine on the external and internal surfaces).

Variables recorded

For each suspected CRI, the age and sex of the patient and the place and time of CVC were recorded. In addition, intensive care unit (ICU) admission diagnosis, personal history of diabetes mellitus, chronic obstructive pulmonary disease, asthma, smoking, chronic liver disease, hematological tumor, human immunodeficiency virus or solid tumor were recorded. In addition, we recorded the use of renal replacement, corticosteroids or immunosuppressants previously to ICU admission, and the use of corticosteroids, parenteral nutrition or propofol at the time of suspected CRI. Finally, we also registered death within 30 days of suspected CRI.

Sample collections

We collected paired catheter tip samples, blood samples and necessary clinical samples from each patient. Paired peripheral vein blood samples were collected 15 min apart with 10 mL of blood in each sample. Catheter tip samples were taken; and for this, the skin surrounding the insertion site was previously rubbed with 2% chlorhexidine and the tip was cut with sterile scissors (5 cm of distal segment). Initially, the distal segment of the catheter tip was cultured using the Maki technique and subsequently using the vortex technique. For the semiquantitative Maki technique, the distal segment of the catheter tip was plated on a blood agar plate[4]. For the quantitative vortexing technique, the distal segment of the catheter tip was placed with 1 mL of brain-heart infusion broth in a vortexing device and vortexed for 1 min. After vortexing for 1 min, 0.1 mL of that suspension was seeded on blood agar[9]. We excluded patients without culture with Maki tip technique, culture with vortex tip technique, and blood cultures.

Definitions

We use the criteria of European Centre for Disease Prevention and Control for definitions of infections[13]. We considered CTC when a significant growth on the CVC tip of a microorganism was obtained by semi-quantitativemethod of Maki (≥ 15 colony-forming units)[4] or by quantitative method of vortexing (≥ 1000 colony-forming units)[9]. CRBSI was defined as the presence of the same recognized pathogen in the blood culture and in the CVC tip without no other apparent source of infection. Two positive blood cultures (obtanied in a separation of 48 h) for a common skin contaminant (Micrococcus spp., Coagulase-negative staphylococci, Propionibacterium acnes, Corynebacterium spp. and Bacillus spp.) were required.

Statistical analysis

We reported categorical variables as frequencies (%) and continuous variables as medians (25%-75%). Categorical variables were compared using the chi-square test and continuous variables by the Mann-Whitney T test. The area under the curve (AUC) of the Maki technique, the vortexing technique and the combination of both techniques for the diagnosis of CTC and CRBSI were compared using the method of DeLong et al[14]. We carried out statistical analyses with SPSS 17.0 software (SPSS Inc., Chicago, IL, United States) and we considered P values lower than 0.05 as significant.

RESULTS

We included 136 episodes of suspected CRI. We found 21 cases of CTC of which 10 were also cases of CRBSI. We found that CVC that developed CRBSI (n = 10) showed higher CVC time (P = 0.02) compared to those that did not develop it (n = 126); however, no other significant differences between CVC who did or did not develop CRBSI were found (Table 1).

Table 1 Characteristics of central venous catheter with suspicion of catheter-related infection that developed or not catheter-related bloodstream infection.
Data
Non CRBSI (n = 126)
CRBSI (n = 10)
P value (CRBSI vs non)
Time of CVC (d) [median (p 25-75)]9 (7-12)12 (10-18)0.02
Site of CVC, n (%)0.19
     Subclavian28 (22.2)3 (30.0)
    Jugular 62 (49.2)2 (50.0)
    Femoral36 (28.6)5 (50.0)
Age (yr, p 25-75)65 (57-70)65 (58-75)0.50
Sex female, n (%)30 (23.8)1 (10.0)0.45
Admission diagnostic, n (%)0.74
    Medical73 (57.9)7 (70.0)
    Surgical39 (31.0)2 (20.0)
    Traumatology14 (11.1)1 (10.0)
Diabetes mellitus, n (%)39 (31.0)3 (30.0)0.99
COPD, n (%)16 (12.7)00.61
Asthma, n (%)3 (2.4)00.99
Chronic liver disease, n (%)25 (19.8)00.21
Smoking, n (%)36 (28.6)4 (40.0)0.48
Hematological tumor, n (%)2 (1.6)00.99
Solid tumor, n (%)15 (11.9)2 (20.0)0.61
Human immunodeficiency virus, n (%)1 (0.8)00.99
Renal replacement previously to ICU admission, n (%)17 (13.5)1 (10.0)0.99
Corticosteroids previously to ICU admission, n (%)14 (11.1)1 (10.0)0.99
Immunosuppressants previously to ICU admission, n (%)10 (7.9)1 (10.0)0.58
Corticosteroids at CRI suspicion, n (%)44 (34.9)4 (40.0)0.74
Parenteral nutrition at CRI suspicion, n (%)17 (13.5)3 (30.0)0.17
Propofol at CRI suspicion, n (%)69 (54.8)8 (80.0)0.19
Deaths at 30 d of CRI suspicion, n (%)9 (7.1)00.99

We found 21 episodes of CTC and 10 episodes of CRBSI. Of the 21 episodes of CTC, 18 (85.7%) were diagnosed by the techniques of Maki and vortexig, 3 (14.3%) were diagnosed only by the technique of Maki, and none wasdiagnosed only by the technique of vortexig (Table 2). Of the 10 episodes of CRBSI, 9 (90.0%) were diagnosed by the techniques of Maki and vortexing, 1 (10.0%) was diagnosed only by the technique of Maki technique, and none was detected only by the technique of vortexing (Table 3).

Table 2 Maki and vortexing results to diagnosis catheter tip colonization.
Maki +Maki -Total
Vortex +18018
Vortex -3115118
Total21115136
Table 3 Maki and vortexing results to diagnosis catheter-related bloodstream infection.
Maki +Maki -Total
Vortex +909
Vortex -1126127
Total10126136

The AUC for CTC diagnosis was 100% (95%CI = 97%-100%; P < 0.001) to the technique of Maki, 93% (95%CI = 87%-97%; P < 0.001) to the technique of vortexing and 100% (95%CI = 97%-100%; P < 0.001) by the combination of techniques. No differences had in the comparison of AUC between the technique of Makiand the combination of techniques (P = 0.99) for CTC diagnosis.

The AUC for CRBSI diagnosis was 96% (95%CI = 91%-98%; P < 0.001) to with the technique of Maki, of 91% (95%CI = 85%-96%; P < 0.001) with the techniqe of vortexing and 96% (95%CI = 91%-98%; P < 0.001) with the combination of techniques. No differences had in the comparison of AUC between the technique of Maki and the combination of techniques (P = 0.99) for CRBSI diagnosis.

The microorganisms responsible for CTC were the following: Staphylococcus epidermidis 6 (2 with CRBSI), Staphylococcus haemolyticus 3 (1 with CRBSI), Methicillin-sensitive Staphylococcus aureus 1 (1 with CRBSI), Methicillin-resistant Staphylococcus aureus 1 (1 with CRBSI), Pseudomonas aeruginosa 2 (2 with CRBSI), Klebsiella spp. 3 (2 with CRBSI), Acinetobacter spp. 1, Serratia 1, Candida albicans 2, Candida glabrata 1 (1 with CRBSI).

DISCUSSION

To our knowledge, there is only one study reporting data on the comparison between the quantitative vortexing technique and the semiquantitative Maki technique for the diagnosis of CRBSI, and it concluded that vortexing was not superior to the Maki method[9]. However, this study did not compare the combined use of the vortexing and Maki techniques with respect to the Maki technique alone for the diagnosis of CTC and CRBSI, and this was the novel aim of our study.

We no found any CTC or CRBSI detected by vortexing technique and not detected by Maki technique. No differences had in the comparison of AUC between the technique of Maki technique and the combination of techniques, between the techniques of Maki and vortexing, and between the vortexing technique and the combined techniques for the diagnosis of CTC or CRBSI. Thus, the novel finding of our study was that the use of vortexing combined with the Maki technique did not add any cost-effectiveness for the diagnosis of CTC or CRBSI.

Recent guidelines suggest similar recommendation strength and evidence quality for the techniques of Maki and vortexing for the diagnosis of CRI[10,11]. We think that the Maki technique remains the standard technique for the diagnosis of CTC and CRBSI due to the findings of our study and those from the study by Bouza et al[9], and because of the greater simplicity of the Maki technique; in addition, we think that the technique of vortexing did not provide profitability to the technique of Maki to the diagnosis of CTC and CRBSI due to the findings of our study.

We want to acknowledge that one limitation of our study was that we have not carried out other quantitative techniques (as sonication or flushing) to compare the profitability of all of them for the diagnosis of CTC and CRBSI. Another limitation of our study was that we have not reported the proportion of CVC excluded (because we did not have complete information on culture with Maki technique, culture with vortexing technique and blood culture). Another limitation of our study was the relatively low number of patients; however, our study showed that to add vortexing technique to Maki technique for the diagnosis of CTC or CRBSI do not apport any benefit due to none of them were detected only by vortexing technique and there were no differences in the AUC when vortexing technique was added to Maki technique.

CONCLUSION

The novel finding of our study was that the combined use of vortexing and Maki techniques did not provide profitability to the technique of Maki alone to CRBSI diagnosis.

ARTICLE HIGHLIGHTS
Research background

A previous study compared the vortexing and the Maki techniques for the diagnosis of catheter-related bloodstream infection (CRBSI), and concluded that vortexing was not superior to the Maki method.

Research motivation

The above study did not compare the combined use of vortexing and Maki with respect to the Maki technique alone for the diagnosis of catheter tip colonization (CTC) and CRBSI.

Research objectives

To determine whether the combined use of vortexing and Maki techniques provide profitability to the Maki technique alone for the diagnosis of CTC and CRBSI.

Research methods

Observational and prospective study. We included patients admited in one Intensive Care Unit that had suspicion of catheter-related infection (CRI) and with one central venous catheter for at least 7 d. The area under the curve (AUC) of the Maki technique, the vortexing technique and the combination of both techniques for the diagnosis of CTC and CRBSI were compared.

Research results

We included 136 episodes of suspected CRI. We found 21 episodes of CTC and 10 episodes of CRBSI. Of the 21 episodes of CTC, 18 (85.7%) were diagnosed by the techniques of Maki and vortexing, 3 (14.3%) were diagnosed only by the technique of Maki, and none was diagnosed only by the technique of vortexing. Of the 10 episodes of CRBSI, 9 (90.0%) were diagnosed by the techniques of Maki and vortexing, 1 (10.0%) was diagnosed by the technique of Maki alone, and none only by the technique of vortexing. No differences had found in the comparison of AUC between the technique of Maki alone and the combination of techniques for the diagnosis of CTC (P = 0.99) and CRBSI (P = 0.99).

Research conclusions

The novel finding of our study was that the use combined of vortexing and Maki techniques did not provide profitability to the technique of Maki alone to CRBSI.

Research perspectives

To study other quantitative techniques (as flushing) to compare the profitability of all of them for the diagnosis of CTC and CRBSI.

Footnotes

Provenance and peer review: Invited article; Externally peer reviewed.

Peer-review model: Single blind

Specialty type: Critical care medicine

Country/Territory of origin: Spain

Peer-review report’s scientific quality classification

Grade A (Excellent): 0

Grade B (Very good): 0

Grade C (Good): C

Grade D (Fair): 0

Grade E (Poor): 0

P-Reviewer: Hu H, China S-Editor: Lin C L-Editor: A P-Editor: Cai YX

References
1.  Laupland KB, Lee H, Gregson DB, Manns BJ. Cost of intensive care unit-acquired bloodstream infections. J Hosp Infect. 2006;63:124-132.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 98]  [Cited by in F6Publishing: 103]  [Article Influence: 5.7]  [Reference Citation Analysis (0)]
2.  Siempos II, Kopterides P, Tsangaris I, Dimopoulou I, Armaganidis AE. Impact of catheter-related bloodstream infections on the mortality of critically ill patients: a meta-analysis. Crit Care Med. 2009;37:2283-2289.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 96]  [Cited by in F6Publishing: 103]  [Article Influence: 6.9]  [Reference Citation Analysis (0)]
3.  Lambert ML, Suetens C, Savey A, Palomar M, Hiesmayr M, Morales I, Agodi A, Frank U, Mertens K, Schumacher M, Wolkewitz M. Clinical outcomes of health-care-associated infections and antimicrobial resistance in patients admitted to European intensive-care units: a cohort study. Lancet Infect Dis. 2011;11:30-38.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 231]  [Cited by in F6Publishing: 248]  [Article Influence: 17.7]  [Reference Citation Analysis (0)]
4.  Maki DG, Weise CE, Sarafin HW. A semiquantitative culture method for identifying intravenous-catheter-related infection. N Engl J Med. 1977;296:1305-1309.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 1472]  [Cited by in F6Publishing: 1350]  [Article Influence: 28.7]  [Reference Citation Analysis (0)]
5.  Cleri DJ, Corrado ML, Seligman SJ. Quantitative culture of intravenous catheters and other intravascular inserts. J Infect Dis. 1980;141:781-786.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 267]  [Cited by in F6Publishing: 275]  [Article Influence: 6.3]  [Reference Citation Analysis (0)]
6.  Liñares J, Sitges-Serra A, Garau J, Pérez JL, Martín R. Pathogenesis of catheter sepsis: a prospective study with quantitative and semiquantitative cultures of catheter hub and segments. J Clin Microbiol. 1985;21:357-360.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 344]  [Cited by in F6Publishing: 349]  [Article Influence: 8.9]  [Reference Citation Analysis (0)]
7.  Brun-Buisson C, Abrouk F, Legrand P, Huet Y, Larabi S, Rapin M. Diagnosis of central venous catheter-related sepsis. Critical level of quantitative tip cultures. Arch Intern Med. 1987;147:873-877.  [PubMed]  [DOI]  [Cited in This Article: ]
8.  Sherertz RJ, Raad II, Belani A, Koo LC, Rand KH, Pickett DL, Straub SA, Fauerbach LL. Three-year experience with sonicated vascular catheter cultures in a clinical microbiology laboratory. J Clin Microbiol. 1990;28:76-82.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 279]  [Cited by in F6Publishing: 287]  [Article Influence: 8.4]  [Reference Citation Analysis (0)]
9.  Bouza E, Alvarado N, Alcalá L, Sánchez-Conde M, Pérez MJ, Muñoz P, Martín-Rabadán P, Rodríguez-Créixems M. A prospective, randomized, and comparative study of 3 different methods for the diagnosis of intravascular catheter colonization. Clin Infect Dis. 2005;40:1096-1100.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 76]  [Cited by in F6Publishing: 78]  [Article Influence: 4.1]  [Reference Citation Analysis (0)]
10.  Chaves F, Garnacho-Montero J, Del Pozo JL, Bouza E, Capdevila JA, de Cueto M, Domínguez MÁ, Esteban J, Fernández-Hidalgo N, Fernández Sampedro M, Fortún J, Guembe M, Lorente L, Paño JR, Ramírez P, Salavert M, Sánchez M, Vallés J. Diagnosis and treatment of catheter-related bloodstream infection: Clinical guidelines of the Spanish Society of Infectious Diseases and Clinical Microbiology and (SEIMC) and the Spanish Society of Spanish Society of Intensive and Critical Care Medicine and Coronary Units (SEMICYUC). Med Intensiva (Engl Ed). 2018;42:5-36.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 38]  [Cited by in F6Publishing: 55]  [Article Influence: 11.0]  [Reference Citation Analysis (0)]
11.  Chaves F, Garnacho-Montero J, Del Pozo JL, Bouza E, Capdevila JA, de Cueto M, Domínguez MÁ, Esteban J, Fernández-Hidalgo N, Fernández Sampedro M, Fortún J, Guembe M, Lorente L, Paño JR, Ramírez P, Salavert M, Sánchez M, Vallés J. Executive summary: Diagnosis and Treatment of Catheter-Related Bloodstream Infection: Clinical Guidelines of the Spanish Society of Clinical Microbiology and Infectious Diseases (SEIMC) and the Spanish Society of Intensive Care Medicine and Coronary Units (SEMICYUC). Enferm Infecc Microbiol Clin (Engl Ed). 2018;36:112-119.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 8]  [Cited by in F6Publishing: 12]  [Article Influence: 2.4]  [Reference Citation Analysis (0)]
12.  Singer M, Deutschman CS, Seymour CW, Shankar-Hari M, Annane D, Bauer M, Bellomo R, Bernard GR, Chiche JD, Coopersmith CM, Hotchkiss RS, Levy MM, Marshall JC, Martin GS, Opal SM, Rubenfeld GD, van der Poll T, Vincent JL, Angus DC. The Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3). JAMA. 2016;315:801-810.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 13771]  [Cited by in F6Publishing: 13771]  [Article Influence: 1721.4]  [Reference Citation Analysis (2)]
13.  European Centre for Disease Prevention and Control  Point prevalence survey of health care associated infections and antimicrobial use in European acute care hospitals–protocol version 4.3. 2012. [cited 20 October 2023]. Available from: https://ecdc.europa.eu/sites/portal/files/media/en/publications/Publications/0512-TED-PPS-HAI-antimicrobial-use-protocol.pdf.  [PubMed]  [DOI]  [Cited in This Article: ]
14.  DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics. 1988;44:837-845.  [PubMed]  [DOI]  [Cited in This Article: ]