Observational Study Open Access
Copyright ©The Author(s) 2022. Published by Baishideng Publishing Group Inc. All rights reserved.
World J Gastroenterol. Jun 28, 2022; 28(24): 2758-2774
Published online Jun 28, 2022. doi: 10.3748/wjg.v28.i24.2758
Usefulness of serum C-reactive protein and calprotectin for the early detection of colorectal anastomotic leakage: A prospective observational study
Nuno J G Rama, Patrícia C Motta Lima, Diana Parente, Colorectal Surgical Division, Leiria Hospital Centre, Leiria 2410-021, Portugal
Nuno J G Rama, Anabela Rocha, Fernando Castro-Pocas, Abel Salazar Biomedical Institute (ICBAS), University of Oporto, Oporto 4099-002, Portugal
Nuno J G Rama, Marlene C C Lages, Maria Pedro S Guarino, Cândida S G Silva, Center for Innovative Care and Health Technology (ciTechCare), Polytechnic of Leiria, Leiria 2410-541, Portugal
Óscar Lourenço, Faculty of Economics, CeBER, University of Coimbra, Coimbra 3000-137, Portugal
Ricardo Castro, Ana Bento, Clinical Pathology Division, Leiria Hospital Centre, Leiria 2410-541, Portugal
Anabela Rocha, Surgical Division, Oporto Hospital Centre, Oporto 4099-001, Portugal
Fernando Castro-Pocas, Department of Gastroenterology, Santo António Hospital, Porto Hospital Center, Porto 4099-001, Portugal
Fernando Castro-Pocas, Institute of Biomedical Sciences Abel Salazar, University of Porto, Porto 4099-001, Portugal
João Pimentel, Faculty of Medicine, University of Coimbra, Coimbra 3004-531, Portugal
João Pimentel, Surgical Division, Montes Claros Hospital, Coimbra 3030-320, Portugal
ORCID number: Nuno J G Rama (0000-0002-1572-2239); Marlene C C Lages (0000-0002-7389-6368); Maria Pedro S Guarino (0000-0001-6079-1105); Óscar Lourenço (0000-0002-3642-4919); Patrícia C Motta Lima (0000-0002-6427-8955); Diana Parente (0000-0003-0271-371X); Cândida S G Silva (0000-0002-7092-1169); Ricardo Castro (0000-0002-5110-0883); Ana Bento (0000-0002-3489-8774); Anabela Rocha (0000-0001-5000-5369); Fernando Castro-Pocas (0000-0002-2268-9107); João Pimentel (0000-0003-1908-8607).
Author contributions: Rama NJM, Guarino MPS, and Lourenço Ó designed the study; Lages MCC, Castro R, Bento A, and Parente D coordinated the data collection process; Lourenço Ó and Silva CSG performed the data analyses; Rama NJM, Motta Lima PC and Guarino MPS prepared the manuscript; Rama NJM, Rocha A, Castro-Poças F, and Pimentel J revised the paper critically; All authors read and approved the final manuscript.
Supported by the Ministry of Health – Incentive Program for the Integration of Care and Valuation of Patients’ Pathways in the National Health Service of Portugal.
Institutional review board statement: This study was conducted in accordance with the Declaration of Helsinki and was approved by the Local Ethical Committee of the Colorectal Referral Centre, after authorization obtained from the Portuguese Data Protection Authority. This study is registered with the number 9930/2016 and can be consulted at https://drive.google.com/file/d/1BiLxWlvcrqpX4KQrjW4F2codsOOywVF/view?usp=sharing.
Informed consent statement: Informed consent was obtained from all participants included in the study.
Conflict-of-interest statement: The authors have no conflicts of interest to declare.
Data sharing statement: For additional data, Dr. Nuno Rama can be contacted by e-mail at ramanuno@gmail.com.
STROBE statement: The authors have read the STROBE Statement – checklist of items, and the manuscript was prepared and revised according to the STROBE Statement – checklist of items.
Open-Access: This article is an open-access article that was selected by an in-house editor and fully peer-reviewed by external reviewers. It is distributed in accordance with the Creative Commons Attribution NonCommercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: https://creativecommons.org/Licenses/by-nc/4.0/
Corresponding author: Nuno JG Rama, FEBS, MD, MHSc, Associate Professor, Research Assistant Professor, Surgeon, Colorectal Surgical Division, Leiria Hospital Centre, Rua das Olhalvas, Leiria 2410-021, Portugal. ramanuno@gmail.com
Received: January 13, 2022
Peer-review started: January 13, 2022
First decision: March 8, 2022
Revised: March 22, 2022
Accepted: May 14, 2022
Article in press: May 14, 2022
Published online: June 28, 2022

Abstract
BACKGROUND

Colorectal anastomotic leakage (CAL) is one of the most dreaded complications after colorectal surgery, with an incidence that can be as high as 27%. This event is associated with increased morbidity and mortality; therefore, its early diagnosis is crucial to reduce clinical consequences and costs. Some biomarkers have been suggested as laboratory tools for the diagnosis of CAL.

AIM

To assess the usefulness of plasma C-reactive protein (CRP) and calprotectin (CLP) as early predictors of CAL.

METHODS

A prospective monocentric observational study was conducted including patients who underwent colorectal resection with anastomosis, from March 2017 to August 2019. Patients were divided into three groups: G1 – no complications; G2 – complications not related to CAL; and G3 – CAL. Five biomarkers were measured and analyzed in the first 5 postoperative days (PODs), namely white blood cell (WBC) count, eosinophil cell count (ECC), CRP, CLP, and procalcitonin (PCT). Clinical criteria, such as abdominal pain and clinical condition, were also assessed. The correlation between biomarkers and CAL was evaluated. Receiver operating characteristic (ROC) curve analysis was used to compare the accuracy of these biomarkers as predictors of CAL, and the area under the ROC curve (AUROC), specificity, sensitivity, positive predictive value, and negative predictive value (NPV) during this period were estimated.

RESULTS

In total, 25 of 396 patients developed CAL (6.3%), and the mean time for this diagnosis was 9.0 ± 6.8 d. Some operative characteristics, such as surgical approach, blood loss, intraoperative complications, and duration of the procedure, were notably related to the development of CAL. The length of hospital stay was markedly higher in the group that developed CAL compared with the group with complications other than CAL and the group with no complications (median of 21 d vs 13 d and 7 d respectively; P < 0.001). For abdominal pain, the best predictive performance was on POD4 and POD5, with the largest AUROC of 0.84 on POD4. Worsening of the clinical condition was associated with the diagnosis of CAL, presenting a higher predictive effect on POD5, with an AUROC of 0.9. WBC and ECC showed better predictive effects on POD5 (AUROC = 0.62 and 0.7, respectively). Those markers also presented a high NPV (94%-98%). PCT had the best predictive effect on POD5 (AUROC = 0.61), although it presented low accuracy. However, this biomarker revealed a high NPV on POD3, POD4, and POD5 (96%, 95%, and 96%, respectively). The mean CRP value on POD5 was significantly higher in the group that developed CAL compared with the group without complications (195.5 ± 139.9 mg/L vs 59.5 ± 43.4 mg/L; P < 0.00001). On POD5, CRP had a NPV of 98%. The mean CLP value on POD3 was significantly higher in G3 compared with G1 (5.26 ± 3.58 μg/mL vs 11.52 ± 6.81 μg/mL; P < 0.00005). On POD3, the combination of CLP and CRP values showed a high diagnostic accuracy (AUROC = 0.82), providing a 5.2 d reduction in the time to CAL diagnosis.

CONCLUSION

CRP and CLP are moderate predictors of CAL. However, the combination of these biomarkers presents an increased diagnostic accuracy, potentially decreasing the time to CAL diagnosis.

Key Words: Anastomotic leakage, Colorectal, Surgery, Biomarkers, C-reactive protein, Calprotectin

Core Tip: Colorectal anastomotic leakage (CAL) remains a serious postoperative complication. It is associated with high morbidity rates, affecting overall costs and patients’ quality of life. Clinical criteria, imaging studies, and biomarkers have been considered to increase diagnostic accuracy. Plasma C-reactive protein, calprotectin, procalcitonin, white blood cell count, and eosinophil cell count have been proposed as predictors of anastomotic leakage. The combination of C-reactive protein and calprotectin after a minimal clinical suspicion of CAL has shown good diagnostic accuracy, allowing clinicians to reduce the time to CAL detection. Regression models can facilitate building a decision model, as the score proposed for the early detection of CAL.



INTRODUCTION

Colorectal anastomotic leakage (CAL) is one of the most frequent complications after colorectal surgery, representing a dreaded issue for patients and surgeons. The reported incidence ranges from 0.2% to 27.2%, depending on the study nature, level of anastomosis, or pathology[1-5]. This occurrence is associated with increased morbidity, mortality, reoperation, and health care costs[6-9]. Thus, its clinical relevance should not be underestimated. It also has a negative impact on a patient’s quality of life[2,4].

Early CAL detection is key to decreasing related morbidity and mortality; therefore, a prompt and timely diagnosis is crucial[5,10,11]. Initially, it is difficult to distinguish CAL from other postoperative abdominal complications. Surgeons should be aware of subtle clinical signs, and then order additional tests including serum biomarkers, proper imaging, or even early reoperation. Unfortunately, diagnosis is often delayed, because of a misleading clinical picture, non-systematic assessment, or inconclusive investigations[11-15]. Besides clinical parameters, several biomarkers (plasma or intraperitoneal), imaging methods such as abdominal computed tomography (CT) scan or water-soluble contrast enema, and scores have been proposed to reduce the time to diagnosis and to establish an appropriate management pathway[16-19].

Plasma C-reactive protein (CRP) has been proposed as an early predictor of postoperative infectious complications[16,20-23]. This biomarker is an acute phase protein, increasing between 6 h and 48 h after surgery, and returning to baseline if inflammation ceases. After this period, a high CRP level is associated with postoperative infectious complications, especially in patients with CAL[24-26]. On the other hand, calprotectin (CLP) is a useful biomarker of inflammation and infection[18,27]. Fecal CLP has been widely used as a marker of gastrointestinal inflammation. However, some authors suggest that high levels of serum CLP could be associated with septic intra-abdominal complications, such as early-stage CAL[18,28].

The aim of this study was to evaluate the utility of plasma CRP and CLP, individually or combined, to shorten the time to CAL diagnosis.

MATERIALS AND METHODS
Study design and population

This was a prospective observational, single-center study that included adults over 18-years-old who underwent urgent or elective colorectal resection, regardless of the surgical approach (open or laparoscopic), indication (benign or malignant), and option for a protective stoma. The study was conducted in the colorectal division of a non-academic hospital accredited by Joint Commission International® and included about 500000 inhabitants. The data were collected between March 1, 2017 and August 31, 2019. The local ethics committee approved the study, and potential participants provided written informed consent before inclusion.

Definitions

CAL was defined in accordance with the following criteria[29]: (1) Clinical: Enteric discharge from abdominal drain or wound, rectovaginal fistula, or anastomotic defect found by digital examination; (2) Radiological (CT): Extravasation of endoluminally administered contrast, intra-abdominal collection around the anastomosis, presacral abscess near the anastomosis or perianastomotic air, and free intra-abdominal air; and (3) Surgical findings (reoperation): Necrosis of the anastomosis or signs of peritonitis and anastomotic defect.

Faced with clinical deterioration and/or serum biomarker increase, patients underwent further imaging with abdominopelvic CT scan (and water-soluble contrast enema if colorectal anastomosis was present). Once diagnosed, anastomotic leakage was classified into two categories: (1) Minor: Patients with CAL and Clavien-Dindo grade I or II, requiring no active intervention (radiological or surgical intervention) (Grade A of the International Study Group of Rectal Cancer definition); and (2) Major: All other patients with CAL[30,31]. Definitions of other postoperative complications, such as pneumonia, urinary tract infection, paralytic ileus, and surgical wound infection, are available in Supplementary material 1A (Definitions).

Exclusion criteria

Patients were excluded from the study if they were younger than 18-year-old, pregnant, unable to give or not providing written informed consent, R0 resection with anastomosis not having been performed, or presence of inflammatory bowel disease.

Study protocol and variables

Prospective data were collected and recorded in an electronic database according to the study protocol (Supplementary material 1B – Study protocol). Five biomarkers were measured in the first 5 posto-perative days (POD), including white blood cell (WBC) count, eosinophil cell count (ECC), CRP, CLP, and procalcitonin (PCT). Clinical criteria, such as abdominal pain and clinical condition, were also assessed. Blood samples were analyzed at the Leiria Hospital Centre laboratory, according to the techniques described in Supplementary material 1C (Laboratory). The 90-d follow-up included data of all postoperative complications, the length of hospital stay, and the readmission rate. Discharge criteria are available in the Supplementary material 1B (Study protocol). All patients received prophylactic antibiotic accordingly to hospital infection control committee protocol.

Statistical analysis

Data were analyzed by using standard descriptive statistics and graphical analysis. One-way analysis of variance was performed to compare the differences in mean biomarkers’ values across the three relevant groups of patients (G1 – no complications; G2 – complications not related to CAL; and G3 – CAL). Chi-squared tests were conducted to assess the association between other categorical variables and the patients. Receiver operating characteristic (ROC) curve analysis was employed to evaluate each biomarker as an appropriate classifier to detect CAL early. The area under the receiver operating characteristic curve (AUROC) was used to establish the diagnostic performance of the studied biomarker. Liu’s method was used to establish the threshold value of each biomarker, and its sensitivity (SS) and specificity (SP) were defined[32]. The negative likelihood ratio (NLR) and positive likelihood ratio (PLR), and the negative predictive value (NPV) and positive predictive value (PPV) were computed by combining the observed incidence of CAL with the estimated SS and SP at the optimum cut-off value.

The added value of combining two different biomarkers, observed on POD3 or POD5, as a classifier to predict early CAL was explored. Regression models (probit, logit, and complementary log-log) were used to analyze binary dependent variables, and the observed CAL status (0/1) in a pairwise manner of all biomarkers included in our study: WBC, ECC, CRP, PCT, and CLP. Several potential classifiers of CAL were built, applying a non-linear combination of two different biomarkers. To minimize overfitting, the “leave-one-out” methodology was adopted[33]. The AUROC graph was used to select the classifier (defined by the model and the combination of two biomarkers) with the best predictive diagnostic performance. Liu’s method was adopted to select the cut-off value for CAL.

The expected reduction in time to CAL diagnosis obtained by using one biomarker or a pairwise combination of biomarkers was estimated. This was the difference between the observed and the expected mean time to CAL diagnosis, if a specific classifier is used. The expected time to CAL diagnosis was computed by using the following expression: S × d1 + [(1 – S) × d2], where S is the SS of the classifier, d1 is the POD of the classifier yielding a positive cut-off value for CAL, and d2 is the day of diagnosis if the classifier provides a false-negative result (time to CAL diagnosis estimated in the dataset). The statistical methods of this study were reviewed by Óscar Lourenço from the Faculty of Economics, CeBER, University of Coimbra, Portugal. All data management and statistical analyses were conducted with Stata Statistical software (Release 16; StataCorp, College Station, TX, United States).

RESULTS
Patients and outcomes

During the study period, we included 458 consecutive patients who underwent colorectal resection, and 62 (13.5%) were ruled out [exclusion criteria (n = 31), no consent (n = 15), no anastomosis (n = 16)] as shown in Figure 1. Patient characteristics, divided into three groups (G1, G2, and G3, as previously defined), are shown in Table 1. Age, the Charlson Comorbidity Index, and American Society of Anesthesiologists grade seem to affect CAL onset.

Figure 1
Figure 1 Flow diagram of patients according to the study protocol. POD1: Postoperative day 1.
Table 1 Patient demographic and clinical characteristics.

Group 1, n = 277
Group 2, n = 94
Group 3, n = 25
P value
Age, mean ± SD68.8 ± 11.372.2 ± 14.573.6 ± 13.60.02
Sex, n (%)0.505
Male161 (58.1)59 (62.7)17 (68.0)
Female116 (41.9)35 (37.3)8 (32.0)
BMI, mean ± SD26.8 ± 3.9926.3 ± 4.0526.0 ± 3.970.33
BMI, n (%)0.33
17.5 < BMI < 2595 (35.0)32 (34.0)12 (48.0)
25 ≤ BMI < 30129 (46.0)51 (54.0)9 (36.0)
BMI ≥ 3053 (19.0)11 (12.0)4 (16.0)
CCI, mean ± SD5.12 ± 1.835.55 ± 2.386.04 ± 2.150.03
Prior abdominal surgery, n (%)77 (27.8)32 (34.0)9 (36.0)0.41
Immunosuppression, n (%)10 (3.6)5 (5.3)0 (0)0.45
Preoperative diagnosis malignant, n (%)272 (98.2)90 (95.7)24 (96.0)0.38
ASA score, n (%)0.018
I–II 187 (67.5)47 (50.0)13 (45.8)
III–IV 90 (32.5)47 (50.0)12 (54.2)

Table 2 summarizes the main operative characteristics. Eighty-two percent of patients had a laparoscopic approach, and the most common procedures performed were right colectomy (n = 196; 49.5%) and sigmoid colectomy/rectosigmoid resection (n = 74; 18.7%). The surgical approach (P < 0.001), the volume of blood loss (P < 0.001), the occurrence of intraoperative complications (P < 0.001), and the duration of the procedure (P = 0.011) were significantly related to the development of CAL.

Table 2 Patients’ operative characteristics.

Group 1, n = 277
Group 2, n = 94
Group 3, n = 25
P value
Type of surgery, n (%)0.071
Elective238 (86.0)72 (76.6)19 (75.0)
Urgent39 (14.0)22 (23.4)6 (25.0)
Surgical approach, n (%)< 0.001
Open25 (9.0)15 (16.0)2 (8.0)
Laparoscopic238 (86.0)72 (77.0)15 (60.0)
Conversion14 (5.0)7 (7.4)8 (32.0)
Procedure, n (%)0.739
Right colectomy1138 (49.8)47 (50.0)11 (44.0)
Left colectomy17 (6.1)7 (7.4)1 (4.0)
Sigmoid/RS resection55 (19.8)15 (15.9)4 (16.0)
Low anterior resection48 (17.3)16 (17.0)8 (32.0)
Other19 (6.8)9 (9.6)1 (4.0)
Level of anastomosis, n (%)0.66
Ileocolic150 (54.1)50 (53.2)11 (44.0)
Colocolic23 (8.3)5 (5.3)1 (4.0)
≥ 6 cm from AV67 (24.2)25 (26.6)10 (40.0)
< 6 cm from AV37 (13.4)14 (14.9)3 (12.0)
Covering stoma, n (%)23 (8.3)8 (8.51)2 (8.0)0.99
Blood loss, mean ± SD, mL51.6 ± 36.658.8 ± 47.7104.0 ± 191.1< 0.001
Intraoperative complications, n (%)3 (1.1)5 (5.3)4 (16.0)< 0.001
Operative time in min, mean ± SD141.9 (48.3)146.2 (50.0)172.8 (57.2)0.011

In this study, CAL developed in 25 of 396 patients (6.3%) and was more frequent in men than women (68% vs 32%). Twenty-three patients with CAL (92.0%) were diagnosed during the first hospital admission. The mean ± SD and median time for CAL detection were 9.0 ± 6.8 d and 8 d (interquartile range = 7), respectively. Anastomotic leak was significantly associated with a longer hospital stay (median of 21 d vs 7 d and 13 d, in G1 and G2 patients, respectively; P < 0.001), the readmission rate (20% vs 6.4% and 5.4%), and the reoperation rate (12% vs 3.2% and 1.8%). Table 3 provides a summary of 90-d morbidity and mortality rates. Based on the Clavien-Dindo classification, grades III and IV complication were significantly higher in the G3 cohort (84.0% vs 17.0%; P < 0.001) (Table 4).

Table 3 Ninety-day postoperative morbidity and mortality.

Patients, n (%)
Length of hospital stay in d, mean ± SD
With complications119 (30.0)16.4 ± 9.91
With no complications277 (70)7.4 ± 2.10
Noninfectious complications49 (41.2)14.2 ± 6.93
Infectious complications
Surgical wound36 (30.3)14.6 ± 8.34
Respiratory tract10 (8.4)16.1 ± 7.22
Urinary tract11 (9.2)16.2 ± 6.00
Anastomotic leakage classification
Minor7 (28)28.0 ± 17.00
Major18 (72)22.4 ± 12.88
Postoperative mortality3 (0.8)NA
Table 4 Short-term outcomes by group.

Group 1, n = 277
Group 2, n = 94
Group 3, n = 25
P value
LOHS in d< 0.001
mean ± SD7.4 ± 2.114.3 ± 7.424.0 ± 14.0
Median71321
90-d morbidity, n (%)< 0.001
Clavien-Dindo INA64 (68.1)0 (0)
Clavien-Dindo II14 (14.9)4 (16.0)
Clavien-Dindo III8 (8.5)16 (64.0)
Clavien-Dindo IV8 (8.5)5 (20.0)
Readmission, n (%)15 (5.4)6 (6.4)5 (20.0)0.019
Reoperation, n (%)4 (1.1)3 (3.2)3 (12.0)0.005
90-d mortality, n (%)0 (0)0 (0)3 (12.0)< 0.001

Table 5 outlines the intraoperative and postoperative details of patients with CAL (G3) based on the CAL classification (minor vs major). Seven patients (28.0%) were managed nonoperatively and two (8.0%) underwent radiologic drainage of intraabdominal collections. The remaining 16 patients (64.0%) required surgical intervention. Of the 16 reoperated patients, 10 (56%) had an anastomosis takedown with an end stoma and 6 (44%) received a defunctioning stoma. The 90-d mortality rate was 0.8%, representing 3 patients with CAL.

Table 5 Intraoperative and postoperative details of patients with colorectal anastomotic leakage (minor vs major).

Minor CAL, n = 7
Major CAL, n = 18
P value
Type of anastomosis, n (%)0.52
Intrabdominal3 (42.8)9 (50.0)
Pelvic4 (57.2)9 (50.0)
Covering stoma, n (%)1 (14.3)1 (5.6)0.47
Abdominal pain
POD31.861.940.08
POD41.572.130.04
POD51.861.920.03
Clinical condition
POD311.250.07
POD41.141.470.13
POD51.291.580.02
CRP levels in mg/L
POD3178.35221.020.28
POD4146.30226.010.13
POD5107.64251.450.01
CLP levels in μg/mL
POD32.7512.99< 0.001
POD43.3410.600.01
POD52.5210.960.004
CAL diagnosis in d, median85.50.07
Diagnostic method, n (%)0.12
Clinical0 (0)7 (38.9)
Abdominopelvic CT7 (100)11 (61.1)
CAL management, n (%)< 0.001
DrainageNA2 (11.1)
Reoperation16 (88.9)
LOHS in d, mean ± SD28.0 ± 17.022.4 ± 12.90.38
Clinical criteria – postoperative trend and predictive effect

Abdominal pain: Abdominal pain was markedly higher and persistent from POD3 onwards in G3 patients (Figure 2A). The AUROC for abdominal pain on POD3, POD4, and POD5 was 0.77, 0.84, and 0.83, respectively, as shown in Supplementary Table E (Supplementary material 2A) and Figure 3A. The predictive effect was higher on POD4 with an estimated AUROC of 0.84.

Figure 2
Figure 2 Distribution of rates of abdominal pain (A) and clinical condition (B). G1: No complications; G2: Complications not related to colorectal anastomotic leakage; G3: CAL. POD: Postoperative day.
Figure 3
Figure 3 Area under the receiver operating characteristic curve of colorectal anastomotic leakage for clinical criteria. A: Abdominal pain from postoperative day 1 to postoperative day 5; B: Clinical condition from postoperative day 1 to postoperative day 5. POD: Postoperative day.

Clinical condition: The clinical condition was worse in G3 compared with G2 patients, and it was significantly different after POD3 (P = 0.001). The overall postoperative trend was a declining clinical condition, as shown in Figure 2B. The AUROC for the clinical condition on POD3, POD4, and POD5 was 0.62, 0.81, and 0.90, respectively, as shown in Supplementary Table E (Supplementary material 2A) and Figure 3B. The prediction effect was higher on POD5 with an estimated AUROC of 0.90.

Biomarkers – postoperative trend and predictive effect

WBC count and ECC: During the first five POD, WBC in G3 patients was higher than that in patients without CAL and was significantly different on POD2, POD4, and POD5 (P = 0.01 for each day). On the other hand, ECC was lower in G3 patients and significantly different on POD1 and POD5 (P = 0.04 and P = 0.01, respectively), as presented in Supplementary Figures 1 and 2 (Supplementary material 2B). Overall, the postoperative course showed a sustained trend for both blood cell counts, except for ECC on POD5. The AUROC for WBC and ECC from POD1 to POD5 is presented in Supplementary Figures 3 and 4, respectively ( Supplementary material 2B). The predictive effects of blood cell count were better on POD5. On POD5, when ECC was greater than 250 cells/μL, the AUROC, SS, and SP were 0.70, 89.0%, and 43.0%, respectively, as shown in Table 6.

Table 6 Summary of the predictive performance of the studied plasma biomarkers.

AUROC
Cut-off value
SS
SP
NPV
PPV
PLR
NLR
WBC in g/L
POD30.579.750.460.750.950.111.840.72
POD4 0.608.250.520.680.960.101.640.70
POD50.627.550.560.620.950.091.480.71
ECC in cells/μL
POD30.591500.500.590.950.081.230.84
POD4 0.541500.330.710.940.071.140.94
POD50.702500.890.430.980.101.550.26
CRP in mg/L
POD30.76175.900.640.830.970.203.770.44
POD4 0.76152.400.620.890.970.275.400.43
POD50.8196.800.780.780.980.193.480.29
PCT in ng/mL
POD30.570.190.680.470.960.081.280.68
POD4 0.500.310.380.760.950.101.560.82
POD50.610.390.440.790.960.122.100.71
CLP in μg/mL
POD30.786.570.710.720.970.152.550.40
POD4 0.678.340.560.860.970.213.890.51
POD50.656.980.580.800.970.162.840.52

CRP, PCT, and CLP: The mean values of CRP, PCT, and CLP increased promptly after surgery in all groups. CRP decreased in G1 patients and remained elevated in patients with a complicated postoperative course, but was significantly higher than in G3 patients. On POD5, the mean CRP level in G3 patients was significantly higher than that in G1 patients (195.5 ± 139.9 mg/L vs 59.5 ± 43.4 mg/L; P < 0.00001) (Figure 4A). Patients with major CAL had a higher mean CRP level than those with minor CAL (251.45 mg/dL vs 107.64 mg/dL; P = 0.01) (Table 5). On POD3, POD4, and POD5, the overall diagnostic accuracy of CRP to detect CAL was expressed by an AUROC of 0.76, 0.76, and 0.81, respectively (Figure 5A). On POD5, the optimum cut-off value of 96.8 mg/L was estimated, resulting in an SS and SP of 78%, an NPV of 98%, and a PPV of 19% (Table 6).

Figure 4
Figure 4 C-reactive protein (A) and calprotectin (B) levels. Values are the mean ± SE. G1: No complications; G2: Complications not related to colorectal anastomotic leakage; G3: CAL; ▲: P statistically significant (P < 0.05).
Figure 5
Figure 5 Area under the receiver operating characteristic curve of colorectal anastomotic leakage. A: For C-reactive protein from postoperative day 1 to postoperative day 5; B: For calprotectin from postoperative day 1 to postoperative day 5; C: For calprotectin from postoperative day 3 to postoperative day 5; D: For C-reactive protein from postoperative day 3 to postoperative day 5. Left: All leaks; Right: Major leaks; POD: Postoperative day.

The PCT level tended to be stable from POD3 onwards. The mean values were higher in G3 patients than in patients without CAL, but without statistical significance [on POD5, 0.23 ± 0.08 ng/mL vs 0.22 ± 0.07 ng/mL; Supplementary Figure 5 (Supplementary material 2C)]. The AUROC on POD3, POD4, and POD5 was 0.57, 0.50, and 0.61, respectively, as shown in Supplementary Figure 6 (Supplementary material 2C). The best predictive effect was on POD5. When PCT was greater than 0.39 ng/mL, the SS and SP were 44.0% and 79.0%, respectively (Table 6).

In the first 5 POD, the mean CLP value tended to follow the pattern of CRP, although it was not as pronounced (Figure 4B). The mean CLP value was significantly higher in G3 patients from POD2 onwards. On POD3, the mean values of G1 vs G3 patients were 5.26 ± 3.58 μg/mL vs 11.52 ± 6.81 μg/mL (P < 0.00005). On POD3, POD4, and POD5, the CLP AUROC was 0.78, 0.67, and 0.65, respectively, as presented in Table 6 and Figure 5B. On POD3, a cut-off value of 6.57 μg/mL yielded a sensitivity of 71.0% and a specificity of 72.0% (Table 6).

Finally, when we analyzed the best predictors (CRP and CLP) for major CAL, the AUROC of CRP was 0.74 and 0.88 for POD3 and POD5, respectively. CLP was a better predictor of CAL than CRP at POD3, with an AUROC of 0.92 (Figure 5C and D).

Combination of biomarkers: Tables 7 and 8 present the AUROC of several possible classifiers of CAL, built with the Probit model, on POD3 and POD5, respectively. The combination of CRP and CLP on POD3 showed the best performance, with an AUROC of 0.82 (Table 7). Of note, on POD5, the combination of CRP and ECC also generated good predictive performance (AUROC = 0.81). However, with the aim of early CAL diagnosis, we chose the combination of CRP and CLP on POD3. Thereafter, we determined the probability of CAL, based on the computed equation P (CAL) = F [-3.0842 + (0.094 × CLP_D3) + (0.0059 × CRP_D3)], where F is the cumulative standard normal distribution. Applying Liu’s method, this classifier had an optimum cut-off point of 0.055, evidencing the existence of CAL above 0.055 on POD3, with an SS and SP of 86% and 75%, respectively. For hypothetical patient X on POD3 with CRP and CLP plasma levels of 137.4 mg/L and 8.75 μg/mL, respectively, the computed probability of CAL is high (score = 0.074). By adopting this classifier, the time to CAL diagnosis is estimated as 3.8 d [(0.86 × 3) + (0.14 × 9.0)], which represents a 5.2-d reduction compared with the baseline results.

Table 7 Area under the receiver operating characteristic curve of pairwise combination of biomarkers on postoperative day 3.

CLP
PCT
CRP
ECC
PCT0.76
CRP0.820.72
ECC0.770.520.72
WBC0.740.530.720.54
Table 8 Area under the receiver operating characteristic curve of pairwise combination of biomarkers on postoperative day 5.

CLP
PCT
CRP
ECC
PCT0.60
CRP0.780.79
ECC0.610.630.81
WBC0.570.600.780.67
DISCUSSION

This study assessed the usefulness of biomarkers for the early detection of CAL. Clinical criteria demonstrated high diagnostic accuracy (AUROC > 0.8) on POD4 and POD5. Changes in the abdominal pain pattern and worsening of the clinical condition were associated with an increased risk of CAL diagnosis. Both clinical criteria seem to be an useful early markers for this condition, producing the best overall diagnostic accuracy of the parameters analyzed. Three large and well-conducted studies on the association between pain and postoperative complications are worth reporting. Boström et al[34] examined a cohort of 3084 patients and estimated that increased postoperative pain is associated with a high risk of CAL, being an independent marker and suggesting a need for further diagnostic measures. The other two studies had similar conclusions, although they were not exclusive for colorectal surgery[14,35]. A worse clinical condition and abdominal pain not localized to the wound are two of four modified Dutch leakage (DULK) score criteria, scoring 1 point each. Using a cut-off value of 1 point produced an overall SS and NPV of 97.0% and 99.5%, respectively[10]. We should bring the clinical method to the forefront, being aware of the clinical signs of CAL. They are very helpful for the early diagnosis, as “red flags” for further investigation.

In our study, particularly on POD4 and POD5, WBC and ECC showed a distinct tendency in patients with and without CAL, with a high NPV (from 94%-98%) but low accuracy (AUROC from 0.54 to 0.70). In G3 patients, WBC plateaued after the acute inflammatory response, a phenomenon that was notably different from patients without CAL. In a large retrospective study, Warschkow et al[16] found that the WBC level contributed little to the early detection of septic complications, with a lower diagnostic accuracy than plasma CRP. In several other studies, researchers have estimated, from POD5 to POD7, an AUROC and SS ranging from 0.63 to 0.82 and from 58% to 74%, respectively[15,16,20,24,35].

Some researchers have proposed eosinopenia as a biomarker in this scenario. They concluded that it might help to identify several sepsis-related conditions, distinguished from other causes of systemic inflammatory response syndrome. It seems to be an interesting biomarker because of its widespread availability and low cost[36]. Shaaban et al[37] defined an optimum cut-off value of 50 cells/μL, which produced an SS, SP, and NPV of 81%, 65% and 80%, respectively. At hospital admission, ECC < 40 cells/μL is an independent prognostic factor for mortality[38,39]. Our study is original in assessing the usefulness of ECC for the early diagnosis of CAL. The mean ECC level showed a non-significant decline after POD4 in G3 patients, and a modest diagnostic accuracy (AUROC from 0.54 to 0.70) when compared with other biomarkers. Nevertheless, ECC could still be used in CAL diagnosis as a fast, simple, convenient, and inexpensive biomarker. It should be considered in the decision-making process and future research[40].

The usefulness of CRP as a biomarker for early detection of CAL has been investigated by several groups[19,25,39,41,42]. In this study, the plasma CRP level exhibited a propensity to normalize from POD3 onwards in patients without CAL (G1 and G2). However, it remained steadily increased in G3 patients, with a markedly high mean value from POD1 to POD5. Yeung et al[43] performed the most comprehensive meta-analysis available in the literature, including nearly 7000 patients pooled from 23 studies. From POD1 to POD7, patients with CAL had a significantly higher mean CRP level compared with patients without CAL (P < 0.001)[43]. In this study, CRP was the best predictor for CAL on POD4 and POD5, with a maximum AUROC of 0.81 (cut-off value of 96.8 mg/L and an NPV of 98%) on POD5. Similar results have been published by other authors. Ortega-Deballon et al[26] estimated on POD4 an AUROC of 0.72 with a cut-off of 125 mg/L, yielding an SS and NPV of 81.8% and 95.8%, respectively. Garcia-Granero et al[25] reported that CRP level showed a good predictive ability for major CAL on POD5, with an AUROC of 0.85 (cut-off value of 135 mg/L and an NPV of 98%). In the Italian ColoRectal Anastomotic Leakage (iCral) multicentric prospective observational study, the CRP level was a good positive and excellent negative predictor of CAL, with an AUROC of 0.81 on POD6 (cut-off value of 81.5 mg/L), and an SS and NPV of 80.9% and 97.7%, respectively[41]. In the meta-analysis by Yeung et al[43], AUROC analysis established a threshold CRP level for CAL of 115 mg/L on POD5, with an SS and SP of 100%. All of these authors recommended CRP levels to predict CAL, and our group advocates a similar practice and suggests the use of this biomarker to expedite further investigation and treatment[25,26,41,43].

CLP, a sign of neutrophil activation, could be a promising early marker for excessive inflammatory response in major abdominal catastrophes, such as CAL. To date, only Reisinger et al[18] have studied the predictive value of CLP in CAL diagnosis. In G3 patients, the mean postoperative CLP level peaked on POD3 and was notably higher, persisting thereafter. On POD3, the AUROC (0.78) and SS (71%) were slightly higher than the CRP level, although they were lower than those obtained in the pioneering study by Reisinger et al[18] (0.92 and 86%, respectively). One possible explanation could be our comprehensive definition of CAL and the larger sample size. It remains unclear to what extent CLP level is an early predictor that is better than CRP for detecting CAL. As a neutrophil activation marker, CLP could be increased early after anastomotic failure, compared with CRP, which indicates a delayed systemic inflammatory response. Our study shows that CLP is worth evaluating for early diagnosis of CAL.

We demonstrated in the first 5 POD, the mean PCT values were marginally higher in G3 patients but with lower accuracy, SS, and SP than CRP and CLP levels. However, it had a high NPV (> 95%), making it an adequate and useful marker for early and safe discharge after colorectal surgery, considering the current enhanced recovery after surgery routine. In contrast to our study, Giaccaglia et al[17] estimated that on POD5, PCT had better accuracy than CRP (0.86 vs 0.81), as well as a high NPV (98.3%). A recent meta-analysis published by Su'a et al[44] determined a diagnostic accuracy of 0.88 on POD5 and an optimum cut-off value on POD3 and POD5 of 0.25 and 680 ng/mL, respectively. The NPV ranged from 95% to 100%. In agreement with these authors, we believe that PCT is a useful negative predictor for CAL; as a single test, however, it is worthless for CAL diagnosis.

We verified that, with the exception of plasma CRP on POD5 (AUROC > 0.80), each biomarker individually was a modest predictor of CAL[45]. The combination of two or more biomarkers has been considered in previous studies[17,18,41]. In this study, the combination of CRP and CLP values on POD3 increased diagnostic accuracy, shortening the mean CAL diagnosis by 5 d. This reduction would likely lead to reduced morbidity and mortality. Reisinger et al[18] confirmed a significant improvement in diagnostic accuracy (AUROC = 0.93) with the combination of CRP and CLP plasma levels on POD3, an SS of 100%, and an SP of 89.0%, decreasing the median time to diagnosis by 3 d. Furthermore, Giaccaglia et al[17] found that by adding PCT to CRP on POD5, the diagnostic accuracy markedly improved (AUROC = 0.90). Similarly, the iCral study demonstrated that the combination of CRP and PCT with a clinical score (DULK score) allowed the exclusion of CAL on POD2 (NPV = 99%)[41]. We believe that a user-friendly diagnostic tool, combining CLP and CRP levels by this mathematic model, would help the surgeon to diagnose CAL early. Consequently, this biomarkers’ combination may be included in a standard postoperative surveillance program, as a warning tool for CAL. In the case of a “positive test”, this protocol recommends abdominal and pelvic CT scan or early reoperation in case of imaging-dubious or -negative, to reduce the time to CAL detection and enable prompt management.

Strengths and limitations of the study

One strength of this study was its prospective design and independent data collection model, which minimized observer bias. Second, it was one of the largest monocentric sample size published to date. Based on the recent meta-analyses of Waterland et al[46] van Helsdingen et al[47], only two monocentric prospective studies have enrolled more than 400 patients. Furthermore, we analyzed five biomarkers, including plasma CLP, which was first studied by Reisinger et al[18]. Third, we chose a comprehensive definition of CAL, recently defined by van Helsdingen et al[29] to include all patients with CAL, minimizing selection bias. We did not exclude minor CAL from the cohort, which also affected the predictive effect of the analyzed biomarkers. In addition, to keep the biomarkers optimum cut-off values in AUROC analysis both standardized and reproducible, we adopted Liu’s method. This method defines the optimum cut-off point as the point maximizing the product of SS and SP[48]. These reasons may explain some differences in biomarkers’ diagnostic accuracy in this study. Fourth, we tried to adapt the study protocol to daily practice, making its enforcement easier in the future. Hence, we included all patients undergoing colorectal resection, even those with a diverting ostomy. In addition, clinicians were not blinded to the daily biomarkers’ results and might use those data according to the study protocol. Finally, we proposed a predictive tool based on the combination of two biomarkers that improved CAL diagnostic accuracy. Adoption of this tool in daily practice might shorten the time to CAL diagnosis and management. Moreover, the data from this study provide information for the development of more complex mathematical predictive models, including machine learning methods.

This study had several limitations. First, the monocentric design may limit the external validity of the results. Second, our sample had some grade of heterogeneity, because the study population included benign and malignant disorders, elective and urgent procedures, and anastomosis within different levels of the colon and rectum. Third, we designed a phase I diagnostic study and estimated cut-off values for early CAL detection. However, we should change the direction of interpretation, running from the diagnostic test result toward the CAL diagnosis. To address this issue, we are performing a new multicentric prospective phase II diagnostic study, using the predictive tool and defined biomarkers cut-off values[49]. Fourth, plasma CLP measurement is expensive and these kits are not easily accessible in daily clinical practice. Finally, our study did not address the cost-effectiveness of biomarkers’ measurement. It is crucial to estimate the economic burden of CAL, including the cost related to a delayed diagnosis, the high rate of false positives, and unjustified reoperations or frequent readmissions.

CONCLUSION

In conclusion, we found that clinical criteria have added value as a warning sign of CAL. On the other hand, CRP and CLP levels are the best early predictors of CAL. Particularly relevant is the combination of CLP and CRP early during POD3, and its potential to markedly reduce the time to diagnosis of CAL. By reducing the time to CAL diagnosis, reduced morbidity and mortality are expected. Additional studies are needed to confirm the predictive ability of this model on early CAL detection and its utility in routine clinical care.

ARTICLE HIGHLIGHTS
Research background

Colorectal anastomotic leakage (CAL) is a major complication in abdominal surgery. Prompt diagnosis can reduce morbidity and mortality associated with this condition. Serum biomarkers have been proposed as predictors of CAL.

Research motivation

Biomarkers such as C-reactive protein (CRP) and white blood cell (WBC) count are frequently requested in the postoperative period of colorectal surgery. However, the usefulness of these and other biomarkers remains unclear.

Research objectives

To assess the role of CRP, WBC, eosinophil cell count, calprotectin (CLP), and procalcitonin in the first 5 postoperative days (PODs) after colorectal surgery, and thus, discuss in what order these biomarkers can be employed in clinical practice.

Research methods

From March 2017 to August 2019, we measured and analyzed five serum biomarkers daily in 396 patients who underwent colorectal surgery. The area under the receiver operating characteristic curve, specificity, sensitivity, positive predictive value (PPV), and negative predictive value (NPV) were used to estimate the best predictive diagnostic performance.

Research results

CRP had an NPV of 98% on POD5. The combination of CLP and CRP measurement presented a high diagnostic accuracy (AUCROC = 0.82) on POD3. We identified a reduction of 5.2 d to the diagnosis of CAL.

Research conclusions

The combination of CRP and CLP demonstrated good diagnostic accuracy. These tests can likely be used to reduce time to CAL detection.

Research perspectives

Further studies should test a warning index score built from selected predictive variables as biomarkers CRP and CLP.

Footnotes

Provenance and peer review: Unsolicited article; Externally peer reviewed.

Peer-review model: Single blind

Specialty type: Surgery

Country/Territory of origin: Portugal

Peer-review report’s scientific quality classification

Grade A (Excellent): 0

Grade B (Very good): B

Grade C (Good): C

Grade D (Fair): D

Grade E (Poor): 0

P-Reviewer: Fiori E, Italy; Kayano H, Japan; Yan T, China S-Editor: Ma YJ L-Editor: A P-Editor: Ma YJ

References
1.  Boccola MA, Buettner PG, Rozen WM, Siu SK, Stevenson AR, Stitz R, Ho YH. Risk factors and outcomes for anastomotic leakage in colorectal surgery: a single-institution analysis of 1576 patients. World J Surg. 2011;35:186-195.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 135]  [Cited by in F6Publishing: 141]  [Article Influence: 10.8]  [Reference Citation Analysis (0)]
2.  Trencheva K, Morrissey KP, Wells M, Mancuso CA, Lee SW, Sonoda T, Michelassi F, Charlson ME, Milsom JW. Identifying important predictors for anastomotic leak after colon and rectal resection: prospective study on 616 patients. Ann Surg. 2013;257:108-113.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 218]  [Cited by in F6Publishing: 213]  [Article Influence: 19.4]  [Reference Citation Analysis (0)]
3.  Pommergaard HC, Gessler B, Burcharth J, Angenete E, Haglind E, Rosenberg J. Preoperative risk factors for anastomotic leakage after resection for colorectal cancer: a systematic review and meta-analysis. Colorectal Dis. 2014;16:662-671.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 136]  [Cited by in F6Publishing: 141]  [Article Influence: 14.1]  [Reference Citation Analysis (0)]
4.  McDermott FD, Heeney A, Kelly ME, Steele RJ, Carlson GL, Winter DC. Systematic review of preoperative, intraoperative and postoperative risk factors for colorectal anastomotic leaks. Br J Surg. 2015;102:462-479.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 427]  [Cited by in F6Publishing: 492]  [Article Influence: 54.7]  [Reference Citation Analysis (0)]
5.  Smith SR, Pockney P, Holmes R, Doig F, Attia J, Holliday E, Carroll R, Draganic B. Biomarkers and anastomotic leakage in colorectal surgery: C-reactive protein trajectory is the gold standard. ANZ J Surg. 2018;88:440-444.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 37]  [Cited by in F6Publishing: 40]  [Article Influence: 5.7]  [Reference Citation Analysis (0)]
6.  Iancu C, Mocan LC, Todea-Iancu D, Mocan T, Acalovschi I, Ionescu D, Zaharie FV, Osian G, Puia CI, Muntean V. Host-related predictive factors for anastomotic leakage following large bowel resections for colorectal cancer. J Gastrointestin Liver Dis. 2008;17:299-303.  [PubMed]  [DOI]  [Cited in This Article: ]
7.  Cousin F, Ortega-Deballon P, Bourredjem A, Doussot A, Giaccaglia V, Fournel I. Diagnostic Accuracy of Procalcitonin and C-reactive Protein for the Early Diagnosis of Intra-abdominal Infection After Elective Colorectal Surgery: A Meta-analysis. Ann Surg. 2016;264:252-256.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 55]  [Cited by in F6Publishing: 66]  [Article Influence: 9.4]  [Reference Citation Analysis (0)]
8.  Watson AJ, Krukowski ZH, Munro A. Salvage of large bowel anastomotic leaks. Br J Surg. 1999;86:499-500.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 18]  [Cited by in F6Publishing: 18]  [Article Influence: 0.7]  [Reference Citation Analysis (0)]
9.  Matthiessen P, Henriksson M, Hallböök O, Grunditz E, Norén B, Arbman G. Increase of serum C-reactive protein is an early indicator of subsequent symptomatic anastomotic leakage after anterior resection. Colorectal Dis. 2008;10:75-80.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 10]  [Cited by in F6Publishing: 44]  [Article Influence: 2.8]  [Reference Citation Analysis (0)]
10.  den Dulk M, Witvliet MJ, Kortram K, Neijenhuis PA, de Hingh IH, Engel AF, van de Velde CJ, de Brauw LM, Putter H, Brouwers MA, Steup WH. The DULK (Dutch leakage) and modified DULK score compared: actively seek the leak. Colorectal Dis. 2013;15:e528-e533.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 10]  [Cited by in F6Publishing: 17]  [Article Influence: 1.5]  [Reference Citation Analysis (0)]
11.  Rojas-Machado SA, Romero M, Arroyo A, Rojas-Machado A, López J, Calpena R. Anastomic leak in colorectal cancer surgery. Development of a diagnostic index (DIACOLE). Int J Surg. 2016;27:92-98.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 4]  [Cited by in F6Publishing: 5]  [Article Influence: 0.6]  [Reference Citation Analysis (0)]
12.  Doeksen A, Tanis PJ, Vrouenraets BC, Lanschot van JJ, Tets van WF. Factors determining delay in relaparotomy for anastomotic leakage after colorectal resection. World J Gastroenterol. 2007;13:3721-3725.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in CrossRef: 45]  [Cited by in F6Publishing: 44]  [Article Influence: 2.6]  [Reference Citation Analysis (0)]
13.  Marres CCM, van de Ven AWH, Leijssen LGJ, Verbeek PCM, Bemelman WA, Buskens CJ. Colorectal anastomotic leak: delay in reintervention after false-negative computed tomography scan is a reason for concern. Tech Coloproctol. 2017;21:709-714.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 22]  [Cited by in F6Publishing: 24]  [Article Influence: 3.4]  [Reference Citation Analysis (0)]
14.  Regenbogen SE, Mullard AJ, Peters N, Brooks S, Englesbe MJ, Campbell DA Jr, Hendren S. Hospital Analgesia Practices and Patient-reported Pain After Colorectal Resection. Ann Surg. 2016;264:1044-1050.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 13]  [Cited by in F6Publishing: 15]  [Article Influence: 2.1]  [Reference Citation Analysis (0)]
15.  Sutton CD, Marshall LJ, Williams N, Berry DP, Thomas WM, Kelly MJ. Colo-rectal anastomotic leakage often masquerades as a cardiac complication. Colorectal Dis. 2004;6:21-22.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 27]  [Cited by in F6Publishing: 31]  [Article Influence: 1.6]  [Reference Citation Analysis (0)]
16.  Warschkow R, Tarantino I, Torzewski M, Näf F, Lange J, Steffen T. Diagnostic accuracy of C-reactive protein and white blood cell counts in the early detection of inflammatory complications after open resection of colorectal cancer: a retrospective study of 1,187 patients. Int J Colorectal Dis. 2011;26:1405-1413.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 63]  [Cited by in F6Publishing: 61]  [Article Influence: 4.7]  [Reference Citation Analysis (0)]
17.  Giaccaglia V, Salvi PF, Antonelli MS, Nigri G, Pirozzi F, Casagranda B, Giacca M, Corcione F, de Manzini N, Balducci G, Ramacciato G. Procalcitonin Reveals Early Dehiscence in Colorectal Surgery: The PREDICS Study. Ann Surg. 2016;263:967-972.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 67]  [Cited by in F6Publishing: 76]  [Article Influence: 9.5]  [Reference Citation Analysis (0)]
18.  Reisinger KW, Poeze M, Hulsewé KW, van Acker BA, van Bijnen AA, Hoofwijk AG, Stoot JH, Derikx JP. Accurate prediction of anastomotic leakage after colorectal surgery using plasma markers for intestinal damage and inflammation. J Am Coll Surg. 2014;219:744-751.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 40]  [Cited by in F6Publishing: 46]  [Article Influence: 4.6]  [Reference Citation Analysis (0)]
19.  den Dulk M, Noter SL, Hendriks ER, Brouwers MA, van der Vlies CH, Oostenbroek RJ, Menon AG, Steup WH, van de Velde CJ. Improved diagnosis and treatment of anastomotic leakage after colorectal surgery. Eur J Surg Oncol. 2009;35:420-426.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 87]  [Cited by in F6Publishing: 99]  [Article Influence: 6.2]  [Reference Citation Analysis (0)]
20.  Welsch T, Müller SA, Ulrich A, Kischlat A, Hinz U, Kienle P, Büchler MW, Schmidt J, Schmied BM. C-reactive protein as early predictor for infectious postoperative complications in rectal surgery. Int J Colorectal Dis. 2007;22:1499-1507.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 142]  [Cited by in F6Publishing: 144]  [Article Influence: 8.5]  [Reference Citation Analysis (0)]
21.  Silvestre J, Rebanda J, Lourenço C, Póvoa P. Diagnostic accuracy of C-reactive protein and procalcitonin in the early detection of infection after elective colorectal surgery - a pilot study. BMC Infect Dis. 2014;14:444.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 36]  [Cited by in F6Publishing: 39]  [Article Influence: 3.9]  [Reference Citation Analysis (0)]
22.  Kørner H, Nielsen HJ, Søreide JA, Nedrebø BS, Søreide K, Knapp JC. Diagnostic accuracy of C-reactive protein for intraabdominal infections after colorectal resections. J Gastrointest Surg. 2009;13:1599-1606.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 97]  [Cited by in F6Publishing: 97]  [Article Influence: 6.5]  [Reference Citation Analysis (0)]
23.  Facy O, Paquette B, Orry D, Binquet C, Masson D, Bouvier A, Fournel I, Charles PE, Rat P, Ortega-Deballon P; IMACORS Study. Diagnostic Accuracy of Inflammatory Markers As Early Predictors of Infection After Elective Colorectal Surgery: Results From the IMACORS Study. Ann Surg. 2016;263:961-966.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 85]  [Cited by in F6Publishing: 92]  [Article Influence: 11.5]  [Reference Citation Analysis (0)]
24.  Lagoutte N, Facy O, Ravoire A, Chalumeau C, Jonval L, Rat P, Ortega-Deballon P. C-reactive protein and procalcitonin for the early detection of anastomotic leakage after elective colorectal surgery: pilot study in 100 patients. J Visc Surg. 2012;149:e345-e349.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 84]  [Cited by in F6Publishing: 91]  [Article Influence: 7.6]  [Reference Citation Analysis (0)]
25.  Garcia-Granero A, Frasson M, Flor-Lorente B, Blanco F, Puga R, Carratalá A, Garcia-Granero E. Procalcitonin and C-reactive protein as early predictors of anastomotic leak in colorectal surgery: a prospective observational study. Dis Colon Rectum. 2013;56:475-483.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 138]  [Cited by in F6Publishing: 136]  [Article Influence: 12.4]  [Reference Citation Analysis (0)]
26.  Ortega-Deballon P, Radais F, Facy O, d'Athis P, Masson D, Charles PE, Cheynel N, Favre JP, Rat P. C-reactive protein is an early predictor of septic complications after elective colorectal surgery. World J Surg. 2010;34:808-814.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 138]  [Cited by in F6Publishing: 145]  [Article Influence: 10.4]  [Reference Citation Analysis (0)]
27.  Cikot M, Kones O, Gedikbası A, Kocatas A, Karabulut M, Temizgonul KB, Alis H. The marker C-reactive protein is helpful in monitoring the integrity of anastomosis: plasma calprotectin. Am J Surg. 2016;212:53-61.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 4]  [Cited by in F6Publishing: 4]  [Article Influence: 0.4]  [Reference Citation Analysis (0)]
28.  Aadland E, Fagerhol MK. Faecal calprotectin: a marker of inflammation throughout the intestinal tract. Eur J Gastroenterol Hepatol. 2002;14:823-825.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 67]  [Cited by in F6Publishing: 71]  [Article Influence: 3.2]  [Reference Citation Analysis (0)]
29.  Rahbari NN, Weitz J, Hohenberger W, Heald RJ, Moran B, Ulrich A, Holm T, Wong WD, Tiret E, Moriya Y, Laurberg S, den Dulk M, van de Velde C, Büchler MW. Definition and grading of anastomotic leakage following anterior resection of the rectum: a proposal by the International Study Group of Rectal Cancer. Surgery. 2010;147:339-351.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 732]  [Cited by in F6Publishing: 787]  [Article Influence: 56.2]  [Reference Citation Analysis (2)]
30.  Dindo D, Demartines N, Clavien PA. Classification of surgical complications: a new proposal with evaluation in a cohort of 6336 patients and results of a survey. Ann Surg. 2004;240:205-213.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 18532]  [Cited by in F6Publishing: 21575]  [Article Influence: 1078.8]  [Reference Citation Analysis (0)]
31.  Hand DJ. Statistical Evaluation of Diagnostic Performance: Topics in ROC Analysis by Zou KH, Liu A, Bandos AI, Ohno-Machado L, Rockette HE. Int Stat Rev. 2013;81:335.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 1]  [Cited by in F6Publishing: 1]  [Article Influence: 0.1]  [Reference Citation Analysis (0)]
32.  James G, Witten D, Hastie T, Tibshira R.   An introduction to statistical learning with applications in R. 1st ed. New York: Springer Science+Business Media, 2013.  [PubMed]  [DOI]  [Cited in This Article: ]
33.  Boström P, Svensson J, Brorsson C, Rutegård M. Early postoperative pain as a marker of anastomotic leakage in colorectal cancer surgery. Int J Colorectal Dis. 2021;36:1955-1963.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 4]  [Cited by in F6Publishing: 3]  [Article Influence: 1.0]  [Reference Citation Analysis (0)]
34.  van Boekel RLM, Warlé MC, Nielen RGC, Vissers KCP, van der Sande R, Bronkhorst EM, Lerou JGC, Steegers MAH. Relationship Between Postoperative Pain and Overall 30-Day Complications in a Broad Surgical Population: An Observational Study. Ann Surg. 2019;269:856-865.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 56]  [Cited by in F6Publishing: 79]  [Article Influence: 19.8]  [Reference Citation Analysis (0)]
35.  Garnacho-Montero J, Huici-Moreno MJ, Gutiérrez-Pizarraya A, López I, Márquez-Vácaro JA, Macher H, Guerrero JM, Puppo-Moreno A. Prognostic and diagnostic value of eosinopenia, C-reactive protein, procalcitonin, and circulating cell-free DNA in critically ill patients admitted with suspicion of sepsis. Crit Care. 2014;18:R116.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 89]  [Cited by in F6Publishing: 95]  [Article Influence: 9.5]  [Reference Citation Analysis (0)]
36.  Shaaban H, Daniel S, Sison R, Slim J, Perez G. Eosinopenia: Is it a good marker of sepsis in comparison to procalcitonin and C-reactive protein levels for patients admitted to a critical care unit in an urban hospital? J Crit Care. 2010;25:570-575.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 55]  [Cited by in F6Publishing: 59]  [Article Influence: 4.5]  [Reference Citation Analysis (0)]
37.  Abidi K, Belayachi J, Derras Y, Khayari ME, Dendane T, Madani N, Khoudri I, Zeggwagh AA, Abouqal R. Eosinopenia, an early marker of increased mortality in critically ill medical patients. Intensive Care Med. 2011;37:1136-1142.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 59]  [Cited by in F6Publishing: 64]  [Article Influence: 4.9]  [Reference Citation Analysis (0)]
38.  Terradas R, Grau S, Blanch J, Riu M, Saballs P, Castells X, Horcajada JP, Knobel H. Eosinophil count and neutrophil-lymphocyte count ratio as prognostic markers in patients with bacteremia: a retrospective cohort study. PLoS One. 2012;7:e42860.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 101]  [Cited by in F6Publishing: 111]  [Article Influence: 9.3]  [Reference Citation Analysis (0)]
39.  Lin Y, Rong J, Zhang Z. Silent existence of eosinopenia in sepsis: a systematic review and meta-analysis. BMC Infect Dis. 2021;21:471.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 7]  [Cited by in F6Publishing: 7]  [Article Influence: 2.3]  [Reference Citation Analysis (0)]
40.  Italian ColoRectal Anastomotic Leakage (iCral) Study Group. Anastomotic leakage after elective colorectal surgery: a prospective multicentre observational study on use of the Dutch leakage score, serum procalcitonin and serum C-reactive protein for diagnosis. BJS Open. 2020;4:499-507.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 20]  [Cited by in F6Publishing: 23]  [Article Influence: 5.8]  [Reference Citation Analysis (0)]
41.  Paliogiannis P, Deidda S, Maslyankov S, Paycheva T, Farag A, Mashhour A, Misiakos E, Papakonstantinou D, Mik M, Losinska J, Scognamillo F, Sanna F, Feo CF, Porcu A, Xidas A, Zinellu A, Restivo A, Zorcolo L. C reactive protein to albumin ratio (CAR) as predictor of anastomotic leakage in colorectal surgery. Surg Oncol. 2021;38:101621.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 2]  [Cited by in F6Publishing: 2]  [Article Influence: 0.7]  [Reference Citation Analysis (0)]
42.  Yeung DE, Peterknecht E, Hajibandeh S, Torrance AW. C-reactive protein can predict anastomotic leak in colorectal surgery: a systematic review and meta-analysis. Int J Colorectal Dis. 2021;36:1147-1162.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 12]  [Cited by in F6Publishing: 19]  [Article Influence: 6.3]  [Reference Citation Analysis (0)]
43.  Su'a B, Tutone S, MacFater W, Barazanchi A, Xia W, Zeng I, Hill AG. Diagnostic accuracy of procalcitonin for the early diagnosis of anastomotic leakage after colorectal surgery: a meta-analysis. ANZ J Surg. 2020;90:675-680.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 5]  [Cited by in F6Publishing: 6]  [Article Influence: 1.2]  [Reference Citation Analysis (0)]
44.  Mandrekar JN. Receiver operating characteristic curve in diagnostic test assessment. J Thorac Oncol. 2010;5:1315-1316.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 1283]  [Cited by in F6Publishing: 1778]  [Article Influence: 127.0]  [Reference Citation Analysis (0)]
45.  Mik M, Dziki L, Berut M, Trzcinski R, Dziki A. Neutrophil to Lymphocyte Ratio and C-Reactive Protein as Two Predictive Tools of Anastomotic Leak in Colorectal Cancer Open Surgery. Dig Surg. 2018;35:77-84.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 30]  [Cited by in F6Publishing: 28]  [Article Influence: 4.0]  [Reference Citation Analysis (0)]
46.  Waterland P, Ng J, Jones A, Broadley G, Nicol D, Patel H, Pandey S. Using CRP to predict anastomotic leakage after open and laparoscopic colorectal surgery: is there a difference? Int J Colorectal Dis. 2016;31:861-868.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 33]  [Cited by in F6Publishing: 33]  [Article Influence: 4.1]  [Reference Citation Analysis (0)]
47.  van Helsdingen CP, Jongen AC, de Jonge WJ, Bouvy ND, Derikx JP. Consensus on the definition of colorectal anastomotic leakage: A modified Delphi study. World J Gastroenterol. 2020;26:3293-3303.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in CrossRef: 35]  [Cited by in F6Publishing: 36]  [Article Influence: 9.0]  [Reference Citation Analysis (2)]
48.  Liu X. Classification accuracy and cut point selection. Stat Med. 2012;31:2676-2686.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 320]  [Cited by in F6Publishing: 380]  [Article Influence: 31.7]  [Reference Citation Analysis (0)]
49.  Sackett DL, Haynes RB. The architecture of diagnostic research. BMJ. 2002;324:539-541.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 465]  [Cited by in F6Publishing: 449]  [Article Influence: 20.4]  [Reference Citation Analysis (0)]