Editorial
Copyright ©The Author(s) 2019. Published by Baishideng Publishing Group Inc. All rights reserved.
World J Gastroenterol. Jun 21, 2019; 25(23): 2833-2838
Published online Jun 21, 2019. doi: 10.3748/wjg.v25.i23.2833
Postoperative complications in gastrointestinal surgery: A “hidden” basic quality indicator
Roberto De la Plaza Llamas, José M Ramia
Roberto De la Plaza Llamas, José M Ramia, Department of General and Digestive Surgery, Hospital Universitario de Guadalajara, Guadalajara 19002, Spain
ORCID number: Roberto de la Plaza Llamas (0000-0001-9501-5480); José M Ramia (0000-0003-1186-953X).
Author contributions: De la Plaza Llamas R and Ramia JM conceived the study; De la Plaza Llamas R design the study; De la Plaza LLamas R performed the reseach; De la Plaza Llamas R and Ramia JM drafted the manuscript; both authors approved the final version of the article.
Conflict-of-interest statement: The authors have no conflict of interest to declare.
Open-Access: This article is an open-access article which was selected by an in-house editor and fully peer-reviewed by external reviewers. It is distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/
Corresponding author: Roberto De la Plaza Llamas, FACS, MD, MSc, PhD, Associate Professor, Doctor, Medical Assistant, Surgeon, Surgical Oncologist, Department of General and Digestive Surgery, Hospital Universitario de Guadalajara, Calle Donante de sangre s/n, Guadalajara 19002, Spain. rdplazal@sescam.jccm.es
Telephone: +34-94-9209241 Fax: +34-94-9209218
Received: March 22, 2019
Peer-review started: March 22, 2019
First decision: April 5, 2019
Revised: April 11, 2019
Accepted: April 19, 2019
Article in press: April 21, 2019
Published online: June 21, 2019

Abstract

Postoperative complications represent a basic quality indicator for measuring outcomes at surgical units. At present, however, they are not systematically measured in all surgical procedures. A more accurate assessment of their impact could help to evaluate the real morbidity associated with different surgical interventions, establish measures for improvement, increase efficiency and identify benchmarking services. The Clavien-Dindo Classification is the most widely used system worldwide for assessing postoperative complications. However, the postoperative period is summarized by the most serious complication without taking into account others of lesser magnitude. Recently, two new scoring systems have emerged, the Comprehensive Complication Index and the Complication Severity Score, which include all postoperative complications and quantify them from 0 (no complications) to 100 (patient’s death), These allow the comparison of results. It is important to train surgical staff to report and classify complications and to record 90-d morbidity rates in all patients. Comparisons with other services must take into account patient comorbidities and the complexity of the particular surgical procedure. To avoid subjectivity and bias, external audits are necessary. In addition, ensuring transparency in the reporting of the results is an urgent obligation.

Key Words: Morbidity, Postoperative complications, Health policy, Comprehensive Complication Index, Clavien-Dindo Classification, Complication Severity Score

Core tip: Postoperative complications represent a basic quality indicator for measuring surgical outcomes, but at present they are not systematically recorded. A more thorough assessment of their impact could help to determine the real morbidity, establish measures for improvement, increase efficiency and identify benchmarking services. The use of the Clavien Dindo Classification of Complications and the Comprehensive Complication Index would allow us to compare them. Surgical staff must be encouraged to report and classify complications and to record 90-d morbidity rates in all patients. External audits are necessary, and ensuring transparency in the reporting of the results is an urgent obligation.



INTRODUCTION

Postoperative complications represent a basic quality parameter for measuring the results of surgical procedures. Unfortunately, morbidity is not systematically re-corded at surgical services. At most, certain services evaluate specific surgeries but for a limited period of time, and usually only the most serious complications are con-sidered. As a consequence, no reliable local or international registries of morbidity are available: The only means available to the scientific community and society at large for assessing the postoperative morbidity associated with particular surgical procedures are isolated studies published by specific surgical services, which are not externally audited and often present better than average results.

Because of the lack of information on the complications associated with particular procedures or at particular units, it is impossible to carry out comparisons with other services, introduce measures for improvement, or learn from other services that obtain better results.

We are accustomed to groups of experts proposing morbidity and mortality standards for performing certain complex surgical procedures. But where do their figures come from? Are their statistics credible? Can they be considered accurate and objective when the services do not record their morbidity?

In cases in which morbidity is recorded, the reporting may be subject to a variety of biases that we will discuss in more detail later. In addition, the reports lack objective certification by an external and fundamentally impartial audit. At most surgical services, these morbidity and mortality standards are considered unattainable. Why is this so? And how can we talk about benchmarking surgical services if we do not know the morbidity associated with each surgical technique at each service, or the real situation in many of the services certified as excellent? Which services are the best, and on what criteria are these qualifications based?

At a time when society demands global transparency, it is hard to explain why this quantification is not mandatory, especially since its consequences have such an important bearing on quality of life, oncological prognosis, and healthcare costs[1,2]. Here, we describe some minimum guidelines designed to allow a process of re-cording, communication and comparison of postoperative morbidity.

GUIDELINES FOR THE RECORDING, CLASSIFICATION AND COMPARISON OF POSTOPERATIVE COMPLICATIONS

Until recently, it was difficult to quantify postoperative complications because of the lack of any standardized classifications that allowed their systematic recording and comparison.

Martin et al[3] conducted a study designed to critically evaluate the quality of surgical literature from 1975 to 2001 in the reporting of complications. They included 119 reports recording outcomes in 22530 patients[3]. Among other things, the authors observed that only 34% of the studies defined the term complication, and that the definitions varied widely (in the case of pancreatic fistula, for instance, they noted up to 12 definitions); only 20% used the degree of severity, and only 67% of the studies indicated the duration of the follow-up. Therefore, the evolution of the methodology for evaluating postoperative morbidity has been heterogeneous, and inconsistent reporting of complications has been a common feature in the surgical literature.

Despite the presence of the tools that we will outline below, in general the des-criptions of the methodology used in the diagnosis, recording, and monitoring of complications are unsatisfactory: There is a systematic absence of an external and impartial audit, and so the results lack reliability.

In 2004, Dindo et al[4] published the classification of complications definitely known as the Classification of Clavien Dindo (CDC)[5], which reached a wide audience. Currently, the article has 10635 citations[6].

The CDC classifies complications in a very intuitive way and was very well received by surgeons, Nonetheless, in complex scenarios their grading may be controversial. For this reason, Clavien's group and others have provided several sets of guidelines[4,5,7-9]. The CDC considers any negative event occurring during hos-pitalization as a complication[4,5,10,11]. The main problem with this system is that the entire postoperative course is defined according to the most serious complication, and other minor complications are not considered - even though it has been shown that between 44% and 51.5% of patients who present morbidity at surgical services have two complications or more[9,11].

To overcome this problem, in 2013 Slankamenac et al[12] developed a new global scoring system for postoperative complications based on the CDC, called the Comprehensive Complication Index (CCI). The CCI evaluates all complications separately according to the CDC; then, after entering them in the online calculator, it rates the morbidity on a scale from 0 to 100, with a score of 0 reflecting the absence of complications and a score of 100 indicating death[12]. The CCI currently has 224 citations[13]; it has been used in 104 published studies and has been discussed in two letters to the editor, two editorials and two comments in PubMed (search updated on March 18, 2019 with the strategy "Comprehensive Complication Index").

In 2015, the Complication Severity Score (CSS) became accessible online. Like the CCI, this system is also based on the CDC and has an overall score of 0 to 100[14]. However, the initial publication describing the scale was rejected[14] and was only finally published in December 2018[15]. The authors claim that it improves on the CCI because the CCI assigns an inappropriately high score to a combination of com-plications: “…a patient who develops two Clavien-Dindo grade II complications gets a higher CCI score than a patient who develops a single Clavien-Dindo grade IIIa com-plication…”[15] . The CSS is similar to the CCI in terms of its elaboration and uses a similar formula, but it assigns less weight to each grade of the CDC.

The CCI and CSS have two obvious advantages over the CDC: They take into account all the complications and produce a composite score, thus allowing the comparison of results.

In a study of all the patients operated upon at a general and digestive surgery service over a one-year period, the CDC and CCI were validated in the four groups of surgical complexity defined by the Operative Severity Score[16], in terms of the following clinical data: Hospital stay, prolongation of hospital stay, readmission and disability[11,17]. The CSS obtained similar results in this series, although the results have not yet been published[17]. The CDC showed slightly lower clinical validation values than the CCI and the CSS[17]. The CCI was the index that was least influenced by confounding factors but in one patient the score exceeded 100, while the CSS did not reach 100 in any case[17], because its numerical values are lower than those of the CCI. Thus, the use of CSS would theoretically have an advantage in highly complex surgeries with a multitude of complications which, in exceptional cases, might produce a higher CCI.

Several studies have shown the relationship between increased costs and higher CDC scores[2,18-21]. Only two teams have studied the relationship of the CCI with postoperative costs. Staiger et al[22] reported (among other findings) a strong correlation between the CCI and costs three months post-surgery, and higher correlations for more complex procedures. They also developed a cost prediction tool. De la Plaza et al[2] studied the postoperative costs in patients operated over a one-year period at a general surgery and digestive service, finding a moderate to strong correlation of the CCI with overall postoperative costs, which increased with the surgical complexity according to the Operative Severity Score. In all the groups, this correlation was higher in emergency surgery. In addition, the CCI was correlated with postoperative costs in patients with prolonged postoperative stay and in those without, and also with the initial operating room costs[2]. This relationship between postoperative costs and the CCI provides further support for the score’s clinical validity.

Comparing the two new systems, we believe that the CCI should be preferred to the CSS for the following reasons: (1) The preparation of the CCI involved 227 patients and 245 physicians (surgeons, anesthetists and intensivists)[12]. In the preparation of the CSS, only 49 senior gastrointestinal and hepato-pancreatico-biliary surgeons in India were included (“senior” being defined as having at least 5 years of experience after graduating), and no patients[15,23]; and (2) The CCI has a greater diffusion worldwide[13].

A summary of these three tools (CDC, CCI and CSS) is shown in Table 1.

Table 1 Comparison of the characteristics of the clavien dindo classification, the comprehensive complication index and the complication severity score.
CDCCCICSS
Year of publication200420132018
Criteria usedOpinions of 144 surgeonsOpinions of 227 patients and 245 physicians (surgeons, anesthetists and intensivists)Opinions of 49 gastrointestinal and hepato-pancreatico-biliary surgeons in India
Scale and calculationClassifies the complications in 5 grades. The therapy used to correct a specific complication remains the cornerstone to rank a complication.All the complications must be classified according to the CDC, and the score is then calculated with the formula or on-line.All the complications must be classified according to the CDC, and the score is then calculated with the formula.
ValueConsiders only the most severe complication: 0-VConsiders all the complications: 0-100. Higher numerical value than the CSS.Considers all the complications: 0-100. Lower numerical value than the CCI
Validation with clinical resultsYesYesYes (PhD thesis)[17]
Bibliographical citings106352242
ManagementMore straightforwardMore complex in patients with multiple complicationsMore complex in patients with multiple complications
Does it adequately represent the postoperative course of patients with ≥ 2 complications?NoYesYes
Does it all comparison of the results?No, if there are ≥ 2 complicationsYesYes

Therefore, the CDC is the most suitable classification for each individual postoperative complication, while the CCI is able to numerically quantify the postoperative complications in a particular patient or group of patients undergoing a surgical procedure. In addition, the percentage of certain important complications is also specified for each surgical procedure: For example, in esophagectomies, gas-trectomies, pancreatectomies, colectomies, and so on, the presence of specific and important complications such as the presence of anastomosis and pancreatic fistulas is recorded. In any case, the mere fact of initially classifying each complication according to the CDC would alert surgical departments to less important com-plications that are relatively easy to improve, such as infection of the surgical wound, urinary tract infection, central venous catheter, or pulmonary complications.

Complications should be recorded for at least 90 d post-surgery, as should re-admissions in that period. Between 30 and 90 d postoperatively the number of complications rises by 11.6%[17]. The recording of complications that occur outside the hospital environment is a more difficult issue. These complications are less serious, but it is important to evaluate them (for example, complications after less complex procedures such as cholecystectomy). This problem could be minimized by the use of an electronic medical recording system that incorporates the care carried out outside the hospital.

It is essential to report complications as they occur, or at least when evidence of the event becomes available. The event should be recorded in the patient progress notes or in specially designed forms in which the complication and the treatment are reported in writing and the CDC. Consultation of nurses' notes is also fundamental.

Within 90 d of the procedure, a summary of the morbidity in each patient should be made by the physicians at the service based on the clinical history, and should be stored in (for example) an Excel table recording each complication, the CDC, and the CCI[11]. In our experience, the average time taken to evaluate complications at 90 d post-surgery and to record them in the spreadsheet ranges between 5 and 10 min per patient.

To compare the results at different services, one must take into account the complexity of the patient’s condition, not just on the basis of the ASA but by making a risk adjustment with complexity or severity scores such as the Charlson Comorbidity scale[24]. It is also important to compare surgical procedures of similar complexity and technical difficulty[2]. An impartial external audit is essential. When used by physicians at our service to record morbidity and applying the methodology described above, the CDC and CCI presented accuracy rates of 88% and 81%; however, when only patients with complications were included, the rates fell res-pectively to 69% and 49%[17,25].

There are several explanations for the fact that postoperative complications are only rarely quantified. The most important, in our view, is the fact that the better the recording system, the worse the results. Surgeons may regard complications as an indication of personal failure, and fear comparison with other services because the results may reflect badly on their work. Furthermore, at a time when centres of reference are being established for complex surgical procedures such as esop-hagectomy, gastrectomy, pancreatectomy or hepatectomy, high morbidity rates at particular services might disqualify them from operating on these patients.

It is hard to understand why public authorities choose these services of reference only on the basis of volume (or sometimes for political reasons) and fail to take actual audited results into account, such as morbidity and disease-free survival in cancer patients. Besides questions of cost-effectiveness, ensuring the optimal use of the means available is an obligation in a system with limited resources.

Another common bias is the failure to record certain minor complications. For example, the CDC includes nausea, poorly controlled pain and atelectasis as complications, which in practice may go unreported. The inclusion of minor com-plications may magnify the actual morbidity, but it eliminates subjective in-terpretations and makes them the same for all auditors. The presence of errors in the classification of complications according to the CDC, particularly in complex sce-narios, should also be borne in mind. However, many useful clarifications have already been made in this regard[4,5,7-9].

CONCLUSION

Little is known at present about real postoperative morbidity.

In the recording of postoperative complications, the following points must be taken into account: (1) A complication should be considered as any negative event occurring in a patient during hospitalization[4,5,10,11]; (2) Physicians and nurses must be made aware of the need to record complications; (3) Training with the CDC must be provided, especially in order to deal with complex scenarios; (4) Exhaustive, external impartial recording of all complications must be performed. However, biases cannot be totally avoided since the registry is performed by doctors and nurses at the service under evaluation; (5) Complications should be recorded on a form specially created for the purpose; (6) Physicians’ and nurses’ notes should be consulted; and (7) An external audit must be carried out by experts without any conflict of interest with regard to the surgery service or its members so as to avoid deficiencies in the re-cording and classification and other biases.

The recording of the complications deriving from all surgical procedures is an urgent scientific and social obligation. Transparency in the reporting is also mandatory. There are sufficient means available now to record complications ac-curately and efficiently, with only minimal investment and the results are available in the short-medium term. Policy-makers in the field of health administration should not let this opportunity pass.

Footnotes

Manuscript source: Invited manuscript

Specialty type: Gastroenterology and hepatology

Country of origin: Spain

Peer-review report classification

Grade A (Excellent): 0

Grade B (Very good): B, B

Grade C (Good): C

Grade D (Fair): D, D

Grade E (Poor): 0

P-Reviewer: El-Shabrawi MHF, Kai K, Mann O, Sperti C, Teramoto-Matsubara OT S-Editor: Ma RY L-Editor: A E-Editor: Ma YJ

References
1.  Slankamenac K, Slankamenac M, Schlegel A, Nocito A, Rickenbacher A, Clavien PA, Turina M. Impact of postoperative complications on readmission and long-term survival in patients following surgery for colorectal cancer. Int J Colorectal Dis. 2017;32:805-811.  [PubMed]  [DOI]
2.  de la Plaza Llamas R, Hidalgo Vega Á, Latorre Fragua RA, López Marcano AJ, Medina Velasco AA, Díaz Gil JM, Ramia Ángel JM. The Cost of Postoperative Complications and Economic Validation of the Comprehensive Complication Index. Ann Surg. 2019;1.  [PubMed]  [DOI]
3.  Martin RC 2nd, Brennan MF, Jaques DP. Quality of complication reporting in the surgical literature. Ann Surg. 2002;235:803-813.  [PubMed]  [DOI]
4.  Dindo D, Demartines N, Clavien PA. Classification of surgical complications: a new proposal with evaluation in a cohort of 6336 patients and results of a survey. Ann Surg. 2004;240:205-213.  [PubMed]  [DOI]
5.  Clavien PA, Barkun J, de Oliveira ML, Vauthey JN, Dindo D, Schulick RD, de Santibañes E, Pekolj J, Slankamenac K, Bassi C, Graf R, Vonlanthen R, Padbury R, Cameron JL, Makuuchi M. The Clavien-Dindo classification of surgical complications: five-year experience. Ann Surg. 2009;250:187-196.  [PubMed]  [DOI]
6.  Classification of Surgical Complications Overview of attention for article published in Annals of Surgery, August 2004 [Internet]. Wolters Kluwer, Artic. Metrics [cited 2019 Mar 18].  Available from: https://wolterskluwer.altmetric.com/details/4800046/citations.  [PubMed]  [DOI]
7.  Mentula PJ, Leppäniemi AK. Applicability of the Clavien-Dindo classification to emergency surgical procedures: a retrospective cohort study on 444 consecutive patients. Patient Saf Surg. 2014;8:31.  [PubMed]  [DOI]
8.  Katayama H, Kurokawa Y, Nakamura K, Ito H, Kanemitsu Y, Masuda N, Tsubosa Y, Satoh T, Yokomizo A, Fukuda H, Sasako M. Extended Clavien-Dindo classification of surgical complications: Japan Clinical Oncology Group postoperative complications criteria. Surg Today. 2016;46:668-685.  [PubMed]  [DOI]
9.  Clavien PA, Vetter D, Staiger RD, Slankamenac K, Mehra T, Graf R, Puhan MA. The Comprehensive Complication Index (CCI®): Added Value and Clinical Perspectives 3 Years "Down the Line". Ann Surg. 2017;265:1045-1050.  [PubMed]  [DOI]
10.  Clavien PA, Sanabria JR, Strasberg SM. Proposed classification of complications of surgery with examples of utility in cholecystectomy. Surgery. 1992;111:518-526.  [PubMed]  [DOI]
11.  de la Plaza Llamas R, Ramia Ángel JM, Bellón JM, Arteaga Peralta V, García Amador C, López Marcano AJ, Medina Velasco AA, González Sierra B, Manuel Vázquez A. Clinical Validation of the Comprehensive Complication Index as a Measure of Postoperative Morbidity at a Surgical Department: A Prospective Study. Ann Surg. 2018;268:838-844.  [PubMed]  [DOI]
12.  Slankamenac K, Graf R, Barkun J, Puhan MA, Clavien PA. The comprehensive complication index: a novel continuous scale to measure surgical morbidity. Ann Surg. 2013;258:1-7.  [PubMed]  [DOI]
13.  The Comprehensive Complication Index Overview of attention for article published in Annals of Surgery, July 2013 [Internet]. Wolters Kluwer, Artic. Metrics [cited 2019 Mar 18].  Available from: https://wolterskluwer.altmetric.com/details/1525609/citations.  [PubMed]  [DOI]
14.  Panwar R, Sahni P. Retracted: Measuring Postoperative Complications: On the Right Path but Far Away From the Destination. Ann Surg. 2017;.  [PubMed]  [DOI]
15.  Panwar R, Mohapatra V, Raichurkar K, Sahni P. Development and validation of a new score for measuring post-operative complications. Langenbecks Arch Surg. 2018;403:1021-1027.  [PubMed]  [DOI]
16.  Copeland GP, Jones D, Walters M. POSSUM: a scoring system for surgical audit. Br J Surg. 1991;78:355-360.  [PubMed]  [DOI]
17.  de la Plaza Llamas R. Validación y aplicabilidad clínica del Comprehensive Complication Index en una población de pacientes intervenidos en un servicio de cirugía general y del aparato digestivo. Estudio prospectivo. Thesis, University of Alcalá. 2018; Available from: https://www.educacion.gob.es/teseo/mostrarRef.do?ref=444441.  [PubMed]  [DOI]
18.  Vonlanthen R, Slankamenac K, Breitenstein S, Puhan MA, Muller MK, Hahnloser D, Hauri D, Graf R, Clavien PA. The impact of complications on costs of major surgical procedures: a cost analysis of 1200 patients. Ann Surg. 2011;254:907-913.  [PubMed]  [DOI]
19.  Straatman J, Cuesta MA, de Lange-de Klerk ES, van der Peet DL. Hospital cost-analysis of complications after major abdominal surgery. Dig Surg. 2015;32:150-156.  [PubMed]  [DOI]
20.  Goense L, van Dijk WA, Govaert JA, van Rossum PS, Ruurda JP, van Hillegersberg R. Hospital costs of complications after esophagectomy for cancer. Eur J Surg Oncol. 2017;43:696-702.  [PubMed]  [DOI]
21.  Wang J, Ma R, Eleftheriou P, Churilov L, Debono D, Robbins R, Nikfarjam M, Christophi C, Weinberg L. Health economic implications of complications associated with pancreaticoduodenectomy at a University Hospital: a retrospective cohort cost study. HPB (Oxford). 2018;20:423-431.  [PubMed]  [DOI]
22.  Staiger RD, Cimino M, Javed A, Biondo S, Fondevila C, Périnel J, Aragão AC, Torzilli G, Wolfgang C, Adham M, Pinto-Marques H, Dutkowski P, Puhan MA, Clavien PA. The Comprehensive Complication Index (CCI®) is a Novel Cost Assessment Tool for Surgical Procedures. Ann Surg. 2018;268:784-791.  [PubMed]  [DOI]
23.  Staiger RD, Puhan MA, Clavien PA. Editorial comment: different perspectives on severity of postoperative morbidity. Langenbecks Arch Surg. 2018;403:1029-1030.  [PubMed]  [DOI]
24.  Charlson ME, Pompei P, Ales KL, MacKenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987;40:373-383.  [PubMed]  [DOI]
25.  de la Plaza Llamas R, Ramia Ángel J, García Gil J, Arteaga Peralta V, García Amador C, López Marcano A, Medina Velasco A, Díaz Candelas D. Registro prospectivo de todas las complicaciones postoperatorias en un servicio de cirugía general. ¿Como hacerlo? Cir Esp. 2018;96 Suppl:S7 Available from: http://www.elsevier.es/es-revista-cirugia-espanola-36-congresos-xxxii-congreso-nacional-cirugia-77-sesion-gestion-de-calidad-4863-comunicacion-registro-prospectivo-de-todas-las-55950-pdf.  [PubMed]  [DOI]