1
|
García-Lorenzo B, Gorostiza A, Alayo I, Castelo Zas S, Cobos Baena P, Gallego Camiña I, Izaguirre Narbaiza B, Mallabiabarrena G, Ustarroz-Aguirre I, Rigabert A, Balzi W, Maltoni R, Massa I, Álvarez López I, Arévalo Lobera S, Esteban M, Fernández Calleja M, Gómez Mediavilla J, Fernández M, del Oro Hitar M, Ortega Torres MDC, Sanz Ferrandez MC, Manso Sánchez L, Serrano Balazote P, Varela Rodríguez C, Campone M, Le Lann S, Vercauter P, Tournoy K, Borges M, Oliveira AS, Soares M, Fullaondo A. European value-based healthcare benchmarking: moving from theory to practice. Eur J Public Health 2024; 34:44-51. [PMID: 37875008 PMCID: PMC10843953 DOI: 10.1093/eurpub/ckad181] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2023] Open
Abstract
BACKGROUND Value-based healthcare (VBHC) is a conceptual framework to improve the value of healthcare by health, care-process and economic outcomes. Benchmarking should provide useful information to identify best practices and therefore a good instrument to improve quality across healthcare organizations. This paper aims to provide a proof-of-concept of the feasibility of an international VBHC benchmarking in breast cancer, with the ultimate aim of being used to share best practices with a data-driven approach among healthcare organizations from different health systems. METHODS In the VOICE community-a European healthcare centre cluster intending to address VBHC from theory to practice-information on patient-reported, clinical-related, care-process-related and economic-related outcomes were collected. Patient archetypes were identified using clustering techniques and an indicator set following a modified Delphi was defined. Benchmarking was performed using regression models controlling for patient archetypes and socio-demographic characteristics. RESULTS Six hundred and ninety patients from six healthcare centres were included. A set of 50 health, care-process and economic indicators was distilled for benchmarking. Statistically significant differences across sites have been found in most health outcomes, half of the care-process indicators, and all economic indicators, allowing for identifying the best and worst performers. CONCLUSIONS To the best of our knowledge, this is the first international experience providing evidence to be used with VBHC benchmarking intention. Differences in indicators across healthcare centres should be used to identify best practices and improve healthcare quality following further research. Applied methods might help to move forward with VBHC benchmarking in other medical conditions.
Collapse
Affiliation(s)
- Borja García-Lorenzo
- Biosistemak Institute for Health Systems Research, Torre del Bilbao Exhibition Centre, Barakaldo, Spain
| | - Ania Gorostiza
- Biosistemak Institute for Health Systems Research, Torre del Bilbao Exhibition Centre, Barakaldo, Spain
| | - Itxaso Alayo
- Biosistemak Institute for Health Systems Research, Torre del Bilbao Exhibition Centre, Barakaldo, Spain
| | - Susana Castelo Zas
- Osakidetza Basque Health Service, Ezkerraldea Enkarterri Cruces Integrated Health Organisation, Innovation and Quality Assistant Service, Barakaldo-Bizkaia, Spain
| | - Patricia Cobos Baena
- Osakidetza Basque Health Service, Ezkerraldea Enkarterri Cruces Integrated Health Organisation, Mammary Pathology Service, Barakaldo-Bizkaia, Spain
| | - Inés Gallego Camiña
- Osakidetza Basque Health Service, Ezkerraldea Enkarterri Cruces Integrated Health Organisation, Innovation and Quality Assistant Service, Barakaldo-Bizkaia, Spain
| | - Begoña Izaguirre Narbaiza
- Osakidetza Basque Health Service, Ezkerraldea Enkarterri Cruces Integrated Health Organisation, Analytical Accounting, Economic and Financial Directorate, Barakaldo, Spain
| | - Gaizka Mallabiabarrena
- Osakidetza Basque Health Service, Ezkerraldea Enkarterri Cruces Integrated Health Organisation, Mammary Pathology Service, Barakaldo-Bizkaia, Spain
| | - Iker Ustarroz-Aguirre
- Osakidetza Basque Health Service, Ezkerraldea Enkarterri Cruces Integrated Health Organisation, Economic Evaluation Unit, Economic and Financial Directorate, Barakaldo, Spain
| | - Alina Rigabert
- Fundación Andaluza Beturia para la Investigación en Salud (FABIS), Huelva, Spain
| | - William Balzi
- IRCCS Istituto Romagnolo per lo Studio dei Tumori (IRST) “Dino Amadori”, Meldola, Italy
| | - Roberta Maltoni
- IRCCS Istituto Romagnolo per lo Studio dei Tumori (IRST) “Dino Amadori”, Meldola, Italy
| | - Ilaria Massa
- IRCCS Istituto Romagnolo per lo Studio dei Tumori (IRST) “Dino Amadori”, Meldola, Italy
| | - Isabel Álvarez López
- Osakidetza Basque Health Service, Donostialdea Integrated Health Organisation, Medical Oncology, Donostia, Spain
- Biodonostia, Donostia, Gipuzkoa, Spain
| | - Sara Arévalo Lobera
- Osakidetza Basque Health Service, Donostialdea Integrated Health Organisation, Medical Oncology, Donostia, Spain
- Biodonostia, Donostia, Gipuzkoa, Spain
| | - Mónica Esteban
- Osakidetza Basque Health Service, Donostialdea Integrated Health Organisation, Economic Resource Service, Donostia, Gipuzkoa, Spain
| | - Marta Fernández Calleja
- Osakidetza Basque Health Service, Donostialdea Integrated Health Organisation, Mamary Pathology Service, Donostia, Gipuzkoa, Spain
| | - Jenifer Gómez Mediavilla
- Osakidetza Basque Health Service, Donostialdea Integrated Health Organisation, Medical Oncology, Donostia, Spain
| | - Manuela Fernández
- Osakidetza Basque Health Service, Donostialdea Integrated Health Organisation, Economic Resource Service, Donostia, Gipuzkoa, Spain
| | - Manuel del Oro Hitar
- Gynecology Department, Hospital Universitario 12 de Octubre, Madrid, Spain
- Hospital Universitario 12 de Octubre, Madrid, Spain
| | - María del Carmen Ortega Torres
- Gynecology Department, Hospital Universitario 12 de Octubre, Madrid, Spain
- Hospital Universitario 12 de Octubre, Madrid, Spain
| | | | - Luís Manso Sánchez
- Hospital Universitario 12 de Octubre, Madrid, Spain
- Instituto de Investigación Biomédica del Hospital Universitario 12 de Octubre, Madrid, Spain
| | - Pablo Serrano Balazote
- Hospital Universitario 12 de Octubre, Madrid, Spain
- Instituto de Investigación Biomédica del Hospital Universitario 12 de Octubre, Madrid, Spain
| | - Carolina Varela Rodríguez
- Hospital Universitario 12 de Octubre, Madrid, Spain
- Instituto de Investigación Biomédica del Hospital Universitario 12 de Octubre, Madrid, Spain
| | - Mario Campone
- Institut de Cancérologie de l’Ouest, Angers-Nantes, France
| | - Sophie Le Lann
- Institut de Cancérologie de l’Ouest, Angers-Nantes, France
| | - Piet Vercauter
- Department of Pulmonary Medicine, Onze-Lieve-Vrouw Hospital, Aalst, Belgium
| | - Kurt Tournoy
- Department of Pulmonary Medicine, Onze-Lieve-Vrouw Hospital, Aalst, Belgium
- Faculty of Medicine and Life Sciences, Ghent University, Ghent, Belgium
| | | | | | - Marta Soares
- Instituto Português de Oncologia do Porto, Portugal
| | - Ane Fullaondo
- Biosistemak Institute for Health Systems Research, Torre del Bilbao Exhibition Centre, Barakaldo, Spain
| |
Collapse
|
2
|
Risk-adjusting away volume as a quality metric for surgical oncology: a perspective worth re-visiting. Nat Rev Clin Oncol 2022; 19:221-222. [PMID: 35169267 DOI: 10.1038/s41571-022-00609-1] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
3
|
Charlson ME, Carrozzino D, Guidi J, Patierno C. Charlson Comorbidity Index: A Critical Review of Clinimetric Properties. PSYCHOTHERAPY AND PSYCHOSOMATICS 2022; 91:8-35. [PMID: 34991091 DOI: 10.1159/000521288] [Citation(s) in RCA: 685] [Impact Index Per Article: 228.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/30/2021] [Accepted: 12/01/2021] [Indexed: 11/19/2022]
Abstract
The present critical review was conducted to evaluate the clinimetric properties of the Charlson Comorbidity Index (CCI), an assessment tool designed specifically to predict long-term mortality, with regard to its reliability, concurrent validity, sensitivity, incremental and predictive validity. The original version of the CCI has been adapted for use with different sources of data, ICD-9 and ICD-10 codes. The inter-rater reliability of the CCI was found to be excellent, with extremely high agreement between self-report and medical charts. The CCI has also been shown either to have concurrent validity with a number of other prognostic scales or to result in concordant predictions. Importantly, the clinimetric sensitivity of the CCI has been demonstrated in a variety of medical conditions, with stepwise increases in the CCI associated with stepwise increases in mortality. The CCI is also characterized by the clinimetric property of incremental validity, whereby adding the CCI to other measures increases the overall predictive accuracy. It has been shown to predict long-term mortality in different clinical populations, including medical, surgical, intensive care unit (ICU), trauma, and cancer patients. It may also predict in-hospital mortality, although in some instances, such as ICU or trauma patients, the CCI did not perform as well as other instruments designed specifically for that purpose. The CCI thus appears to be clinically useful not only to provide a valid assessment of the patient's unique clinical situation, but also to demarcate major diagnostic and prognostic differences among subgroups of patients sharing the same medical diagnosis.
Collapse
Affiliation(s)
- Mary E Charlson
- Division of Clinical Epidemiology and Evaluative Sciences Research, Department of Medicine, Weill Cornell Medicine, New York, New York, USA
| | - Danilo Carrozzino
- Department of Psychology "Renzo Canestrari," University of Bologna, Bologna, Italy
| | - Jenny Guidi
- Department of Psychology "Renzo Canestrari," University of Bologna, Bologna, Italy
| | - Chiara Patierno
- Department of Psychology "Renzo Canestrari," University of Bologna, Bologna, Italy
| |
Collapse
|
4
|
Gupta S, Lui B, Ma X, Walline M, Ivascu NS, White RS. Sex Differences in Outcomes After Coronary Artery Bypass Grafting. J Cardiothorac Vasc Anesth 2020; 34:3259-3266. [DOI: 10.1053/j.jvca.2020.04.030] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/28/2020] [Revised: 04/15/2020] [Accepted: 04/16/2020] [Indexed: 01/23/2023]
|
5
|
Amiri A, Solankallio-Vahteri T. Nurse-staffing level and quality of acute care services: Evidence from cross-national panel data analysis in OECD countries. Int J Nurs Sci 2018; 6:6-16. [PMID: 31406863 PMCID: PMC6608666 DOI: 10.1016/j.ijnss.2018.11.010] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2018] [Revised: 11/02/2018] [Accepted: 11/30/2018] [Indexed: 11/14/2022] Open
Abstract
Background Most of previous studies aimed to estimate the effect of nurse staffing on quality of acute hospital care have used stochastic methods and their results are mixed. Objective To measure the magnitude of effect of nurse-staffing level on increasing quality of acute care services in long-run. Data The number of practicing nurses’ density per 1000 population as the proxy of nurse-staffing level and three Health Care Quality Indicators (HCQI) included 30-day mortality per 100 patients based on acute myocardial infarction (MORTAMIO), hemorrhagic stroke (MORTHSTO) and ischemic stroke (MORTISTO) were collected as a part of ongoing project by OECD.org in panels of 26 OECD countries over 2005–2015 period. Method Panel data analysis. Results There were committed relationships from nurse-staffing level to the enhancement of HCQI i.e. 1% increase in nurse-staffing level would reduce the rates of patient mortality based on MORTAMIO, MORTHSTO and MORTISTO by 0.65%, 0.60% and 0.80%, respectively. Furthermore, the role of nurse-staffing level in increasing overall HCQI were simulated at the highest level in Sweden (−3.53), Denmark (−3.31), Canada (−2.59), Netherlands (−2.33), Finland (−2.09), Switzerland (−1.72), Australia (−1.64) and United States (−1.53). Conclusion A higher proportion of nurses-staffing level is associated with higher quality of acute care services in OECD countries. Also, the nursing characteristics of Sweden, Denmark, Canada, Netherlands, Finland, Switzerland, Australia and United States would be good patterns for other countries to maximize nursing outcomes in the care of patients with acute and life-threatening conditions by reducing the risk of complication, mortality and adverse clinical outcomes.
Collapse
Affiliation(s)
- Arshia Amiri
- University of Eastern Finland, Kuopio, Finland.,JAMK University of Applied Sciences, Jyväskylä, Finland
| | | |
Collapse
|
6
|
König V, Kolzter O, Albuszies G, Thölen F. [Factors affecting in-hospital mortality in patients with sepsis: Development of a risk-adjusted model based on administrative data from German hospitals]. ZEITSCHRIFT FUR EVIDENZ, FORTBILDUNG UND QUALITAT IM GESUNDHEITSWESEN 2018; 133:30-39. [PMID: 29610028 DOI: 10.1016/j.zefq.2018.03.001] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/29/2017] [Revised: 02/28/2018] [Accepted: 03/01/2018] [Indexed: 12/23/2022]
Abstract
BACKGROUND Inpatient administrative data from hospitals is already used nationally and internationally in many areas of internal and public quality assurance in healthcare. For sepsis as the principal condition, only a few published approaches are available for Germany. The aim of this investigation is to identify factors influencing hospital mortality by employing appropriate analytical methods in order to improve the internal quality management of sepsis. METHODS The analysis was based on data from 754,727 DRG cases of the CLINOTEL hospital network charged in 2015. The association then included 45 hospitals of all supply levels with the exception of university hospitals (range of beds: 100 to 1,172 per hospital). Cases of sepsis were identified via the ICD codes of their principal diagnosis. Multiple logistic regression analysis was used to determine the factors influencing in-hospital lethality for this population. The model was developed using sociodemographic and other potential variables that could be derived from the DRG data set, and taking into account current literature data. The model obtained was validated with inpatient administrative data of 2016 (51 hospitals, 850,776 DRG cases). RESULTS Following the definition of the inclusion criteria, 5,608 cases of sepsis (2016: 6,384 cases) were identified in 2015. A total of 12 significant and, over both years, stable factors were identified, including age, severity of sepsis, reason for hospital admission and various comorbidities. The AUC value of the model, as a measure of predictability, is above 0.8 (H-L test p>0.05, R2 value=0.27), which is an excellent result. CONCLUSION The CLINOTEL model of risk adjustment for in-hospital lethality can be used to determine the mortality probability of patients with sepsis as principal diagnosis with a very high degree of accuracy, taking into account the case mix. Further studies are needed to confirm whether the model presented here will prove its value in the internal quality assurance of hospitals.
Collapse
Affiliation(s)
- Volker König
- CLINOTEL Krankenhausverbund gGmbH, Köln, Deutschland.
| | - Olaf Kolzter
- CLINOTEL Krankenhausverbund gGmbH, Köln, Deutschland
| | - Gerd Albuszies
- Klinik für Anästhesiologie, anästhesiologische Intensivmedizin und perioperative Schmerztherapie, Gesundheits- und Pflegezentrum Rüsselsheim gGmbH, Rüsselsheim, Deutschland
| | - Frank Thölen
- CLINOTEL Krankenhausverbund gGmbH, Köln, Deutschland
| |
Collapse
|
7
|
Incorporating Longitudinal Comorbidity and Acute Physiology Data in Template Matching for Assessing Hospital Quality: An Exploratory Study in an Integrated Health Care Delivery System. Med Care 2018; 56:448-454. [PMID: 29485529 DOI: 10.1097/mlr.0000000000000891] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
OBJECTIVE We sought to build on the template-matching methodology by incorporating longitudinal comorbidities and acute physiology to audit hospital quality. STUDY SETTING Patients admitted for sepsis and pneumonia, congestive heart failure, hip fracture, and cancer between January 2010 and November 2011 at 18 Kaiser Permanente Northern California hospitals. STUDY DESIGN We generated a representative template of 250 patients in 4 diagnosis groups. We then matched between 1 and 5 patients at each hospital to this template using varying levels of patient information. DATA COLLECTION Data were collected retrospectively from inpatient and outpatient electronic records. PRINCIPAL FINDINGS Matching on both present-on-admission comorbidity history and physiological data significantly reduced the variation across hospitals in patient severity of illness levels compared with matching on administrative data only. After adjustment for longitudinal comorbidity and acute physiology, hospital rankings on 30-day mortality and estimates of length of stay were statistically different from rankings based on administrative data. CONCLUSIONS Template matching-based approaches to hospital quality assessment can be enhanced using more granular electronic medical record data.
Collapse
|
8
|
Mathur AK, Chakrabarti AK, Mellinger JL, Volk ML, Day R, Singer AL, Hewitt WR, Reddy KS, Moss AA. Hospital resource intensity and cirrhosis mortality in United States. World J Gastroenterol 2017; 23:1857-1865. [PMID: 28348492 PMCID: PMC5352927 DOI: 10.3748/wjg.v23.i10.1857] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/05/2016] [Revised: 01/04/2017] [Accepted: 02/08/2017] [Indexed: 02/06/2023] Open
Abstract
AIM To determine whether hospital characteristics predict cirrhosis mortality and how much variation in mortality is attributable to hospital differences.
METHODS We used data from the 2005-2011 Nationwide Inpatient Sample and the American Hospital Association Annual survey to identify hospitalizations for decompensated cirrhosis and corresponding facility characteristics. We created hospital-specific risk and reliability-adjusted odds ratios for cirrhosis mortality, and evaluated patient and facility differences based on hospital performance quintiles. We used hierarchical regression models to determine the effect of these factors on mortality.
RESULTS Seventy-two thousand seven hundred and thirty-three cirrhosis admissions were evaluated in 805 hospitals. Hospital mean cirrhosis annual case volume was 90.4 (range 25-828). Overall hospital cirrhosis mortality rate was 8.00%. Hospital-adjusted odds ratios (aOR) for mortality ranged from 0.48 to 1.89. Patient characteristics varied significantly by hospital aOR for mortality. Length of stay averaged 6.0 ± 1.6 days, and varied significantly by hospital performance (P < 0.001). Facility level predictors of risk-adjusted mortality were higher Medicaid case-mix (OR = 1.00, P = 0.029) and LPN staffing (OR = 1.02, P = 0.015). Higher cirrhosis volume (OR = 0.99, P = 0.025) and liver transplant program status (OR = 0.83, P = 0.026) were significantly associated with survival. After adjusting for patient differences, era, and clustering effects, 15.3% of variation between hospitals was attributable to differences in facility characteristics.
CONCLUSION Hospital characteristics account for a significant proportion of variation in cirrhosis mortality. These findings have several implications for patients, providers, and health care delivery in liver disease care and inpatient health care design.
Collapse
|
9
|
Greenhalgh J, Dalkin S, Gooding K, Gibbons E, Wright J, Meads D, Black N, Valderas JM, Pawson R. Functionality and feedback: a realist synthesis of the collation, interpretation and utilisation of patient-reported outcome measures data to improve patient care. HEALTH SERVICES AND DELIVERY RESEARCH 2017. [DOI: 10.3310/hsdr05020] [Citation(s) in RCA: 109] [Impact Index Per Article: 13.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/07/2023] Open
Abstract
BackgroundThe feedback of patient-reported outcome measures (PROMs) data is intended to support the care of individual patients and to act as a quality improvement (QI) strategy.ObjectivesTo (1) identify the ideas and assumptions underlying how individual and aggregated PROMs data are intended to improve patient care, and (2) review the evidence to examine the circumstances in which and processes through which PROMs feedback improves patient care.DesignTwo separate but related realist syntheses: (1) feedback of aggregate PROMs and performance data to improve patient care, and (2) feedback of individual PROMs data to improve patient care.InterventionsAggregate – feedback and public reporting of PROMs, patient experience data and performance data to hospital providers and primary care organisations. Individual – feedback of PROMs in oncology, palliative care and the care of people with mental health problems in primary and secondary care settings.Main outcome measuresAggregate – providers’ responses, attitudes and experiences of using PROMs and performance data to improve patient care. Individual – providers’ and patients’ experiences of using PROMs data to raise issues with clinicians, change clinicians’ communication practices, change patient management and improve patient well-being.Data sourcesSearches of electronic databases and forwards and backwards citation tracking.Review methodsRealist synthesis to identify, test and refine programme theories about when, how and why PROMs feedback leads to improvements in patient care.ResultsProviders were more likely to take steps to improve patient care in response to the feedback and public reporting of aggregate PROMs and performance data if they perceived that these data were credible, were aimed at improving patient care, and were timely and provided a clear indication of the source of the problem. However, implementing substantial and sustainable improvement to patient care required system-wide approaches. In the care of individual patients, PROMs function more as a tool to support patients in raising issues with clinicians than they do in substantially changing clinicians’ communication practices with patients. Patients valued both standardised and individualised PROMs as a tool to raise issues, but thought is required as to which patients may benefit and which may not. In settings such as palliative care and psychotherapy, clinicians viewed individualised PROMs as useful to build rapport and support the therapeutic process. PROMs feedback did not substantially shift clinicians’ communication practices or focus discussion on psychosocial issues; this required a shift in clinicians’ perceptions of their remit.Strengths and limitationsThere was a paucity of research examining the feedback of aggregate PROMs data to providers, and we drew on evidence from interventions with similar programme theories (other forms of performance data) to test our theories.ConclusionsPROMs data act as ‘tin openers’ rather than ‘dials’. Providers need more support and guidance on how to collect their own internal data, how to rule out alternative explanations for their outlier status and how to explore the possible causes of their outlier status. There is also tension between PROMs as a QI strategy versus their use in the care of individual patients; PROMs that clinicians find useful in assessing patients, such as individualised measures, are not useful as indicators of service quality.Future workFuture research should (1) explore how differently performing providers have responded to aggregate PROMs feedback, and how organisations have collected PROMs data both for individual patient care and to improve service quality; and (2) explore whether or not and how incorporating PROMs into patients’ electronic records allows multiple different clinicians to receive PROMs feedback, discuss it with patients and act on the data to improve patient care.Study registrationThis study is registered as PROSPERO CRD42013005938.FundingThe National Institute for Health Research Health Services and Delivery Research programme.
Collapse
Affiliation(s)
- Joanne Greenhalgh
- School of Sociology and Social Policy, University of Leeds, Leeds, UK
| | - Sonia Dalkin
- Department of Public Health, Northumbria University, Newcastle upon Tyne, UK
| | - Kate Gooding
- School of Sociology and Social Policy, University of Leeds, Leeds, UK
| | - Elizabeth Gibbons
- Nuffield Department of Population Health, University of Oxford, Oxford, UK
| | - Judy Wright
- School of Sociology and Social Policy, University of Leeds, Leeds, UK
| | - David Meads
- School of Sociology and Social Policy, University of Leeds, Leeds, UK
| | - Nick Black
- Department of Health Services Research and Policy, London School of Hygiene and Tropical Medicine, London, UK
| | | | - Ray Pawson
- School of Sociology and Social Policy, University of Leeds, Leeds, UK
| |
Collapse
|
10
|
Kadri SS, Miller AC, Hohmann S, Bonne S, Nielsen C, Wells C, Gruver C, Quraishi SA, Sun J, Cai R, Morris PE, Freeman BD, Holmes JH, Cairns BA, Suffredini AF. Risk Factors for In-Hospital Mortality in Smoke Inhalation-Associated Acute Lung Injury: Data From 68 United States Hospitals. Chest 2016; 150:1260-1268. [PMID: 27316558 PMCID: PMC5310127 DOI: 10.1016/j.chest.2016.06.008] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2016] [Revised: 04/28/2016] [Accepted: 06/01/2016] [Indexed: 10/21/2022] Open
Abstract
BACKGROUND Mortality after smoke inhalation-associated acute lung injury (SI-ALI) remains substantial. Age and burn surface area are risk factors of mortality, whereas the impact of patient- and center-level variables and treatments on survival are unknown. METHODS We performed a retrospective cohort study of burn and non-burn centers at 68 US academic medical centers between 2011 and 2014. Adult inpatients with SI-ALI were identified using an algorithm based on a billing code for respiratory conditions from smoke inhalation who were mechanically ventilated by hospital day 4, with either a length-of-stay ≥ 5 days or death within 4 days of hospitalization. Predictors of in-hospital mortality were identified using logistic regression. The primary outcome was the odds ratio for in-hospital mortality. RESULTS A total of 769 patients (52.9 ± 18.1 years) with SI-ALI were analyzed. In-hospital mortality was 26% in the SI-ALI cohort and 50% in patients with ≥ 20% surface burns. In addition to age > 60 years (OR 5.1, 95% CI 2.53-10.26) and ≥ 20% burns (OR 8.7, 95% CI 4.55-16.75), additional risk factors of in-hospital mortality included initial vasopressor use (OR 5.0, 95% CI 3.16-7.91), higher diagnostic-related group-based risk-of-mortality assignment and lower hospital bed capacity (OR 2.3, 95% CI 1.23-4.15). Initial empiric antibiotics (OR 0.93, 95% CI 0.58-1.49) did not impact survival. These new risk factors improved mortality prediction by 9.9% (P < .001). CONCLUSIONS In addition to older age and major surface burns, mortality in SI-ALI is predicted by initial vasopressor use, higher diagnostic-related group-based risk-of-mortality assignment, and care at centers with < 500 beds, but not by initial antibiotic therapy.
Collapse
Affiliation(s)
- Sameer S Kadri
- Critical Care Medicine Department, Clinical Center, National Institutes of Health, Bethesda, MD; Department of Medicine, Massachusetts General Hospital, Boston, MA.
| | - Andrew C Miller
- Critical Care Medicine Department, Clinical Center, National Institutes of Health, Bethesda, MD; Department of Emergency Medicine, West Virginia University, Morgantown, WV
| | - Samuel Hohmann
- University HealthSystem Consortium, Chicago, IL; Department of Health Systems Management, Rush University, Chicago, IL
| | - Stephanie Bonne
- Department of Surgery, Washington University School of Medicine, St. Louis, MO
| | - Carrie Nielsen
- North Carolina Jaycee Burn Center, University of North Carolina Hospital, Chapel Hill, NC
| | - Carmen Wells
- Department of General Surgery, Wake Forest Medical Center, Wake Forest School of Medicine, Winston-Salem, NC
| | - Courtney Gruver
- Department of General Surgery, Wake Forest Medical Center, Wake Forest School of Medicine, Winston-Salem, NC
| | - Sadeq A Quraishi
- Department of Anesthesia, Critical Care and Pain Medicine, Massachusetts General Hospital, Harvard Medical School, Boston, MA; Department of Anesthesia, Harvard Medical School, Boston, MA
| | - Junfeng Sun
- Critical Care Medicine Department, Clinical Center, National Institutes of Health, Bethesda, MD
| | - Rongman Cai
- Critical Care Medicine Department, Clinical Center, National Institutes of Health, Bethesda, MD
| | - Peter E Morris
- Division of Pulmonary and Critical Care Medicine, Wake Forest Medical Center, Wake Forest School of Medicine, Winston-Salem, NC
| | - Bradley D Freeman
- Department of Surgery, Washington University School of Medicine, St. Louis, MO
| | - James H Holmes
- Department of General Surgery, Wake Forest Medical Center, Wake Forest School of Medicine, Winston-Salem, NC
| | - Bruce A Cairns
- North Carolina Jaycee Burn Center, University of North Carolina Hospital, Chapel Hill, NC
| | - Anthony F Suffredini
- Critical Care Medicine Department, Clinical Center, National Institutes of Health, Bethesda, MD
| |
Collapse
|
11
|
Park HK, Ahn HS, Yoon SJ, Lee HY, Hong JM, Lee SW, Hann HJ. Comparing Risk-adjusted Hospital Mortality for CABG and AMI Patients. J Int Med Res 2016; 33:425-33. [PMID: 16104446 DOI: 10.1177/147323000503300408] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022] Open
Abstract
The objectives of this study were to compare the risk-adjusted mortality of coronary artery bypass graft (CABG) and acute myocardial infarction (AMI) patients simultaneously in six hospitals in Seoul, Korea, and to investigate the relationship between these performance measures by developing a predictive model of mortality. The medical records of 749 AMI and 564 CABG patients were reviewed. A predictive model was developed using logistic regression, including 170 variables selected as risk factors for risk adjustment. The validity of our predictive model was demonstrated to be within an acceptable range. The results showed that one hospital with a significantly low AMI mortality rate also had a low CABG mortality rate, while another hospital with a significantly high AMI mortality rate also had a high CABG mortality rate. Our results implied that hospitals providing good-quality medical management of coronary artery disease also provided a good-quality surgical service.
Collapse
Affiliation(s)
- H K Park
- Korea Health Insurance Review Agency, Seoul, Korea
| | | | | | | | | | | | | |
Collapse
|
12
|
Hayashida K, Imanaka Y, Sekimoto M, Kobuse H, Fukuda H. Evaluation of Acute Myocardial Infarction In-hospital Mortality Using a Risk-adjustment Model Based on Japanese Administrative Data. J Int Med Res 2016; 35:590-6. [PMID: 17900397 DOI: 10.1177/147323000703500502] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/31/2022] Open
Abstract
This study aimed to develop a new risk-adjustment method to assess acute myocardial infarction (AMI) in-hospital mortality. Risk-adjustment was based on variables obtained from administrative data from Japanese hospitals, and included factors such as age, gender, primary diagnosis and co-morbidity. The infarct location was determined using the criteria of the International Classification of Diseases (10th version). Potential co-morbidity risk factors for mortality were selected based on previous studies and their critical influence analysed to identify major co-morbidities. The remaining minor co-morbidities were then divided into two groups based on their medical implications. The major co-morbidities included shock, pneumonia, cancer and chronic renal failure. The two minor co-morbidity groups also demonstrated a substantial impact on mortality. The model was then used to assess clinical performance in the participating hospitals. Our model reliably employed the available data for the risk-adjustment of AMI mortality and provides a new approach to evaluating clinical performance.
Collapse
Affiliation(s)
- K Hayashida
- Department of Healthcare Economics and Quality Management, School of Public Health, Kyoto University Graduate School of Medicine, Kyoto, Japan
| | | | | | | | | |
Collapse
|
13
|
Mohnen SM, Molema CC, Steenbeek W, van den Berg MJ, de Bruin SR, Baan CA, Struijs JN. Cost Variation in Diabetes Care across Dutch Care Groups? Health Serv Res 2016; 52:93-112. [PMID: 26997514 DOI: 10.1111/1475-6773.12483] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022] Open
Abstract
OBJECTIVE The introduction of bundled payment for diabetes care in the Netherlands led to the origination of care groups. This study explored to what extent variation in health care costs per patient can be attributed to the performance of care groups. Furthermore, the commonly applied simple mean aggregation was compared with the more advanced generalized linear mixed model (GLMM) to benchmark health care costs per patient between care groups. DATA SOURCE Dutch 2009 nationwide insurance claims data of diabetes type 2 patients (104,544 patients, 50 care groups). STUDY DESIGN Both a simple mean aggregation and a GLMM approach was applied to rank care groups, using two different health care costs variables: total treatment health care costs and diabetes-specific specialist care costs per diabetes patient. PRINCIPAL FINDINGS Care groups varied slightly in the first and mainly in the second indicator. Care group variation was not explained by composition. Although the ranking methods were correlated, some care groups' rank positions differed, with consequences on the top-10 and the low-10 positions. CONCLUSIONS Differences between care groups exist when an appropriate indicator and a sophisticated aggregation technique is used. Currently applied benchmarking may have unfair consequences for some care groups.
Collapse
Affiliation(s)
- Sigrid M Mohnen
- National Institute for Public Health and the Environment (RIVM), Centre for Nutrition, Prevention, and Health Services, Bilthoven, the Netherlands
| | - Claudia C Molema
- National Institute for Public Health and the Environment (RIVM), Centre for Nutrition, Prevention, and Health Services, Bilthoven, the Netherlands
| | - Wouter Steenbeek
- Netherlands Institute for the Study of Crime and Law Enforcement (NSCR), Amsterdam, the Netherlands
| | - Michael J van den Berg
- National Institute for Public Health and the Environment (RIVM), Centre for Health and Society, Bilthoven, the Netherlands
| | - Simone R de Bruin
- National Institute for Public Health and the Environment (RIVM), Centre for Nutrition, Prevention, and Health Services, Bilthoven, the Netherlands
| | - Caroline A Baan
- National Institute for Public Health and the Environment (RIVM), Centre for Nutrition, Prevention, and Health Services, Bilthoven, the Netherlands.,Scientific Centre for Transformation in Care and Welfare (Tranzo), University of Tilburg, Tilburg, the Netherlands
| | - Jeroen N Struijs
- National Institute for Public Health and the Environment (RIVM), Centre for Nutrition, Prevention, and Health Services, Bilthoven, the Netherlands
| |
Collapse
|
14
|
Berlowitz DR, Stineman M. Risk Adjustment in Rehabilitation Quality Improvement. Top Stroke Rehabil 2015; 17:252-61. [DOI: 10.1310/tsr1704-252] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
|
15
|
Castro RAS, Oliveira PN, Silva Portela C, Camanho AS, Queiroz e Melo J. Benchmarking clinical practice in surgery: looking beyond traditional mortality rates. Health Care Manag Sci 2014; 18:431-43. [PMID: 24633958 DOI: 10.1007/s10729-014-9266-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2013] [Accepted: 01/11/2014] [Indexed: 11/30/2022]
Abstract
This paper proposes two new measures to assess performance of surgical practice based on observed mortality: reliability, measured as the area under the ROC curve and a living score, the sum of individual risk among surviving patients, divided by the total number of patients. A Monte Carlo simulation of surgeons' practice was used for conceptual validation and an analysis of a real-world hospital department was used for managerial validation. We modelled surgical practice as a bivariate distribution function of risk and final state. We sampled 250 distributions, varying the maximum risk each surgeon faced, the distribution of risk among dead patients, the mortality rate and the number of surgeries performed yearly. We applied the measures developed to a Portuguese cardiothoracic department. We found that the joint use of the reliability and living score measures overcomes the limitations of risk adjusted mortality rates, as it enables a different valuation of deaths, according to their risk levels. Reliability favours surgeons with casualties, predominantly, in high values of risk and penalizes surgeons with deaths in relatively low levels of risk. The living score is positively influenced by the maximum risk for which a surgeon yields surviving patients. These measures enable a deeper understanding of surgical practice and, as risk adjusted mortality rates, they rely only on mortality and risk scores data. The case study revealed that the performance of the department analysed could be improved with enhanced policies of risk management, involving the assignment of surgeries based on surgeon's reliability and living score.
Collapse
Affiliation(s)
- Ricardo A S Castro
- Faculdade de Engenharia da Universidade do Porto: Rua Dr. Roberto Frias, s/n, 4200-465, Porto, Portugal.
| | - Pedro N Oliveira
- Instituto de Ciências Biomédicas Abel Salazar da Universidade do Porto: Rua de Jorge Viterbo Ferreira, no. 228, 4050-313, Porto, Portugal
| | - Conceição Silva Portela
- CEGE - Centros de Estudos em Gestão e Economia da Universidade, Católica Portuguesa - Centro Regional do Porto: Rua Diogo Botelho, no. 1327, 4169-005, Porto, Portugal
| | - Ana S Camanho
- Faculdade de Engenharia da Universidade do Porto: Rua Dr. Roberto Frias, s/n, 4200-465, Porto, Portugal
| | - João Queiroz e Melo
- ICS - Instituto de Ciências da Saúde da Universidade Católica Portuguesa - Centro Regional do Porto: Rua Dr. Ant´onio Bernardino de Almeida, s/n, 4200-072, Porto, Portugal
| |
Collapse
|
16
|
Carlisle JB. Pre-operative co-morbidity and postoperative survival in the elderly: beyond one lunar orbit. Anaesthesia 2013; 69 Suppl 1:17-25. [DOI: 10.1111/anae.12489] [Citation(s) in RCA: 22] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/02/2013] [Indexed: 12/30/2022]
Affiliation(s)
- J. B. Carlisle
- Anaesthetic Department; Torbay Hospital; Torquay Devon UK
| |
Collapse
|
17
|
Eijkenaar F, van Vliet RCJA. Performance profiling in primary care: does the choice of statistical model matter? Med Decis Making 2013; 34:192-205. [PMID: 23920433 DOI: 10.1177/0272989x13498825] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
BACKGROUND Profiling is increasingly being used to generate input for improvement efforts in health care. For these efforts to be successful, profiles must reflect true provider performance, requiring an appropriate statistical model. Sophisticated models are available to account for the specific features of performance data, but they may be difficult to use and explain to providers. OBJECTIVE To assess the influence of the statistical model on the performance profiles of primary care providers. Data Source. Administrative data (2006–2008) on 2.8 million members of a Dutch health insurer who were registered with 1 of 4396 general practitioners. METHODS Profiles are constructed for 6 quality measures and 5 resource use measures, controlling for differences in case mix. Models include ordinary least squares, generalized linear models, and multilevel models. Separately for each model, providers are ranked on z scores and classified as outlier if belonging to the 10% with the worst or best performance. The impact of the model is evaluated using the weighted kappa for rankings overall, percentage agreement on outlier designation, and changes in rankings over time. RESULTS Agreement among models was relatively high overall (kappa typically .0.85). Agreement on outlier designation was more variable and often below 80%, especially for high outliers. Rankings were more similar for processes than for outcomes and expenses. Agreement among annual rankings per model was low for all models. CONCLUSIONS Differences among models were relatively small, but the choice of statistical model did affect the rankings. In addition, most measures appear to be driven largely by chance, regardless of the model that is used. Profilers should pay careful attention to the choice of both the statistical model and the performance measures.
Collapse
Affiliation(s)
- Frank Eijkenaar
- Institute of Health Policy and Management, Erasmus University Rotterdam, Rotterdam, the Netherlands
| | - René C J A van Vliet
- Institute of Health Policy and Management, Erasmus University Rotterdam, Rotterdam, the Netherlands
| |
Collapse
|
18
|
Berta P, Seghieri C, Vittadini G. Comparing health outcomes among hospitals: the experience of the Lombardy Region. Health Care Manag Sci 2013; 16:245-57. [PMID: 23529708 DOI: 10.1007/s10729-013-9227-1] [Citation(s) in RCA: 20] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/21/2012] [Accepted: 02/22/2013] [Indexed: 10/27/2022]
|
19
|
Goldman LE, Chu PW, Osmond D, Bindman A. Accuracy of do not resuscitate (DNR) in administrative data. Med Care Res Rev 2012; 70:98-112. [PMID: 22955698 DOI: 10.1177/1077558712458455] [Citation(s) in RCA: 20] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/21/2022]
Abstract
This article evaluates the accuracy of reporting do not resuscitate (DNR) orders in administrative data for use in risk-adjusted hospital assessments. We compared DNR reporting by 48 California hospitals in 2005 patient discharge data (PDD) with gold-standard assessments made by registered nurses (RNs) who reabstracted 1,673 records of patients with myocardial infarction, pneumonia, or heart failure. The PDD agreed with the RN reabstraction in 1,411 (84.3%) cases. The administrative data did not reflect a DNR order in 71 of 512 records where the RN indicated there was (14% false negative rates), and reflected a DNR order in 191 of 1,161 records where the RN indicated there was not (16% false positive rate). The accuracy of DNR was more problematic for patients who died, suggesting that hospital-reported DNR is problematic for capturing patient preferences for resuscitation that can be used for risk-adjusted outcomes assessments.
Collapse
|
20
|
Alwaqfi NR, Khader YS, Ibrahim KS, Eqab FM. Coronary artery bypass grafting: 30-day operative morbidity analysis in 1046 patients. J Clin Med Res 2012; 4:267-73. [PMID: 22870174 PMCID: PMC3409622 DOI: 10.4021/jocmr1020w] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/08/2012] [Indexed: 11/03/2022] Open
Abstract
Background To determine the rate and risk factors of three operative complications (renal failure, pneumonia, and sternal wound infection) within 30 days after isolated coronary artery bypass surgery. Methods Medical records of 1,046 consecutive patients between the years 2005 and 2009 were reviewed. Demographic data and peri-operative information were collected and analyzed. Univariate and multivariate analysis between different variables were performed. Results Of all patients 3.6% developed pneumonia, 5.9% developed acute renal failure and 8.5% developed sternal wound infection. Independent predictors of acute renal failure were age > 65 years (P = 0.030), pre-operative renal impairment (P < 0.005), peripheral vascular disease (P = 0.005), emergency surgery (P = 0.043), blood transfusion (P = 0.002) mechanical ventilation > 12 hours (P < 0.005) and prolonged inotropic support (P = 0.035). Pneumonia independent predictors were female gender (P < 0.005), diabetes mellitus (P = 0.024), peripheral vascular disease (P = 0.012), emergency surgery (P = 0.007), blood transfusion (P = 0.001), mechanical ventilation > 12 hours (P = 0.005) and prolonged inotropic support (P < 0.005). Sternal wound infection independent predictors were diabetes mellitus (P = 0.017), intra- and post-operative blood transfusion (P < 0.005), and prolonged inotropic support (P = 0.006). Conclusion Age, female gender, history of diabetes mellitus, chronic obstructive pulmonary disease, peripheral vascular disease, renal impairment, emergency surgery, per-operative blood transfusion, mechanical ventilation > 12 hours and prolonged inotropic support are associated with the 30-day complication after on-pump isolated coronary artery bypass grafting surgery.
Collapse
Affiliation(s)
- Nizar R Alwaqfi
- Princess Muna Heart Center, Department of General Surgery, Jordan University of Science and Technology and King Abdullah University Hospital, Irbid, Jordan
| | | | | | | |
Collapse
|
21
|
|
22
|
Lovaglio PG. Benchmarking strategies for measuring the quality of healthcare: problems and prospects. ScientificWorldJournal 2012; 2012:606154. [PMID: 22666140 PMCID: PMC3361319 DOI: 10.1100/2012/606154] [Citation(s) in RCA: 27] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2011] [Accepted: 11/29/2011] [Indexed: 01/24/2023] Open
Abstract
Over the last few years, increasing attention has been directed toward the problems inherent to measuring the quality of healthcare and implementing benchmarking strategies. Besides offering accreditation and certification processes, recent approaches measure the performance of healthcare institutions in order to evaluate their effectiveness, defined as the capacity to provide treatment that modifies and improves the patient's state of health. This paper, dealing with hospital effectiveness, focuses on research methods for effectiveness analyses within a strategy comparing different healthcare institutions. The paper, after having introduced readers to the principle debates on benchmarking strategies, which depend on the perspective and type of indicators used, focuses on the methodological problems related to performing consistent benchmarking analyses. Particularly, statistical methods suitable for controlling case-mix, analyzing aggregate data, rare events, and continuous outcomes measured with error are examined. Specific challenges of benchmarking strategies, such as the risk of risk adjustment (case-mix fallacy, underreporting, risk of comparing noncomparable hospitals), selection bias, and possible strategies for the development of consistent benchmarking analyses, are discussed. Finally, to demonstrate the feasibility of the illustrated benchmarking strategies, an application focused on determining regional benchmarks for patient satisfaction (using 2009 Lombardy Region Patient Satisfaction Questionnaire) is proposed.
Collapse
Affiliation(s)
- Pietro Giorgio Lovaglio
- CRISP and Department of Quantitative Methods, University of Bicocca-Milan, V. Sarca 202, 20146 Milan, Italy.
| |
Collapse
|
23
|
Risk-adjusted mortality: problems and possibilities. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2012; 2012:829465. [PMID: 22474540 PMCID: PMC3312252 DOI: 10.1155/2012/829465] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/29/2011] [Revised: 12/24/2011] [Accepted: 01/03/2012] [Indexed: 11/18/2022]
Abstract
The ratio of observed-to-expected deaths is considered a measure of hospital quality and for this reason will soon become a basis for payment. However, there are drivers of that metric more potent than quality: most important are medical documentation and patient acuity. If hositals underdocument and therefore do not capture the full “expected mortality” they may be tempted to lower their observed/expected ratio by reducing “observed mortality” through limiting access to the very ill. Underdocumentation occurs because hospitals do not recognize, and therefore cannot seek to confirm, specific comorbidities conferring high mortality risk. To help hospitals identify these comorbidities, this paper describes an easily implemented spread-sheet for evaluating comorbid conditions associated, in any particular hospital, with each discharge. This method identifies comorbidities that increase in frequency as mortality risk increases within each diagnostic grouping. The method is inductive and therefore independent of any particular risk-adjustment technique.
Collapse
|
24
|
Enfield KB, Schafer K, Zlupko M, Herasevich V, Novicoff WM, Gajic O, Hoke TR, Truwit JD. A comparison of administrative and physiologic predictive models in determining risk adjusted mortality rates in critically ill patients. PLoS One 2012; 7:e32286. [PMID: 22384205 PMCID: PMC3286481 DOI: 10.1371/journal.pone.0032286] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2010] [Accepted: 01/26/2012] [Indexed: 11/18/2022] Open
Abstract
Background Hospitals are increasingly compared based on clinical outcomes adjusted for severity of illness. Multiple methods exist to adjust for differences between patients. The challenge for consumers of this information, both the public and healthcare providers, is interpreting differences in risk adjustment models particularly when models differ in their use of administrative and physiologic data. We set to examine how administrative and physiologic models compare to each when applied to critically ill patients. Methods We prospectively abstracted variables for a physiologic and administrative model of mortality from two intensive care units in the United States. Predicted mortality was compared through the Pearsons Product coefficient and Bland-Altman analysis. A subgroup of patients admitted directly from the emergency department was analyzed to remove potential confounding changes in condition prior to ICU admission. Results We included 556 patients from two academic medical centers in this analysis. The administrative model and physiologic models predicted mortalities for the combined cohort were 15.3% (95% CI 13.7%, 16.8%) and 24.6% (95% CI 22.7%, 26.5%) (t-test p-value<0.001). The r2 for these models was 0.297. The Bland-Atlman plot suggests that at low predicted mortality there was good agreement; however, as mortality increased the models diverged. Similar results were found when analyzing a subgroup of patients admitted directly from the emergency department. When comparing the two hospitals, there was a statistical difference when using the administrative model but not the physiologic model. Unexplained mortality, defined as those patients who died who had a predicted mortality less than 10%, was a rare event by either model. Conclusions In conclusion, while it has been shown that administrative models provide estimates of mortality that are similar to physiologic models in non-critically ill patients with pneumonia, our results suggest this finding can not be applied globally to patients admitted to intensive care units. As patients and providers increasingly use publicly reported information in making health care decisions and referrals, it is critical that the provided information be understood. Our results suggest that severity of illness may influence the mortality index in administrative models. We suggest that when interpreting “report cards” or metrics, health care providers determine how the risk adjustment was made and compares to other risk adjustment models.
Collapse
Affiliation(s)
- Kyle B Enfield
- Department of Medicine, University of Virginia, Charlottesville, Virginia, United States of America.
| | | | | | | | | | | | | | | |
Collapse
|
25
|
Abstract
BACKGROUND The Leapfrog Group reports on hospitals' adoption of the National Quality Forum Patient Safety Practices. However, it is unknown whether hospital compliance with these safe practices is associated with improved outcomes in patients undergoing major surgery. METHODS We analyzed the association between hospital mortality and Leapfrog Safe Practices among patients undergoing coronary artery bypass graft surgery (n=18,565), abdominal aortic aneurysm repair (n=2777), and hip replacement (n=25,067) in hospitals participating in the 2007 Leapfrog Hospital Survey using logistic regression. RESULTS After adjusting for patient and hospital factors, we found that the total safety score (adjusted odds ratio: 1.000, 95% confidence interval: 0.999-1.001) was not associated with hospital mortality. Computerized physician order entry and ICU physician staffing were also not associated with hospital mortality. CONCLUSIONS We did not find evidence that patients undergoing major surgery at hospitals which scored higher on the Leapfrog Safe Practices Survey had lower mortality rates. The Leapfrog safe practices score as a standalone quality measure may have limited power to distinguish between high-quality and low-quality hospitals.
Collapse
|
26
|
Goldman LE, Chu PW, Osmond D, Bindman A. The accuracy of present-on-admission reporting in administrative data. Health Serv Res 2011; 46:1946-62. [PMID: 22092023 DOI: 10.1111/j.1475-6773.2011.01300.x] [Citation(s) in RCA: 69] [Impact Index Per Article: 4.9] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/01/2022] Open
Abstract
OBJECTIVE To test the accuracy of reporting present-on-admission (POA) and to assess whether POA reporting accuracy differs by hospital characteristics. DATA SOURCES We performed an audit of POA reporting of secondary diagnoses in 1,059 medical records from 48 California hospitals. STUDY DESIGN We used patient discharge data (PDD) to select records with secondary diagnoses that are powerful predictors of mortality and could potentially represent comorbidities or complications among patients who either had a primary procedure of a percutaneous transluminal coronary angioplasty or a primary diagnosis of acute myocardial infarction, community-acquired pneumonia, or congestive heart failure. We modeled the relationship between secondary diagnoses POA reporting accuracy (over-reporting and under-reporting) and hospital characteristics. DATA COLLECTION We created a gold standard from blind reabstraction of the medical records and compared the accuracy of the PDD against the gold standard. PRINCIPAL FINDINGS The PDD and gold standard agreed on POA reporting in 74.3 percent of records, with 13.7 percent over-reporting and 11.9 percent under-reporting. For-profit hospitals tended to overcode secondary diagnoses as present on admission (odds ratios [OR] 1.96; 95 percent confidence interval [CI] 1.11, 3.44), whereas teaching hospitals tended to undercode secondary diagnoses as present on admission (OR 2.61; 95 percent CI 1.36, 5.03). CONCLUSIONS POA reporting of secondary diagnoses is moderately accurate but varies by hospitals. Steps should be taken to improve POA reporting accuracy before using POA in hospital assessments tied to payments.
Collapse
Affiliation(s)
- L Elizabeth Goldman
- Department of Medicine, University of California-San Francisco, San Francisco, CA 94110, USA.
| | | | | | | |
Collapse
|
27
|
Wang J, Hockenberry J, Chou SY, Yang M. Do bad report cards have consequences? Impacts of publicly reported provider quality information on the CABG market in Pennsylvania. JOURNAL OF HEALTH ECONOMICS 2011; 30:392-407. [PMID: 21195494 DOI: 10.1016/j.jhealeco.2010.11.006] [Citation(s) in RCA: 35] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/03/2009] [Revised: 11/29/2010] [Accepted: 11/29/2010] [Indexed: 05/30/2023]
Abstract
Since 1992, the Pennsylvania Health Care Cost Containment Council (PHC4) has published cardiac care report cards for coronary artery bypass graft (CABG) surgery providers. We examine the impact of CABG report cards on a provider's aggregate volume and volume by patient severity and then employ a mixed logit model to investigate the matching between patients and providers. We find a reduction in volume of poor performing and unrated surgeons' volume but no effect on more highly rated surgeons or hospitals of any rating. We also find that the probability that patients, regardless of severity of illness, receive CABG surgery from low-performing surgeons is significantly lower.
Collapse
Affiliation(s)
- Justin Wang
- School of Business, Worcester Polytechnic Institute, USA
| | | | | | | |
Collapse
|
28
|
Chua CL, Palangkaraya A, Yong J. A two-stage estimation of hospital quality using mortality outcome measures: an application using hospital administrative data. HEALTH ECONOMICS 2010; 19:1404-1424. [PMID: 19937614 DOI: 10.1002/hec.1560] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/28/2023]
Abstract
This paper proposes a method of deriving a quality indicator for hospitals using mortality outcome measures. The method aggregates any number of mortality outcomes into a single indicator via a two-stage procedure. In the first stage, mortality outcomes are risk-adjusted using a system of seemingly unrelated regression equations. These risk-adjusted mortality rates are then aggregated into a single quality indicator in the second stage via weighted least squares. This method addresses the dimensionality problem in measuring hospital quality, which is multifaceted in nature. In addition, our method also facilitates further analyses of determinants of hospital quality by allowing the resulting quality estimates be associated with hospital characteristics. The method is applied to a sample of heart-disease episodes extracted from hospital administrative data from the state of Victoria, Australia. Using the quality estimates, we show that teaching hospitals and large regional hospitals provide higher quality of care than other hospitals and this superior performance is related to hospital case-load volume.
Collapse
Affiliation(s)
- Chew Lian Chua
- Melbourne Institute of Applied Economic and Social Research and The Centre for Microeconometrics, The University of Melbourne, Parkville, Victoria, Australia
| | | | | |
Collapse
|
29
|
Pons J, Sais C, Illa C, Méndez R, Suñen E, Casas M, Camí J. Is there an association between the quality of hospitals’ research and their quality of care? J Health Serv Res Policy 2010; 15:204-9. [DOI: 10.1258/jhsrp.2010.009125] [Citation(s) in RCA: 27] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Objective: It is often claimed that hospitals that are leaders in biomedical research provide higher health care quality, or vice versa. Although several studies have shown a relationship between teaching status and quality of care, none has analysed the association between research output and hospital outcomes. Our aim was to determine whether there is a relationship between bibliometric measures of research output in acute hospitals and hospital mortality for two common cardiac conditions. Methods: A cross-sectional analysis of secondary data of in-hospital risk-adjusted mortality for congestive heart failure and acute myocardial infarction (2002-2004) and several bibliometric measures of publications (1996- 2004) in cardiovascular disease. The setting was 50 acute Spanish public hospitals, voluntarily participating in an external quality initiative, with more than 30 medical cases of congestive heart failure and acute myocardial infarction per year, and more than five citable papers in the field of heart disease. Spearman's rho non-parametric correlation coefficient was used to assess association. Results: There was a low-to-moderate negative correlation between the risk-adjusted mortality ratio and the weighted citations ratio: 20.43 (95% CI 20.17 to 20.63) for congestive heart failure and 20.37 (20.10 to 20.59) for acute myocardial infarction. Teaching status and the technological level of the hospital had a stronger correlation with hospital mortality. Conclusions: Measures of research output could be considered for incorporation into comparisons of the quality of hospitals. A weighted citations ratio is the most suitable measure of research output, but more research is needed on the interplay between research and practice as complementary ways of developing medical knowledge.
Collapse
Affiliation(s)
- Joan Pons
- Catalan Agency for Health Technology Assessment and Research, Department of Health, Barcelona, Spain
| | | | | | - Raül Méndez
- Parc de Recerca Biomèdica de Barcelona, Barcelona, Spain
| | - Eduard Suñen
- Parc de Recerca Biomèdica de Barcelona, Barcelona, Spain
| | | | - Jordi Camí
- Parc de Recerca Biomèdica de Barcelona, Barcelona, Spain
| |
Collapse
|
30
|
Giorgio Lovaglio P. Hospital effectiveness from administrative data: the Lombardy case. TQM JOURNAL 2010. [DOI: 10.1108/17542731011072829] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
|
31
|
Manojlovich M, Antonakos CL, Ronis DL. The relationship between hospital size and ICU type on select adverse patient outcomes. Hosp Top 2010; 88:33-42. [PMID: 20494883 DOI: 10.1080/00185861003768845] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Abstract
The authors examined the relationships among hospital size and unit type, the prevalence of pressure ulcers, and rates of ventilator-associated pneumonia and catheter-related bloodstream infections in 25 intensive care units (ICUs) in 8 hospitals. Data came from the American Hospital Association survey, and nursing and infection control databases. Multiple regression was the main statistical technique. Pressure ulcer prevalence and catheter-related bloodstream infection rates were higher in large hospitals; ventilator-associated pneumonia rates were higher in surgical ICUs. Future researchers should include factors often hidden within hospital and unit characteristics to expose possible relationships that may be incorporated into interventions to prevent adverse outcomes.
Collapse
|
32
|
Basu A, Howell R, Gopinath D. Clinical performance indicators: intolerance for variety? Int J Health Care Qual Assur 2010; 23:436-49. [PMID: 20535911 DOI: 10.1108/09526861011037489] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
PURPOSE The performance of NHS U.K. hospitals is under continuous scrutiny as they are constantly under pressure to perform well. A recent document published by an independent body has recommended a host of clinical indicators to assess non-financial performance of hospitals. This study aims to critically analyse the performance of a single U.K. hospital against several of these recommended indicators. DESIGN/METHODOLOGY/APPROACH Data presented to the Hospital Trust Board for 12 months were used for this study. Previous years' data were used wherever available. FINDINGS Based on data analysis, this hospital's performance is extremely difficult to calculate. The indicators use complex ratios and due to lack of standardisation, the hospital performance could be interpreted as better, worse or indifferent. RESEARCH LIMITATIONS/IMPLICATIONS This study analyses most of the recommended indicators. Literature review did not reveal a similar analysis of another hospital against these indicators which precludes comparison. PRACTICAL IMPLICATIONS This study highlights the difficulty in comparing the performance of hospitals due to the inherent lack of consistency. Therefore it is apparent that any reward-rebuke system linked to performance should interpret the data with caution. It is therefore suggested that easy to control single value activities and standardised routine activities could be used to measure hospital performance. Alternatively, the hospital could compare with its own statistics from previous years. ORIGINALITY/VALUE Literature acknowledges the difficulties in measuring clinical performance. This paper elucidates these difficulties applied to the NHS and suggests alternatives.
Collapse
Affiliation(s)
- Abhijit Basu
- University Hospital of South Manchester, Wythenshawe, UK.
| | | | | |
Collapse
|
33
|
Schade CP, Brehm JG. Improving the home health acute-care hospitalization quality measure. Health Serv Res 2010; 45:712-27. [PMID: 20403057 DOI: 10.1111/j.1475-6773.2010.01106.x] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/01/2022] Open
Abstract
OBJECTIVES (1) To demonstrate average length of service (ALOS) bias in the currently used acute-care hospitalization (ACH) home health quality measure, limiting comparability across agencies, and (2) to propose alternative ACH measures. DATA SOURCES/STUDY SETTING Secondary analysis of Medicare home health service data 2004-2007; convenience sample of Medicare fee-for-service hospital discharges. STUDY DESIGN Cross-sectional analysis and patient-level simulation. DATA COLLECTION/EXTRACTION METHODS We aggregated outcome and ALOS data from 2,347 larger Medicare-certified home health agencies (HHAs) in the United States between 2004 and 2007, and calculated risk-adjusted monthly ACH rates. We used multiple regression to identify agency characteristics associated with ACH. We simulated ACH during and immediately after home health care using patient and agency characteristics similar to those in the actual data, comparing the existing measure with alternative fixed-interval measures. PRINCIPAL FINDINGS Of agency characteristics studied, ALOS had by far the highest partial correlation with the current ACH measure (r(2)=0.218, p<.0001). We replicated the correlation between ACH and ALOS in the patient-level simulation. We found no correlation between ALOS and the alternative measures. CONCLUSIONS Alternative measures do not exhibit ALOS bias and would be appropriate for comparing HHA ACH rates with one another or over time.
Collapse
Affiliation(s)
- Charles P Schade
- West Virginia Medical Institute, 3001 Chesterfield Ave., Charleston, WV 25304, USA.
| | | |
Collapse
|
34
|
Mukamel DB, Glance LG, Dick AW, Osler TM. Measuring quality for public reporting of health provider quality: making it meaningful to patients. Am J Public Health 2009; 100:264-9. [PMID: 20019317 DOI: 10.2105/ajph.2008.153759] [Citation(s) in RCA: 27] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Public quality reports of hospitals, health plans, and physicians are being used to promote efficiency and quality in the health care system. Shrinkage estimators have been proposed as superior measures of quality to be used in these reports because they offer more conservative and stable quality ranking of providers than traditional, nonshrinkage estimators. Adopting the perspective of a patient faced with choosing a local provider on the basis of publicly provided information, we examine the advantages and disadvantages of shrinkage and nonshrinkage estimators and contrast the information made available by them. We demonstrate that 2 properties of shrinkage estimators make them less useful than nonshrinkage estimators for patients making choices in their area of residence.
Collapse
Affiliation(s)
- Dana B Mukamel
- Health Policy Research Institute, University of California-Irvine, 100 Theory, Suite 110, Irvine, CA 92697-5800, USA.
| | | | | | | |
Collapse
|
35
|
Kim DH, Daskalakis C, Silvestry SC, Sheth MP, Lee AN, Adams S, Hohmann S, Medvedev S, Whellan DJ. Aspirin and clopidogrel use in the early postoperative period following on-pump and off-pump coronary artery bypass grafting. J Thorac Cardiovasc Surg 2009; 138:1377-84. [DOI: 10.1016/j.jtcvs.2009.07.027] [Citation(s) in RCA: 42] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/13/2008] [Revised: 05/20/2009] [Accepted: 07/06/2009] [Indexed: 10/20/2022]
|
36
|
Mukamel DB, Ladd H, Weimer DL, Spector WD, Zinn JS. Is there evidence of cream skimming among nursing homes following the publication of the Nursing Home Compare report card? THE GERONTOLOGIST 2009; 49:793-802. [PMID: 19491363 DOI: 10.1093/geront/gnp062] [Citation(s) in RCA: 22] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/14/2022] Open
Abstract
PURPOSE A national quality report card for nursing homes, Nursing Home Compare, has been published since 2002. It has been shown to have some, albeit limited, positive impact on quality of care. The objective of this study was to test empirically the hypothesis that nursing homes have responded to the publication of the report by adopting cream skimming admission policies. DESIGN AND METHODS The study included all non-Medicare newly admitted patients to all Medicare- and Medicaid-certified nursing homes nationally during the 2001-2005 period. Using the Minimum Data Set data, we calculated for each quarter several admission cohort characteristics: average number of activity of daily living limitations and percent of residents admitted with pain, with pressure ulcers, with urinary incontinence, with diabetes, and with memory limitations. We tested whether residents admitted in the postpublication period were less frail and sick compared with residents admitted in the prepublication period by estimating fixed facility effects longitudinal regression models. Analyses were stratified by nursing home ownership, occupancy, reported quality ranking, chain affiliation, and region. RESULTS Evidence for cream skimming was found with respect to pain and, to a lesser degree, with respect to memory limitation but not with respect to the 4 other admission cohort characteristics. IMPLICATIONS Despite the theoretical expectation, empirical evidence suggests only a limited degree of cream skimming. Further studies are required to investigate this phenomenon with respect to other admission cohort characteristics and with respect to post-acute patients.
Collapse
Affiliation(s)
- Dana B Mukamel
- Health Policy Research Institute, University of California, Irvine, Irvine, CA 92697-5800, USA.
| | | | | | | | | |
Collapse
|
37
|
Kim DH, Daskalakis C, Whellan DJ, Whitman IR, Hohmann S, Medvedev S, Kraft WK. Safety of selective serotonin reuptake inhibitor in adults undergoing coronary artery bypass grafting. Am J Cardiol 2009; 103:1391-5. [PMID: 19427434 DOI: 10.1016/j.amjcard.2009.01.348] [Citation(s) in RCA: 56] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/20/2008] [Revised: 01/21/2009] [Accepted: 01/21/2009] [Indexed: 12/31/2022]
Abstract
Selective serotonin reuptake inhibitors (SSRIs) are commonly used in patients with coronary artery disease and depression, but they have been reported to increase the risk for bleeding. However, data on the short-term outcomes comparing SSRI and non-SSRI antidepressant use after coronary artery bypass grafting (CABG) are limited. A retrospective analysis was conducted of 1,380 adults who received any antidepressants before CABG from 2003 to 2006 at academic medical centers participating in the University HealthSystem Consortium. The primary end point was defined as a composite of in-hospital mortality or any bleeding events, including postprocedural hemorrhage or hematoma, gastrointestinal hemorrhage, and reopening of surgical site. A total of 1,076 adults (78%) received SSRIs. After controlling for propensity of receiving SSRIs compared with non-SSRIs, no significant differences were found in the primary end point (9.4% vs 8.2%, adjusted odds ratio [OR] 1.03, 95% confidence interval [CI] 0.60 to 1.78), any bleeding events (6.5% vs 7.2%, OR 0.93, 95% CI 0.50 to 1.76), or in-hospital mortality (3.1% vs 2.3%, OR 0.88, 95% CI 0.47 to 1.65). There was no increased risk associated with SSRI use when the analysis was restricted to patients who received antiplatelet and anticoagulant therapy for acute coronary syndromes (OR 1.03, 95% CI 0.40 to 2.61) and when examined by age, gender, nonsteroidal anti-inflammatory drug use, and type of CABG (on pump or off pump). In conclusion, compared with non-SSRIs, the preoperative use of SSRIs does not seem to increase the risk for bleeding or in-hospital mortality after CABG.
Collapse
|
38
|
Abstract
BACKGROUND Prediction models that identify populations at risk for high health expenditures can guide the management and allocation of financial resources. OBJECTIVE To compare the ability for identifying individuals at risk for high health expenditures between the single-item assessment of general self-rated health (GSRH), "In general, would you say your health is Excellent, Very Good, Good, Fair, or Poor?," and 3 more complex measures. STUDY DESIGN We used data from a prospective cohort, representative of the US civilian noninstitutionalized population, to compare the predictive ability of GSRH to: (1) the Short Form-12, (2) the Seattle Index of Comorbidity, and (3) the Diagnostic Cost-Related Groups/Hierarchal Condition Categories Relative-Risk Score. The outcomes were total, pharmacy, and office-based annualized expenditures in the top quintile, decile, and fifth percentile and any inpatient expenditures. DATA SOURCE Medical Expenditure Panel Survey panels 8 (2003-2004, n = 7948) and 9 (2004-2005, n = 7921). RESULTS The GSRH model predicted the top quintile of expenditures, as well as the SF-12, Seattle Index of Comorbidity, though not as well as the Diagnostic Cost-Related Groups/Hierarchal Condition Categories Relative-Risk Score: total expenditures [area under the curve (AUC): 0.79, 0.80, 0.74, and 0.84, respectively], pharmacy expenditures (AUC: 0.83, 0.83, 0.76, and 0.87, respectively), and office-based expenditures (AUC: 0.73, 0.74, 0.68, and 0.78, respectively), as well as any hospital inpatient expenditures (AUC: 0.74, 0.76, 0.72, and 0.78, respectively). Results were similar for the decile and fifth percentile expenditure cut-points. CONCLUSIONS A simple model of GSRH and age robustly stratifies populations and predicts future health expenditures generally as well as more complex models.
Collapse
|
39
|
Myers RP, Quan H, Hubbard JN, Shaheen AAM, Kaplan GG. Predicting in-hospital mortality in patients with cirrhosis: results differ across risk adjustment methods. Hepatology 2009; 49:568-77. [PMID: 19085957 DOI: 10.1002/hep.22676] [Citation(s) in RCA: 69] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/15/2023]
Abstract
UNLABELLED Risk-adjusted health outcomes are often used to measure the quality of hospital care, yet the optimal approach in patients with liver disease is unclear. We sought to determine whether assessments of illness severity, defined as risk for in-hospital mortality, vary across methods in patients with cirrhosis. We identified 258,731 patients with cirrhosis hospitalized in the Nationwide Inpatient Sample between 2002 and 2005. The performance of four common risk adjustment methods (the Charlson/Deyo and Elixhauser comorbidity algorithms, Disease Staging, and All Patient Refined Diagnosis Related Groups [APR-DRGs]) for predicting in-hospital mortality was determined using the c-statistic. Subgroup analyses were conducted according to a primary versus secondary diagnosis of cirrhosis and in homogeneous patient subgroups (hepatic encephalopathy, hepatocellular carcinoma, congestive heart failure, pneumonia, hip fracture, and cholelithiasis). Patients were also ranked according to the probability of death as predicted by each method, and rankings were compared across methods. Predicted mortality according to the risk adjustment methods agreed for only 55%-67% of patients. Similarly, performance of the methods for predicting in-hospital mortality varied significantly. Overall, the c-statistics (95% confidence interval) for the Charlson/Deyo and Elixhauser algorithms, Disease Staging, and APR-DRGs were 0.683 (0.680-0.687), 0.749 (0.746-0.752), 0.832 (0.829-0.834), and 0.875 (0.873-0.878), respectively. Results were robust across diagnostic subgroups, but performance was lower in patients with a primary versus secondary diagnosis of cirrhosis. CONCLUSION Mortality analyses in patients with cirrhosis require sensitivity to the method of risk adjustment. Because different methods often produce divergent severity rankings, analyses of provider-specific outcomes may be biased depending on the method used.
Collapse
Affiliation(s)
- Robert P Myers
- Department of Medicine, Division of Gastroenterology, University of Calgary, Calgary, Alberta, Canada
| | | | | | | | | |
Collapse
|
40
|
Kang CH, Kim YI, Lee EJ, Park K, Lee JS, Kim Y. The variation in risk adjusted mortality of intensive care units. Korean J Anesthesiol 2009; 57:698-703. [PMID: 30625951 DOI: 10.4097/kjae.2009.57.6.698] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND This study aimed to estimate risk adjusted mortality rate in the ICUs (Intensive care units) by APACHE (Acute Physiology And Chronic Health Evaluation) III for revealing the performance variation in ICUs. METHODS This study focused on 1,090 patients in the ICUs of 18 hospitals. For establishing risk adjusted mortality predictive model, logistic regression analysis was performed. APACHE III, surgery experience, admission route, and major disease categories were used as independent variables. The performance of each model was evaluated by c-statistic and goodness-of-fit test of Hosmer-Lemeshow. Using this predictive model, the performance of each ICU was tested as ratio of predictive mortality rate and observed mortality rate. RESULTS The average observed mortality rate was 24.1%. The model including APACHE III score, admission route, and major disease categories was signified as the fittest one. After risk adjustment, the ratio of predictive mortality rate and observed mortality rate was distributed from 0.49 to 1.55. CONCLUSIONS The variation in risk adjusted mortality among ICUs was wide. The effort to reduce this quality difference is needed.
Collapse
Affiliation(s)
| | - Yong Ik Kim
- The Armed Forces Seoul Hospital, Seoul, Korea
| | | | - Kunhee Park
- The Armed Forces Seoul Hospital, Seoul, Korea
| | | | - Yoon Kim
- The Armed Forces Seoul Hospital, Seoul, Korea
| |
Collapse
|
41
|
Manojlovich M, Antonakos CL, Ronis DL. Intensive care units, communication between nurses and physicians, and patients' outcomes. Am J Crit Care 2009; 18:21-30. [PMID: 19116401 DOI: 10.4037/ajcc2009353] [Citation(s) in RCA: 65] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/01/2022]
Abstract
BACKGROUND Various factors in hospitals can adversely affect patients' outcomes, including faulty communication between nurses and physicians. Whether specific communication elements (timeliness, accuracy, openness, understanding) can influence adverse outcomes is unknown. OBJECTIVES To determine the relationships between patients' outcomes and (1) nurses' perceptions of elements of communication between nurses and physicians and (2) characteristics of the practice environment. METHODS A cross-sectional survey design was used. Information on ventilator-associated pneumonia, bloodstream infection associated with a central catheter, and pressure ulcers was collected from 25 intensive care units in southeastern Michigan. Simultaneously, 462 nurses in those units (response rate, 53.3%) were anonymously surveyed. The Conditions for Work Effectiveness Questionnaire-II and the Practice Environment Scale of the Nursing Work Index were used to measure characteristics of the practice environment. The Intensive Care Unit Nurse-Physician Questionnaire was used to measure communication between nurses and physicians. Statistical tests included correlation and multiple regression. Analyses were conducted at the unit level. RESULTS Unit response rates varied from 6% to 100%. Together, variability in understanding communication and capacity utilization were predictive of 27% of the variance in ventilator-associated pneumonia. Timeliness of communication was inversely related to pressure ulcers (r= -0.38; P=.06), and workplace empowerment and scores on the Acute Physiology and Chronic Health Evaluation III were positive predictors of ventilator-associated pneumonia (R(2)=0.36; P=.005). CONCLUSIONS Not all elements of communication were related to the selected adverse outcomes. The connection between characteristics of the practice environment at the unit level and adverse outcomes remains elusive.
Collapse
Affiliation(s)
- Milisa Manojlovich
- Milisa Manojlovich is an assistant professor and Cathy L. Antonakos is a statistical consultant at the University of Michigan School of Nursing, Ann Arbor. David L. Ronis is an associate research scientist and director of the statistical consulting team at the University of Michigan School of Nursing and is a statistical consultant within the US Department of Veterans Affairs
| | - Cathy L. Antonakos
- Milisa Manojlovich is an assistant professor and Cathy L. Antonakos is a statistical consultant at the University of Michigan School of Nursing, Ann Arbor. David L. Ronis is an associate research scientist and director of the statistical consulting team at the University of Michigan School of Nursing and is a statistical consultant within the US Department of Veterans Affairs
| | - David L. Ronis
- Milisa Manojlovich is an assistant professor and Cathy L. Antonakos is a statistical consultant at the University of Michigan School of Nursing, Ann Arbor. David L. Ronis is an associate research scientist and director of the statistical consulting team at the University of Michigan School of Nursing and is a statistical consultant within the US Department of Veterans Affairs
| |
Collapse
|
42
|
Racial disparity in the relationship between hospital volume and mortality among patients undergoing coronary artery bypass grafting. Ann Surg 2008; 248:886-92. [PMID: 18948819 DOI: 10.1097/sla.0b013e318189b1bc] [Citation(s) in RCA: 32] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/06/2023]
Abstract
OBJECTIVE To examine whether the volume-mortality relationship in coronary artery bypass grafting (CABG) differs by race and operative risk. SUMMARY BACKGROUND DATA In-hospital mortality after CABG is inversely associated with hospital volume. Racial disparities exist in the outcomes of CABG, possibly due to blacks' high operative risk. METHODS We analyzed 71,949 CABG procedures performed between 2002 and 2005 at 93 academic medical centers participating in the University HealthSystem Consortium. In-hospital mortality was examined across hospital volume categories (very low, <100/yr; low, 100-299/yr; medium, 300-499/yr; and high, > or =500/yr) via logistic regression. RESULTS In-hospital mortality was 2.0% in whites and 2.8% in blacks. Controlling for patient risk, geographic region, and proportion of African American patients treated at the hospital, the benefit of higher volume was substantial for blacks but only modest for whites (race-by-volume interaction; P = 0.033). Odds ratios of mortality for increasing volume categories (compared with very low volume) were 0.46, 0.37, and 0.47 among blacks but only 0.85, 0.77, and 0.75 among whites. Racial disparities in mortality existed mostly in very low-volume hospitals. The differential volume effect across the 2 racial groups seemed to be primarily driven by regional patterns, as the volume effect was much more pronounced in the South and the Midwest (region by volume interaction; P = 0.033). CONCLUSIONS Blacks have greater reduction in mortality than whites by undergoing CABG at higher-volume hospitals, regardless of operative risk. Because of limited generalizability, these findings should be confirmed using more representative database.
Collapse
|
43
|
Abstract
The discipline of health services research, often loosely referred to as outcomes research, is primarily focused on the study of access to care, costs of care, and quality of care. Access to care includes everything that facilitates or impedes the actual use of medical services. Costs of care include financial and nonfinancial payments by insurers and individuals for medical services as well as the opportunity cost of lost wages and the societal cost of decreased productivity. Quality of care encompasses elements of the structure, process, and outcome of medical care.
Collapse
Affiliation(s)
- Mark S Litwin
- David Geffen School of Medicine, School of Public Health, Jonsson Comprehensive Cancer Center, University of California, Los Angeles. Los Angeles, CA 90095-1738, USA.
| |
Collapse
|
44
|
Hollenbeak CS, Rogers AM, Barrus B, Wadiwala I, Cooney RN. Surgical volume impacts bariatric surgery mortality: a case for centers of excellence. Surgery 2008; 144:736-43. [PMID: 19081015 DOI: 10.1016/j.surg.2008.05.013] [Citation(s) in RCA: 88] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2008] [Accepted: 05/20/2008] [Indexed: 12/21/2022]
Abstract
BACKGROUND Concerns regarding care quality prompted credentialing processes for bariatric "Centers of Excellence" (COE). It is hypothesized that high-volume surgeons and hospitals have better outcomes. OBJECTIVE This population-based study examines the effect of bariatric surgery volume on mortality in Pennsylvania. METHODS Between 1999 and 2003, 14,716 patients having gastric bypass surgery in Pennsylvania hospitals were identified from the Pennsylvania Health Care Cost Containment Council database. Individual surgeons and hospitals were stratified as high (> 100 cases/yr), medium (50-100 cases/yr), or low volume (< 50 cases/yr). The relationship between surgeon and hospital volume on length of stay (LOS), in-hospital, and 30-day mortality were examined, adjusting for age, gender, ethnicity, payor, and MedisGroups Admission Severity Group (ASG) score. RESULTS There were 26-50 low (n = 2,158), 35-54 medium (n = 1,835), and 43-64 high (n = 10,723) volume hospitals in Pennsylvania. The mean volume/hospital increased between 1999 and 2003 (30-120 cases/yr) and in-hospital mortality decreased (0.8-0.2%). Thirty-day mortality (1.15%) was approximately 2 times the in-hospital mortality (0.37%). Male gender (odds ratio [OR] 3.6, P < .001), ASG (OR 2.5, P < .001), hospital and surgeon volume were associated with increased in-hospital and 30-day mortality. Controlling for other factors, patients treated by low- and medium-volume surgeons (OR 3.7, P = .002; OR 2.8, P = .015) and hospitals (OR 2.3, P = .01; OR 2.44, P = .017) had increased odds of 30-day mortality versus high-volume surgeons and hospitals. LOS was significantly shorter at high-volume hospitals as well. CONCLUSIONS In Pennsylvania, high volume is associated with decreased mortality and LOS. The results support the use of surgical volume in the COE credentialing process.
Collapse
|
45
|
Abstract
BACKGROUND The Centers for Medicare and Medicaid Services (CMS) publish a report card for nursing homes with 19 clinical quality measures (QMs). These measures include minimal risk adjustment. OBJECTIVES To develop QMs with more extensive risk adjustment and to investigate the impact on quality rankings. RESEARCH DESIGN Retrospective analysis of individual level data reported in the Minimum Data Set (MDS). Random effect logistic models were used to estimate risk adjustment models for 5 outcomes: pressure ulcers for high and low risk patients, physical restraints, and pain for long- and short-stay patients. These models were used to create 5 QMs with extended risk adjustment, enhanced QMs (EQMs). The EQMs were compared with the corresponding QMs. SUBJECTS All (17,469) nursing homes that reported MDS data in the period 2001-2005, and their 9.6 million residents. MEASURES QMs were compared with EQMs for all nursing homes in terms of agreement on outlier identification: Kappa, false positive and false negative error rates. RESULTS Kappa values ranged from 0.63 to 0.90. False positive and negative error rates ranged from 8% to 37%. Agreement between QMs and EQMs was better on high quality rather than on low quality. CONCLUSIONS More extensive risk adjustment changes quality ranking of nursing homes and should be considered as potential improvement to the current QMs. Other methodological issues related to construction of the QMs should also be investigated to determine if they are important in the context of nursing home care.
Collapse
|
46
|
Pippins JR, Fitzmaurice GM, Haas JS. Hospital characteristics and racial disparities in hospital mortality from common medical conditions. J Natl Med Assoc 2007; 99:1030-6. [PMID: 17913113 PMCID: PMC2575868] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/17/2023]
Abstract
OBJECTIVES Less is known about racial disparities in mortality from medical conditions than for procedures. We determined whether black-white disparities in risk-adjusted hospital mortality exist for five common conditions (myocardial infarction, congestive heart failure, cerebral vascular accident, gastrointestinal hemorrhage and pneumonia), and to determine the role of hospital characteristics. METHODS We used the 2003 Nationwide Inpatient Sample. Where a mortality disadvantage for black patients was demonstrated, additional analyses assessed whether the degree of disparity varied by hospital characteristics. RESULTS Mortality for black patients was equivalent to or lower than that for white patients for four of the five conditions. Black patients were more likely than white patients to die from gastrointestinal hemorrhage (1.5% vs. 1.1%, p<0.001). In multivariate analysis, hospital racial composition was the only characteristic associated with degree of disparity for gastrointestinal hemorrhage, with hospitals discharging fewer black patients demonstrating greater disparity. CONCLUSIONS In a large, multistate sample, there was no evidence of disparities in mortality for four of five common conditions. Black-white racial disparities in mortality from gastrointestinal hemorrhage, however, may be associated with hospital racial composition.
Collapse
Affiliation(s)
- Jennifer R Pippins
- Division of General Medicine and Primary Care, Department of Medicine, Brigham and Women's Hospital and Harvard Medical School, Boston, MA, USA
| | | | | |
Collapse
|
47
|
Abstract
BACKGROUND Clinically plausible risk-adjustment methods are needed to implement pay-for-performance protocols. Because billing data lacks clinical precision, may be gamed, and chart abstraction is costly, we sought to develop predictive models for mortality that maximally used automated laboratory data and intentionally minimized the use of administrative data (Laboratory Models). We also evaluated the additional value of vital signs and altered mental status (Full Models). METHODS Six models predicting in-hospital mortality for ischemic and hemorrhagic stroke, pneumonia, myocardial infarction, heart failure, and septicemia were derived from 194,903 admissions in 2000-2003 across 71 hospitals that imported laboratory data. Demographics, admission-based labs, International Classification of Diseases (ICD)-9 variables, vital signs, and altered mental status were sequentially entered as covariates. Models were validated using abstractions (629,490 admissions) from 195 hospitals. Finally, we constructed hierarchical models to compare hospital performance using the Laboratory Models and the Full Models. RESULTS Model c-statistics ranged from 0.81 to 0.89. As constructed, laboratory findings contributed more to the prediction of death compared with any other risk factor characteristic groups across most models except for stroke, where altered mental status was more important. Laboratory variables were between 2 and 67 times more important in predicting mortality than ICD-9 variables. The hospital-level risk-standardized mortality rates derived from the Laboratory Models were highly correlated with the results derived from the Full Models (average rho = 0.92). CONCLUSIONS Mortality can be well predicted using models that maximize reliance on objective pathophysiologic variables whereas minimizing input from billing data. Such models should be less susceptible to the vagaries of billing information and inexpensive to implement.
Collapse
Affiliation(s)
- Ying P Tabak
- Department of Clinical Research, Cardinal Health's MediQual Business, Marlborough, MA 01752, USA.
| | | | | |
Collapse
|
48
|
Abstract
OBJECTIVE To identify relationships between variations in team structure and risk-adjusted adverse events across 86 teams in a large US home health care organization. METHODS Patient episode data were collected for two 6-month periods, January-June 2002 (N = 54,732 episodes) and January-June 2003 (N = 51,560 episodes). An adverse event was defined as having 1 or more events defined by the Centers for Medicare and Medicaid Services for home health care episodes. Events were risk adjusted using 2 alternative approaches-a Z-score and a Fixed Effects (FE)-score, for each team in each period. These scores (1 for each team in each period) were then regressed against objective measures of team structure. RESULTS The regressions based on the FE-score as the measure of quality performed better than the traditional Z-score. Based on these regressions we find that volume (number of episodes) (P = 0.03), number of weekend visits (P = 0.02), and workload distribution (P = 0.02) were negatively associated with the occurrence of adverse events, whereas higher weekend admissions (P = 0.01) were positively associated with adverse events. CONCLUSIONS Our analysis identifies a number of key team-level organizational variables that influence adverse events in home health care services. We also have demonstrated that the FE-score is a more accurate measure of team quality, as opposed to the Z-score, given that it focuses only on "team attributable" adverse events by isolating and excluding random variation from the quality score.
Collapse
Affiliation(s)
- Penny Hollander Feldman
- Center for Home Care Policy and Research, Visiting Nurse Service of New York, New York, New York 10021, USA.
| | | | | |
Collapse
|
49
|
D'Errigo P, Tosti ME, Fusco D, Perucci CA, Seccareccia F. Use of hierarchical models to evaluate performance of cardiac surgery centres in the Italian CABG outcome study. BMC Med Res Methodol 2007; 7:29. [PMID: 17608921 PMCID: PMC1933547 DOI: 10.1186/1471-2288-7-29] [Citation(s) in RCA: 24] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2007] [Accepted: 07/03/2007] [Indexed: 11/20/2022] Open
Abstract
Background Hierarchical modelling represents a statistical method used to analyze nested data, as those concerning patients afferent to different hospitals. Aim of this paper is to build a hierarchical regression model using data from the "Italian CABG outcome study" in order to evaluate the amount of differences in adjusted mortality rates attributable to differences between centres. Methods The study population consists of all adult patients undergoing an isolated CABG between 2002–2004 in the 64 participating cardiac surgery centres. A risk adjustment model was developed using a classical single-level regression. In the multilevel approach, the variable "clinical-centre" was employed as a group-level identifier. The intraclass correlation coefficient was used to estimate the proportion of variability in mortality between groups. Group-level residuals were adopted to evaluate the effect of clinical centre on mortality and to compare hospitals performance. Spearman correlation coefficient of ranks (ρ) was used to compare results from classical and hierarchical model. Results The study population was made of 34,310 subjects (mortality rate = 2.61%; range 0.33–7.63). The multilevel model estimated that 10.1% of total variability in mortality was explained by differences between centres. The analysis of group-level residuals highlighted 3 centres (VS 8 in the classical methodology) with estimated mortality rates lower than the mean and 11 centres (VS 7) with rates significantly higher. Results from the two methodologies were comparable (ρ = 0.99). Conclusion Despite known individual risk-factors were accounted for in the single-level model, the high variability explained by the variable "clinical-centre" states its importance in predicting 30-day mortality after CABG.
Collapse
Affiliation(s)
- Paola D'Errigo
- National Center for Epidemiology, Surveillance and Health Promotion, Istituto Superiore di Sanità, Rome, Italy
| | - Maria E Tosti
- National Center for Epidemiology, Surveillance and Health Promotion, Istituto Superiore di Sanità, Rome, Italy
| | - Danilo Fusco
- Department of Epidemiology, ASL RME, Rome, Italy
| | | | - Fulvia Seccareccia
- National Center for Epidemiology, Surveillance and Health Promotion, Istituto Superiore di Sanità, Rome, Italy
| | | |
Collapse
|
50
|
Odetola FO, Gebremariam A, Freed GL. Patient and hospital correlates of clinical outcomes and resource utilization in severe pediatric sepsis. Pediatrics 2007; 119:487-94. [PMID: 17332201 DOI: 10.1542/peds.2006-2353] [Citation(s) in RCA: 169] [Impact Index Per Article: 9.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
OBJECTIVE Our goal was to describe patient and hospital characteristics associated with in-hospital mortality, length of stay, and charges for critically ill children with severe sepsis. METHODS Our study consisted of a retrospective study of children 0 to 19 years of age hospitalized with severe sepsis using the 2003 Kids' Inpatient Database. We generated national estimates of rates of hospitalization and then compared in-hospital mortality, length of stay, and total charges according to patient and hospital characteristics using multivariable regression methods. Severity of illness was measured by using all-patient refined diagnosis-related group severity of illness classification into minor, moderate, major, and extreme severity. RESULTS There were an estimated 21,448 hospitalizations for severe pediatric sepsis nationally in 2003. The in-hospital mortality rate was 4.2%. Comorbid illness was present in 34% of hospitalized children. Most (70%) of the extremely ill children were admitted to children's hospitals. Length of stay was longer among patients with higher illness severity and nonsurvivors compared with survivors (13.5 vs 8.5 days). Hospitalizations at urban or children's hospitals were also associated with longer length of stay than nonchildren's or rural hospitals, respectively. Higher charges were associated with higher illness severity, and nonsurvivors had 2.5-fold higher total charges than survivors. Also, higher charges were observed among hospitalizations in urban or children's hospitals. In multivariable regression analysis, multiple comorbid illnesses, multiple organ dysfunction, and greater severity of illness were associated with higher odds of mortality and longer length of stay. Higher hospital charges and longer length of stay were observed among transfer hospitalizations and among hospitalizations to children's hospitals and nonchildren's teaching hospitals compared with hospitals, which had neither children's nor teaching status. CONCLUSIONS Mortality from severe pediatric sepsis is associated with patient illness severity, comorbid illness, and multiple organ dysfunction. Many characteristics are associated with resource consumption, including type of hospital, source of admission, and illness severity.
Collapse
Affiliation(s)
- Folafoluwa O Odetola
- Division of Pediatric Critical Care Medicine, University of Michigan, Ann Arbor, Michigan, USA.
| | | | | |
Collapse
|