1
|
Ouimet C, Fodor B, Del Paggio JC, Kimmelman J. Proportion of patients in phase 2 oncology trials receiving treatments that are ultimately approved. J Natl Cancer Inst 2025; 117:1056-1063. [PMID: 39994861 PMCID: PMC12058269 DOI: 10.1093/jnci/djaf013] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2024] [Revised: 10/22/2024] [Accepted: 12/04/2024] [Indexed: 02/26/2025] Open
Abstract
BACKGROUND Many patients enroll in phase 1 dose expansion cohorts or phase 2 clinical trials (together referred to below as "phase 2") seeking access to novel treatments. Little is known about the extent to which they benefit by enrolling. Herein, we use a novel metric of benefit-therapeutic proportion-to assess the probability that patients in phase 2 trials receive treatment that eventually advances to FDA (Food and Drug Administration) approval for their condition. METHODS We randomly sampled 400 trials identified in a search of Clinicaltrials.gov for cancer phase 2 trials initiated between November 1, 2012 and November 1, 2015. We determined whether the drug/dose/indication tested in each trial advanced to FDA approval within 7.5 years. We determined whether the drug/dose/indication presented substantial clinical benefit using the ESMO-MCBS (European Society for Medical Oncology - Magnitude of Clinical Benefit Scale), or whether it received off-label recommendation in NCCN (National Comprehensive Cancer Network) guidelines. RESULTS Collectively, trials in our sample enrolled 25 002 patient-participants in 608 specific treatment cohorts. A total of 4045 patients received a treatment that advanced to FDA approval (16.2%; 95% CI = 10.3 to 22.7). The therapeutic proportion increased to 19.4% (95% CI = 14.1 to 25.8) when considering NCCN off-label recommendations and decreased to 9.3% (95% CI = 4.7 to 14.6) for FDA-approved regimens considered being of substantial clinical benefit by ESMO-MCBS. Bootstrap test of mean difference showed no statistical difference in proportions based on drug class, trial phase, or sponsorship. CONCLUSION One in 6 patients in phase 2 clinical trials receives treatments that are eventually approved. This represents a higher therapeutic value than phase 1 trials.
Collapse
Affiliation(s)
- Charlotte Ouimet
- Department of Equity, Ethics and Policy, McGill University School of Population and Global Health, Montreal, QC H3A 1G1, Canada
| | - Bianca Fodor
- Department of Equity, Ethics and Policy, McGill University School of Population and Global Health, Montreal, QC H3A 1G1, Canada
| | - Joseph C Del Paggio
- Department of Oncology, Thunder Bay Regional Health Sciences Centre and Northern Ontario School of Medicine University, Thunder Bay, ON P7B 6V4, Canada
| | - Jonathan Kimmelman
- Department of Equity, Ethics and Policy, McGill University School of Population and Global Health, Montreal, QC H3A 1G1, Canada
| |
Collapse
|
2
|
Memon R, Asif M, Shah BA, Kiran T, Khoso AB, Tofique S, Miah J, Ahmad A, Chaudhry I, Chaudhry N, Husain N, Edwards SJL. Clinicians' experiences of obtaining informed consent for research and treatment: a nested qualitative study from Pakistan. BMC Med Ethics 2024; 25:131. [PMID: 39548492 PMCID: PMC11566489 DOI: 10.1186/s12910-024-01119-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2024] [Accepted: 10/14/2024] [Indexed: 11/18/2024] Open
Abstract
BACKGROUND Informed consent is considered to be the standard method for respecting the autonomy of individual participants in research and practices and is thought to be based on several conditions: (1) providing information on the purpose of the research or a specific treatment, what it will entail, (2) the participants being mentally competent to understand the information and weigh it in the balance, and (3) the participants to be free from coercion. While there are studies of informed consent in other countries, especially Low and Middle Income Countries (LMICs), this study explored the experiences of clinicians regarding the process of obtaining informed consent to participate in a Randomised Controlled Trial (RCT) in particular and treatment in general in healthcare settings, both general and mental health, specifically focusing on the tension between individualistic concept of autonomy and collectivist values in cultures such as Pakistan. METHODS Qualitative interviews with 20 clinicians from healthcare settings in Pakistan who also served as recruiters in a suicide prevention RCT in Pakistan. The interviews were guided by semi-structured topic guide. All interviews were audio-recorded and transcribed verbatim. RESULTS The interviews revealed that shared decision making was more morally important than individual autonomy, the role of the family played a dominant part in the consent-taking procedure, the decision of the elder and/or family patriarch took prominence, and that clinician-researchers encountered significant challenges in consent process in Pakistan, while recruiting patients into the trial as well as during routine treatment processes in healthcare settings. Four distinct themes emerged which were (1) Family deciding for patients, (2) Benefits of involving family in consent process, (3) Gender disparity in consent process, (4) Challenges experienced by clinician-researchers during consent process in Pakistan. CONCLUSIONS The concept of consent is generally considered important in many cultures, however, there are two strands of understanding. There seems to be consensus that participant agreement is necessary to protect the participant but with regards to autonomy there are significant cultural differences whether it is the right for autonomy of the individual (individualistic concept) or family, community, or expert authority in other cultures. In Pakistan clinician-researchers sometimes preferred one approach and sometimes the other as they appreciated the interests of the patient to be.
Collapse
Affiliation(s)
| | - Muqaddas Asif
- Pakistan Institute of Living and Learning, Karachi, Pakistan
- University of Manchester, Manchester, UK
| | - Bushra Ali Shah
- Pakistan Institute of Living and Learning, Karachi, Pakistan
| | - Tayyeba Kiran
- Pakistan Institute of Living and Learning, Karachi, Pakistan
| | - Ameer B Khoso
- Pakistan Institute of Living and Learning, Karachi, Pakistan
| | - Sehrish Tofique
- Pakistan Institute of Living and Learning, Karachi, Pakistan
| | | | | | - Imran Chaudhry
- University of Manchester, Manchester, UK
- Ziauddin University Hospital, Karachi, Pakistan
| | - Nasim Chaudhry
- Pakistan Institute of Living and Learning, Karachi, Pakistan
| | - Nusrat Husain
- University of Manchester, Manchester, UK
- Mersey Care NHS Foundation Trust, Liverpool, UK
| | | |
Collapse
|
3
|
Dandurand C, Dvorak MF, Hazenbiller O, Bransford RJ, Schnake KJ, Vaccaro AR, Benneker LM, Vialle E, Schroeder GD, Rajasekaran S, El-Skarkawi M, Kanna RM, Aly MM, Holas M, Canseco JA, Muijs S, Popescu EC, Tee JW, Camino-Willhuber G, Joaquim AF, Keynan O, Chhabra HS, Bigdon S, Spiegel U, Öner CF. Using Equipoise to Determine the Radiographic Characteristics Leading to Agreement on Best Treatment for Thoracolumbar Burst Fractures Without Neurologic Deficits. Global Spine J 2024; 14:25S-31S. [PMID: 38324599 PMCID: PMC10867529 DOI: 10.1177/21925682231215770] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/09/2024] Open
Abstract
STUDY DESIGN Retrospective analysis of prospectively collected data. OBJECTIVES Our goal was to assess radiographic characteristics associated with agreement and disagreement in treatment recommendation in thoracolumbar (TL) burst fractures. METHODS A panel of 22 AO Spine Knowledge Forum Trauma experts reviewed 183 cases and were asked to: (1) classify the fracture; (2) assess degree of certainty of PLC disruption; (3) assess degree of comminution; and (4) make a treatment recommendation. Equipoise threshold used was 77% (77:23 distribution of uncertainty or 17 vs 5 experts). Two groups were created: consensus vs equipoise. RESULTS Of the 183 cases reviewed, the experts reached full consensus in only 8 cases (4.4%). Eighty-one cases (44.3%) were included in the agreement group and 102 cases (55.7%) in the equipoise group. A3/A4 fractures were more common in the equipoise group (92.0% vs 83.7%, P < .001). The agreement group had higher degree of certainty of PLC disruption [35.8% (SD 34.2) vs 27.6 (SD 27.3), P < .001] and more common use of the M1 modifier (44.3% vs 38.3%, P < .001). Overall, the degree of comminution was slightly higher in the equipoise group [47.8 (SD 20.5) vs 45.7 (SD 23.4), P < .001]. CONCLUSIONS The agreement group had a higher degree of certainty of PLC injury and more common use of M1 modifier (more type B fractures). The equipoise group had more A3/A4 type fractures. Future studies are required to identify the role of comminution in decision making as degree of comminution was slightly higher in the equipoise group.
Collapse
Affiliation(s)
- Charlotte Dandurand
- Combined Neurosurgical and Orthopedic Spine Program, Vancouver General Hospital, University of British Columbia, Vancouver, BC, Canada
| | - Marcel F Dvorak
- Combined Neurosurgical and Orthopedic Spine Program, Vancouver General Hospital, University of British Columbia, Vancouver, BC, Canada
| | | | - Richard J Bransford
- Department of Orthopaedics and Sports Medicine, Harborview Medical Center, University of Washington, Seattle, WA, USA
| | - Klaus J Schnake
- Center for Spinal and Scoliosis Surgery, Malteser Waldkrankenhaus St. Marien, Erlangen, Germany
- Department of Orthopedics and Traumatology, Paracelsus Private Medical University Nuremberg, Nuremberg, Germany
| | - Alexander R Vaccaro
- Department of Orthopaedic Surgery, Rothman Institute, Thomas Jefferson University Hospital, Philadelphia, PA, USA
| | - Lorin M Benneker
- Spine Unit, Sonnenhof Spital, University of Bern, Bern, Switzerland
| | - Emiliano Vialle
- Cajuru Hospital, Catholic University of Paraná, Curitiba, Brazil
| | - Gregory D Schroeder
- Department of Orthopaedic Surgery, Rothman Institute, Thomas Jefferson University Hospital, Philadelphia, PA, USA
| | | | - Mohammad El-Skarkawi
- Department of Orthopaedic and Trauma Surgery, Faculty of Medicine, Assiut University, Egypt
| | - Rishi M Kanna
- Spine Department of Orthopaedics and Spine Surgery, Ganga Hospital, Coimbatore, India
| | - Mohamed M Aly
- Department of Neurosurgery, Prince Mohammed Bin Abdulaziz Hospital, Riyadh, Saudi Arabia
- Department of Neurosurgery, Mansoura University, Mansoura, Egypt
| | - Martin Holas
- Klinika Úrazovej Chirurgie SZU, FNsP F.D.Roosevelta, Banská Bystrica, Slovakia
| | - Jose A Canseco
- Department of Orthopaedic Surgery, Rothman Institute, Thomas Jefferson University Hospital, Philadelphia, PA, USA
| | - Sander Muijs
- University Medical Centers, Utrecht, the Netherlands
| | | | - Jin Wee Tee
- Department of Neurosurgery, The Alfred Hospital, National Trauma Research Institute (NTRI), Melbourne, VIC, Australia
| | - Gaston Camino-Willhuber
- Orthopaedic and Traumatology Department, Institute of Orthopedics "Carlos E. Ottolenghi" Hospital Italiano de Buenos Aires, Buenes Aires, Argentina
| | - Andrei Fernandes Joaquim
- Neurosurgery Division, Department of Neurology, State University of Campinas, Campinas-Sao Paulo, Brazil
| | - Ory Keynan
- Rambam Health Care Campus, Haifa, Israel
| | | | - Sebastian Bigdon
- Department of Orthopaedic Surgery and Traumatology, Inselspital, University Hospital, University of Bern, Bern, Switzerland
| | - Ulrich Spiegel
- Department of Orthopaedics, Trauma Surgery and Plastic Surgery, University of Leipzig, Leipzig, Germany
| | - Cumhur F Öner
- University Medical Centers, Utrecht, the Netherlands
| |
Collapse
|
4
|
Rigat F. A conservative approach to leveraging external evidence for effective clinical trial design. Pharm Stat 2024; 23:81-90. [PMID: 37751940 DOI: 10.1002/pst.2339] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2022] [Revised: 07/03/2023] [Accepted: 09/03/2023] [Indexed: 09/28/2023]
Abstract
Prior probabilities of clinical hypotheses are not systematically used for clinical trial design yet, due to a concern that poor priors may lead to poor decisions. To address this concern, a conservative approach to Bayesian trial design is illustrated here, requiring that the operational characteristics of the primary trial outcome are stronger than the prior. This approach is complementary to current Bayesian design methods, in that it insures against prior-data conflict by defining a sample size commensurate to a discrete design prior. This approach is ethical, in that it requires designs appropriate to achieving pre-specified levels of clinical equipoise imbalance. Practical examples are discussed, illustrating design of trials with binary or time to event endpoints. Moderate increases in phase II study sample size are shown to deliver strong levels of overall evidence for go/no-go clinical development decisions. Levels of negative evidence provided by group sequential confirmatory designs are found negligible, highlighting the importance of complementing efficacy boundaries with non-binding futility criteria.
Collapse
Affiliation(s)
- Fabio Rigat
- Oncology Biometrics, AstraZeneca Plc, Cambridge, UK
| |
Collapse
|
5
|
Memon R, Asif M, Pitman A, Chaudhry N, Husain N, Edwards SJL. Is equipoise a useful concept to justify randomised controlled trials in the cultural context of Pakistan? A survey of clinicians in relation to a trial of talking therapy for young people who self-harm. Trials 2023; 24:506. [PMID: 37553645 PMCID: PMC10408059 DOI: 10.1186/s13063-023-07397-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2022] [Accepted: 05/19/2023] [Indexed: 08/10/2023] Open
Abstract
BACKGROUND Clinical equipoise, also defined as the uncertainty principle, is considered essential when recruiting subjects to a clinical trial. However, equipoise is threatened when clinicians are influenced by their own preferences. Little research has investigated equipoise in the context of trial recruitment. METHODS This cross-sectional survey sought clinicians' views (operationalised as 11 statements relating to treatments offered in a trial of a psychological intervention for young people) about equipoise and individual treatment preferences in the context of moral justification for recruiting young people at risk of self-harm or suicide to a randomised controlled trial (RCT) to evaluate the Youth Culturally Adapted Manual Assisted Psychological Intervention (Y-CMAP) in Pakistan. We compared the views of clinicians involved in Y-CMAP RCT recruitment to those of a sample of clinicians not involved in trial recruitment but treating similar patients, comparing their sociodemographic characteristics and the proportions of those in each group agreeing with each statement. RESULTS There was a response rate of 96% (75/78). Findings showed that, during trial recruitment and before the RCT results were known, the majority of all responding clinicians (73.3%) considered Y-CMAP to be an effective treatment for young people at risk of self-harm or suicide. Although there was an acknowledgement of individual preferences for the intervention, there was near consensus (90%) on the need to conduct an RCT for reaching an evidence-based decision. However, there were no significant differences in the proportion of recruiting clinicians reporting a treatment preference for Y-CMAP than non-recruiting clinicians (31 (88.6%) versus 36 (90%), p = 0.566). A significantly higher proportion of non-recruiting clinicians (87.5%) as compared to (48.5%) in the trial (p = 0.000) stated that there may be other treatments that may be equally good for the patients, seemingly undermining a preference for the intervention. Those reporting a treatment preference also acknowledged that there was nothing on which this preference was based, however confident they felt about them, thus accepting clinical equipoise as ethical justification for conducting the RCT. There was a significant group difference in views that treatment overall is better as a result of young patients' participation in the Y-CMAP trial (p = 0.015) (i.e. more clinicians not involved in the trial agreed with this statement). Similarly, more clinicians not involved in the trial agreed on the perceived availability of other treatment options that were good for young people at risk of self-harm (p < 0.05). CONCLUSIONS The paper highlights that clinicians in Pakistan accept the notion of clinical equipoise as an ethical justification for patient participation in RCTs. The need for conducting RCTs to generate evidence base and to reduce bias was considered important by the clinical community.
Collapse
Affiliation(s)
| | - Muqaddas Asif
- Pakistan Institute of Living and Learning (PILL), Karachi, Pakistan
| | - Alexandra Pitman
- University College London (UCL), London, UK
- Camden and Islington NHS Foundation Trust, London, UK
| | - Nasim Chaudhry
- Pakistan Institute of Living and Learning (PILL), Karachi, Pakistan
| | | | | |
Collapse
|
6
|
Matsumoto H, Fano AN, Quan T, Akbarnia BA, Blakemore LC, Flynn JM, Skaggs DL, Smith JT, Snyder BD, Sponseller PD, McCarthy RE, Sturm PF, Roye DP, Emans JB, Vitale MG. Re-evaluating consensus and uncertainty among treatment options for early onset scoliosis: a 10-year update. Spine Deform 2023; 11:11-25. [PMID: 35947359 DOI: 10.1007/s43390-022-00561-1] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/11/2022] [Accepted: 07/23/2022] [Indexed: 11/26/2022]
Abstract
PURPOSE Consensus and uncertainty in early onset scoliosis (EOS) treatment were evaluated in 2010. It is currently unknown how treatment preferences have evolved over the past decade. The purpose of this study was to re-evaluate consensus and uncertainty among treatment options for EOS patients to understand how they compare to 10 years ago. METHODS 11 pediatric spinal surgeons (similar participants as in 2010) were invited to complete a survey of 315 idiopathic and neuromuscular EOS cases (same cases as in 2010). Treatment options included the following: conservative management, distraction-based methods, growth guidance/modulation, and arthrodesis. Consensus was defined as ≥ 70% agreement, and uncertainty was < 70%. Associations between case characteristics and consensus for treatments were assessed via chi-squared and multiple regression analyses. Case characteristics associated with uncertainty were described. RESULTS Eleven surgeons [31.7 ± 7.8 years of experience] in the original 2010 cohort completed the survey. Consensus for conservative management was found in idiopathic patients aged ≤ 3, whereas in 2010, some of these cases were selected for surgery. There is currently consensus for casting idiopathic patients aged 1 or 2 with moderate curves, whereas in 2010, there was uncertainty between casting and bracing. Among neuromuscular cases with consensus for surgery, arthrodesis was chosen for patients aged 9 with larger curves. CONCLUSION Presently, preferences for conservative management have increased in comparison to 2010, and casting appears to be preferred over bracing in select infantile cases. Future research efforts with higher levels-of-evidence should be devoted to elucidate the areas of uncertainty to improve care in the EOS population. LEVEL OF EVIDENCE Level V.
Collapse
Affiliation(s)
- Hiroko Matsumoto
- Department of Orthopedic Surgery, Boston Children's Hospital, Boston, MA, 02115, USA.
- Department of Orthopaedic Surgery, Harvard Medical School, Boston, MA, 02115, USA.
| | - Adam N Fano
- Department of Orthopedic Surgery, Morgan Stanley Children's Hospital of New York Presbyterian, Columbia University Irving Medical Center, 3959 Broadway, CHONY 8-N, New York, NY, 10032, USA
| | - Theodore Quan
- Department of Orthopedic Surgery, Morgan Stanley Children's Hospital of New York Presbyterian, Columbia University Irving Medical Center, 3959 Broadway, CHONY 8-N, New York, NY, 10032, USA
| | - Behrooz A Akbarnia
- Department of Orthopaedic Surgery, University of California San Diego, San Diego, CA, 92037, USA
| | | | - John M Flynn
- Division of Orthopaedics, Children's Hospital of Philadelphia, Philadelphia, PA, 19104, USA
| | - David L Skaggs
- Department of Orthopaedics, Cedars-Sinai Medical Center, Los Angeles, CA, 90048, USA
| | - John T Smith
- Department of Orthopaedics, University of Utah, Salt Lake City, UT, 84113, USA
| | - Brian D Snyder
- Department of Orthopedic Surgery, Boston Children's Hospital, Boston, MA, 02115, USA
- Department of Orthopaedic Surgery, Harvard Medical School, Boston, MA, 02115, USA
| | - Paul D Sponseller
- Division of Pediatric Orthopaedics, Johns Hopkins University, Baltimore, MD, 21287, USA
| | - Richard E McCarthy
- Department of Orthopaedics, University of Arkansas for Medical Sciences and Arkansas Children's Hospital, Little Rock, AR, 72205, USA
| | - Peter F Sturm
- Department of Orthopedic Surgery, Cincinnati Children's Hospital, Cincinnati, OH, 45229, USA
| | - David P Roye
- Department of Orthopedic Surgery, Boston Children's Hospital, Boston, MA, 02115, USA
- Division of Pediatric Orthopaedic Surgery, New York-Presbyterian Morgan Stanley Children's Hospital, Columbia University Irving Medical Center, New York, NY, 10032, USA
| | - John B Emans
- Department of Orthopedic Surgery, Boston Children's Hospital, Boston, MA, 02115, USA
- Department of Orthopaedic Surgery, Harvard Medical School, Boston, MA, 02115, USA
| | - Michael G Vitale
- Department of Orthopedic Surgery, Boston Children's Hospital, Boston, MA, 02115, USA
- Division of Pediatric Orthopaedic Surgery, New York-Presbyterian Morgan Stanley Children's Hospital, Columbia University Irving Medical Center, New York, NY, 10032, USA
| |
Collapse
|
7
|
Jensen EA, Greenspan JS, Aghai ZH, Carola DL, Eichenwald EC, DeMauro SB, Dysart K. Is it time to study routine car seat tolerance screening in a randomized controlled trial? An international survey of current practice and clinician equipoise. J Perinatol 2022; 42:507-509. [PMID: 34453111 PMCID: PMC8882206 DOI: 10.1038/s41372-021-01167-7] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/24/2021] [Revised: 05/28/2021] [Accepted: 07/13/2021] [Indexed: 11/09/2022]
Affiliation(s)
- Erik A Jensen
- Department of Pediatrics, Division of Neonatology, The Children's Hospital of Philadelphia and The University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA.
| | - Jay S Greenspan
- Division of Neonatology, Nemours/Sidney Kimmel Medical College at Thomas Jefferson University, Philadelphia, PA, USA
| | - Zubair H Aghai
- Division of Neonatology, Nemours/Sidney Kimmel Medical College at Thomas Jefferson University, Philadelphia, PA, USA
| | - David L Carola
- Division of Neonatology, Nemours/Sidney Kimmel Medical College at Thomas Jefferson University, Philadelphia, PA, USA
| | - Eric C Eichenwald
- Department of Pediatrics, Division of Neonatology, The Children's Hospital of Philadelphia and The University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA
| | - Sara B DeMauro
- Department of Pediatrics, Division of Neonatology, The Children's Hospital of Philadelphia and The University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA
| | - Kevin Dysart
- Department of Pediatrics, Division of Neonatology, The Children's Hospital of Philadelphia and The University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA
| |
Collapse
|
8
|
Nostedt S, Joffe AR. Critical Care Randomized Trials Demonstrate Power Failure: A Low Positive Predictive Value of Findings in the Critical Care Research Field. J Intensive Care Med 2022; 37:1082-1093. [PMID: 35179408 DOI: 10.1177/08850666221077203] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
BACKGROUND We aimed to determine the post-hoc power of randomized controlled trials (RCTs) in critical care, and describe the implications for long-term positive (PPV) and negative predictive value (NPV) of statistically significant and non-significant findings respectively in the research field. METHODS We reviewed three cohorts of RCTs. "Adult-RCTs" were 216 multicenter RCTs with a mortality outcome from a published systematic review. "Pediatric-RCTs" were 120 RCTs with a mortality outcome, obtained by search of picutrials.net. "Consecutive-RCTs" were 90 recent RCTs obtained by screening publications in 6 journals. Post-hoc power for each study was calculated at α 0.05 and 0.005, for measures of small, medium, and large effect-size, using G*Power software. Long-run expected PPV and NPV of critical care research field findings were then calculated. RESULTS With α 0.05, post-hoc power for small effect-size was very low in all RCT-cohorts (eg, median 24% in Adult-RCTs). For medium effect-size, post-hoc power was low, except for Adult-RCTs (eg, median 9% in Pediatric-RCTs). For large effect-size, post-hoc power for non-human-animal Consecutive-RCTs was low (median 32%). With α 0.005, post-hoc power was even lower. The corollary was that both PPV and NPV were poor for small effect-size, unless α 0.005 was used. Even with α 0.005, with realistic (vs. optimistic) prior probability of the alternative hypothesis, the PPV was low (eg, in Adult-RCTs 57.1% vs. 92.3%). Adding mild bias (0.1) reduced the PPV even further. For medium effect-size both PPV and NPV were better; nevertheless, with α 0.05 and realistic prior probability of the alternative hypothesis the PPV was poor, and with α 0.005 and mild bias (0.1) the PPV was very low (eg, Adult-RCTs median 44.1%). CONCLUSIONS To improve the predictive value of findings in the critical care research field, RCTs should be designed to have 80% power for realistic effect-size at α 0.005.
Collapse
Affiliation(s)
- Sarah Nostedt
- Department of Pediatrics, Division of Critical Care Medicine, University of Alberta, Edmonton, Alberta, Canada.,Stollery Children's Hospital, Edmonton, Alberta, Canada
| | - Ari R Joffe
- Department of Pediatrics, Division of Critical Care Medicine, University of Alberta, Edmonton, Alberta, Canada.,Stollery Children's Hospital, Edmonton, Alberta, Canada
| |
Collapse
|
9
|
Nostedt S, Joffe AR. Reverse Bayesian Implications of p-Values Reported in Critical Care Randomized Trials. J Intensive Care Med 2021; 37:954-964. [PMID: 34841950 PMCID: PMC9149268 DOI: 10.1177/08850666211053793] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
Abstract
Background Misinterpretations of the p-value in null-hypothesis statistical testing are
common. We aimed to determine the implications of observed p-values in
critical care randomized controlled trials (RCTs). Methods We included three cohorts of published RCTs: Adult-RCTs reporting a mortality
outcome, Pediatric-RCTs reporting a mortality outcome, and recent
Consecutive-RCTs reporting p-value ≤.10 in six higher-impact journals. We
recorded descriptive information from RCTs. Reverse Bayesian implications of
obtained p-values were calculated, reported as percentages with
inter-quartile ranges. Results Obtained p-value was ≤.005 in 11/216 (5.1%) Adult-RCTs, 2/120 (1.7%)
Pediatric-RCTs, and 37/90 (41.1%) Consecutive-RCTs. An obtained p-value
.05–.0051 had high False Positive Rates; in Adult-RCTs, minimum (assuming
prior probability of the alternative hypothesis was 50%) and realistic
(assuming prior probability of the alternative hypothesis was 10%) False
Positive Rates were 16.7% [11.2, 21.8] and 64.3% [53.2, 71.4]. An obtained
p-value ≤.005 had lower False Positive Rates; in Adult-RCTs the realistic
False Positive Rate was 7.7% [7.7, 16.0]. The realistic probability of the
alternative hypothesis for obtained p-value .05–.0051 (ie, Positive
Predictive Value) was 28.0% [24.1, 34.8], 30.6% [27.7, 48.5], 29.3% [24.3,
41.0], and 32.7% [24.1, 43.5] for Adult-RCTs, Pediatric-RCTs,
Consecutive-RCTs primary and secondary outcome, respectively. The maximum
Positive Predictive Value for p-value category .05–.0051 was median 77.8%,
79.8%, 78.8%, and 81.4% respectively. To have maximum or realistic Positive
Predictive Value >90% or >80%, RCTs needed to have obtained p-value
≤.005. The credibility of p-value .05–.0051 findings were easy to challenge,
and the credibility to rule-out an effect with p-value >.05 to .10 was
low. The probability that a replication study would obtain p-value ≤.05 did
not approach 90% unless the obtained p-value was ≤.005. Conclusions Unless the obtained p-value was ≤.005, the False Positive Rate was high, and
the Positive Predictive Value and probability of replication of
“statistically significant” findings were low.
Collapse
Affiliation(s)
- Sarah Nostedt
- University of Alberta, Edmonton, Alberta, Canada.,Stollery Children's Hospital, Edmonton, Alberta, Canada
| | - Ari R Joffe
- University of Alberta, Edmonton, Alberta, Canada.,Stollery Children's Hospital, Edmonton, Alberta, Canada
| |
Collapse
|
10
|
Devaney B, Pilcher D, Mitra B, Watterson J. Does equipoise exist amongst experts regarding the role of hyperbaric oxygen treatment for necrotising soft tissue infection? ANZ J Surg 2021; 91:485-487. [PMID: 33847053 DOI: 10.1111/ans.16337] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2020] [Revised: 09/06/2020] [Accepted: 09/07/2020] [Indexed: 11/30/2022]
Affiliation(s)
- Bridget Devaney
- Department of Intensive Care and Hyperbaric Medicine, Alfred Hospital, Melbourne, Victoria, Australia.,Emergency and Trauma Centre, Alfred Hospital, Melbourne, Victoria, Australia.,School of Public Health and Preventive Medicine, Monash University, Melbourne, Victoria, Australia
| | - David Pilcher
- Department of Intensive Care and Hyperbaric Medicine, Alfred Hospital, Melbourne, Victoria, Australia.,School of Public Health and Preventive Medicine, Monash University, Melbourne, Victoria, Australia
| | - Biswadev Mitra
- Emergency and Trauma Centre, Alfred Hospital, Melbourne, Victoria, Australia.,School of Public Health and Preventive Medicine, Monash University, Melbourne, Victoria, Australia.,National Trauma Research Institute, Alfred Hospital, Melbourne, Victoria, Australia
| | - Jason Watterson
- Department of Intensive Care and Hyperbaric Medicine, Alfred Hospital, Melbourne, Victoria, Australia.,School of Public Health and Preventive Medicine, Monash University, Melbourne, Victoria, Australia
| |
Collapse
|
11
|
Zahid A, Byrne C, Solomon MJ, Young CJ. Assessing Surgeons' Preferences in the Management of Fistula In Ano. Int Surg 2021; 105:483-488. [DOI: 10.9738/intsurg-d-16-00185.1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/20/2025] Open
Abstract
Background
Fistula in ano is a common condition treated by surgeons worldwide. Despite this, there is a paucity of high-quality data to aid decision-making. Hence, management presents a difficult and frustrating dilemma for the treating surgeon.
Methods
A prospective regional survey was sent to all members of General Surgeons Australia. Questions regarding surgeon demographics, patient evaluation, perianal abscess, and simple and complex fistula in ano were presented.
Results
Equipoise exists in the management of fistula in ano among general surgeons. This was noted in the management of simple and complex fistula in ano.
Conclusion
Because of the uncertainty in certain clinical scenarios and a paucity of high-quality randomized controlled trials on the management of fistula in ano, evidence-based practice is a challenge to the treating surgeon.
Collapse
Affiliation(s)
- Assad Zahid
- Department of Colorectal Surgery, Royal Prince Alfred Hospital, Royal Prince Alfred Hospital, University of Sydney, Sydney, Australia
- Discipline of Surgery, Royal Prince Alfred Hospital, University of Sydney, Sydney, Australia
| | - Chris Byrne
- Department of Colorectal Surgery, Royal Prince Alfred Hospital, Royal Prince Alfred Hospital, University of Sydney, Sydney, Australia
- Surgical Outcome Research Centre (SOuRCe), Royal Prince Alfred Hospital, University of Sydney, Sydney, Australia
| | - Michael J Solomon
- Department of Colorectal Surgery, Royal Prince Alfred Hospital, Royal Prince Alfred Hospital, University of Sydney, Sydney, Australia
- Discipline of Surgery, Royal Prince Alfred Hospital, University of Sydney, Sydney, Australia
- Surgical Outcome Research Centre (SOuRCe), Royal Prince Alfred Hospital, University of Sydney, Sydney, Australia
| | - Christopher J. Young
- Department of Colorectal Surgery, Royal Prince Alfred Hospital, Royal Prince Alfred Hospital, University of Sydney, Sydney, Australia
- Discipline of Surgery, Royal Prince Alfred Hospital, University of Sydney, Sydney, Australia
| |
Collapse
|
12
|
Rentea RM, Oyetunji TA, Peter SDS. Ethics of randomized trials in pediatric surgery. Pediatr Surg Int 2020; 36:865-867. [PMID: 32394059 DOI: 10.1007/s00383-020-04665-5] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 04/29/2020] [Indexed: 11/30/2022]
Abstract
To provide the best evidence-based treatment for children, and timely evaluation of innovations, the role of the pediatric surgeon's participation in randomized controlled trials (RCTs) and prospective comparative studies is required. The ethical considerations of pediatric surgical RCTs pose unique practical difficulties in the design and performance of clinical trials in children. There are several ethical issues unique to pediatric surgical RCTs: diseases with low volume, an inability to conduct Phase 1 and 2 trials, parental emotional involvement, difficulty with recruitment in surgical trials, volume, and modified study design, issues with permission vs. assent and investigator bias. This article reviews the ethical aspects unique to pediatric surgical RCTs and prospective comparative studies.Level of evidence: Level 3.
Collapse
Affiliation(s)
- Rebecca M Rentea
- Pediatric Surgery, Comprehensive Colorectal Center, Children's Mercy Hospital, 2401 Gillham Road, Kansas City, MO, 64108, USA.
| | - Tolulope A Oyetunji
- Pediatric Surgery, Comprehensive Colorectal Center, Children's Mercy Hospital, 2401 Gillham Road, Kansas City, MO, 64108, USA
| | - Shawn D St Peter
- Pediatric Surgery, Comprehensive Colorectal Center, Children's Mercy Hospital, 2401 Gillham Road, Kansas City, MO, 64108, USA
| |
Collapse
|
13
|
Kim DD, Guzauskas GF, Bennette CS, Basu A, Veenstra DL, Ramsey SD, Carlson JJ. Influence of Modeling Choices on Value of Information Analysis: An Empirical Analysis from a Real-World Experiment. PHARMACOECONOMICS 2020; 38:171-179. [PMID: 31631254 DOI: 10.1007/s40273-019-00848-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
BACKGROUND Value of information (VOI) analysis often requires modeling to characterize and propagate uncertainty. In collaboration with a cancer clinical trial group, we integrated a VOI approach to assessing trial proposals. OBJECTIVE This paper aims to explore the impact of modeling choices on VOI results and to share lessons learned from the experience. METHODS After selecting two proposals (A: phase III, breast cancer; B: phase II, pancreatic cancer) for in-depth evaluations, we categorized key modeling choices relevant to trial decision makers (characterizing uncertainty of efficacy, evidence thresholds to change clinical practice, and sample size) and modelers (cycle length, survival distribution, simulation runs, and other choices). Using a $150,000 per quality-adjusted life-year (QALY) threshold, we calculated the patient-level expected value of sample information (EVSI) for each proposal and examined whether each modeling choice led to relative change of more than 10% from the averaged base-case estimate. We separately analyzed the impact of the effective time horizon. RESULTS The base-case EVSI was $118,300 for Proposal A and $22,200 for Proposal B per patient. Characterizing uncertainty of efficacy was the most important choice in both proposals (e.g. Proposal A: $118,300 using historical data vs. $348,300 using expert survey), followed by the sample size and the choice of survival distribution. The assumed effective time horizon also had a substantial impact on the population-level EVSI. CONCLUSIONS Modeling choices can have a substantial impact on VOI. Therefore, it is important for groups working to incorporate VOI into research prioritization to adhere to best practices, be clear in their reporting and justification for modeling choices, and to work closely with the relevant decision makers, with particular attention to modeling choices.
Collapse
Affiliation(s)
- David D Kim
- Center for the Evaluation of Value and Risk in Health, Institute for Clinical Research and Health Policy Studies, Tufts Medical Center, 800 Washington St., Box 63, Boston, MA, 02111, USA.
| | | | | | - Anirban Basu
- Department of Pharmacy, University of Washington, Seattle, WA, USA
| | - David L Veenstra
- Department of Pharmacy, University of Washington, Seattle, WA, USA
| | - Scott D Ramsey
- Hutchinson Institute for Cancer Outcomes Research, Fred Hutchinson Cancer Research Center, Seattle, WA, USA
| | - Josh J Carlson
- Department of Pharmacy, University of Washington, Seattle, WA, USA
| |
Collapse
|
14
|
Fowler GE, Siddiqui J, Zahid A, Young CJ. Treatment of hemorrhoids: A survey of surgical practice in Australia and New Zealand. World J Clin Cases 2019; 7:3742-3750. [PMID: 31799299 PMCID: PMC6887603 DOI: 10.12998/wjcc.v7.i22.3742] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/14/2019] [Revised: 10/21/2019] [Accepted: 10/30/2019] [Indexed: 02/05/2023] Open
Abstract
BACKGROUND Hemorrhoidal disease is the most common anorectal disorder. Hemorrhoids can be classified as external or internal, according to their relation to the dentate line. External hemorrhoids originate below the dentate line and are managed conservatively unless the patient cannot keep the perianal region clean, or they cause significant discomfort. Internal hemorrhoids originate above the dentate line and can be managed according to the graded degree of prolapse, as described by Goligher. Generally, low-grade internal hemorrhoids are effectively treated conservatively, by non-operative measures, while high-grade internal hemorrhoids warrant procedural intervention. AIM To determine the application of clinical practice guidelines for the current management of hemorrhoids and colorectal surgeon consensus in Australia and New Zealand. METHODS An online survey was distributed to 206 colorectal surgeons in Australia and New Zealand using 17 guideline-based hypothetical clinical scenarios. RESULTS There were 82 respondents (40%) to 17 guideline-based scenarios. Nine (53%) reached consensus, of which only 1 (6%) disagreed with the guidelines. This was based on low quality evidence for the management of acutely thrombosed external hemorrhoids. There were 8 scenarios which showed community equipoise (47%) and they were equally divided for agreeing or disagreeing with the guidelines. These topics were based on low and moderate levels of evidence. They included the initial management of grade I internal hemorrhoids, grade III internal hemorrhoids when initial management had failed and the patient had recognised risks factors for septic complications; and finally, the decision-making when considering patient preferences, including a prompt return to work, or minimal post-operative pain. CONCLUSION Although there are areas of consensus in the management of hemorrhoids, there are many areas of community equipoise which would benefit from further research.
Collapse
Affiliation(s)
- George E Fowler
- Department of Colorectal Surgery, Royal Devon and Exeter NHS Foundation Trust, Exeter EX2 5DW, United Kingdom
| | - Javariah Siddiqui
- Department of Colorectal Surgery, Royal Prince Alfred Hospital, Newtown 2042, NSW, Australia
| | - Assad Zahid
- Department of Colorectal Surgery, Royal Prince Alfred Hospital, Newtown 2042, NSW, Australia
| | - Christopher John Young
- Department of Colorectal Surgery, Royal Prince Alfred Hospital, Newtown 2042, NSW, Australia
| |
Collapse
|
15
|
Haushofer J, Riis-Vestergaard MI, Shapiro J. Is there a social cost of randomization? SOCIAL CHOICE AND WELFARE 2019; 52:709-739. [PMID: 33012935 PMCID: PMC7528981 DOI: 10.1007/s00355-018-1168-7] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/03/2017] [Accepted: 12/14/2018] [Indexed: 06/11/2023]
Abstract
Randomized controlled trials, which randomly allocate benefits to a treatment group and not a control group, ascribe differences in post-treatment welfare to the benefits being allocated. However, it is possible that potential recipients' welfare is not only affected by the receipt of the program, but also by the allocation mechanism (procedural utility). In this paper, we ask whether potential recipients support or oppose random allocation of financial benefits, by allowing them to reward or punish an allocator conditional on her choice of allocation mechanism: direct allocation to one recipient vs. randomization among potential recipients. We find that when potential recipients have equal endowments, they on average reward the allocator for randomizing. When instead there is inequality in the potential recipients' endowments, the relatively poorer recipients punish allocators who randomize, while the relatively richer potential recipients neither reward nor punish the allocator for randomizing. Our results suggest that an allocator who chooses to randomize between potential recipients with unequal endowments imposes a social cost on the relatively poorer potential recipients.
Collapse
Affiliation(s)
- Johannes Haushofer
- Princeton University, Peretsman-Scully Hall, Princeton, NJ 08540, USA
- National Bureau of Economic Research, Cambridge, USA
- Busara Center for Behavioral Economics, Nairobi, Kenya
| | | | | |
Collapse
|
16
|
Hamilton AER, Young CJ. Surveys still teach vital non-technical lessons in General Surgery. ANZ J Surg 2019; 89:159-164. [PMID: 30485674 DOI: 10.1111/ans.14932] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2018] [Revised: 09/23/2018] [Accepted: 09/29/2018] [Indexed: 11/27/2022]
Abstract
In general surgery, observational studies are disregarded and often seen as non-noteworthy research. We intend to defend the use of surveys in general surgery and colorectal surgery. This review highlights the historical importance and contemporary utility of surveys internationally and in our region, thus reminding Australasian surgeons and clinicians in numerous disciplines of the usefulness of this research tool. Well-constructed surveys often successfully capture qualitative data otherwise impossible to collect through randomized controlled trial. The results of these surveys may advise national policies and medical registration agencies thus having a direct influence on individuals and their public health. Samples from contemporary survey-based research publications from international and Australasian authors are used to illustrate some of the vital non-technical lessons learned in recent times.
Collapse
Affiliation(s)
- Auerilius E R Hamilton
- Colorectal Surgery Unit, Royal Prince Alfred Hospital, Institute of Academic Surgery, Sydney, New South Wales, Australia
| | - Christopher J Young
- Colorectal Surgery Unit, Royal Prince Alfred Hospital, Institute of Academic Surgery, Sydney, New South Wales, Australia
- Discipline of Surgery, The University of Sydney, Sydney, New South Wales, Australia
| |
Collapse
|
17
|
Siddiqui J, Fowler GE, Zahid A, Brown K, Young CJ. Treatment of anal fissure: a survey of surgical practice in Australia and New Zealand. Colorectal Dis 2019; 21:226-233. [PMID: 30411476 DOI: 10.1111/codi.14466] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/14/2018] [Accepted: 10/19/2018] [Indexed: 12/19/2022]
Abstract
AIM The aim was to determine whether or not the clinical management of anal fissure in Australia and New Zealand accords with published guidelines. METHODS A comprehensive survey based on common clinical scenarios was distributed to 206 colorectal surgeons in Australia and New Zealand. RESULTS The response rate was 44% (91 surgeons). For 19 topic areas, only seven (37%) reached consensus (defined as > 70% majority opinion). Of these, six (86%) agreed with guideline recommendations. Twelve (63%) topic areas demonstrated community equipoise (defined as less than or equal to 70% majority opinion), of which five (42%) agreed with guideline recommendations and seven (58%) disagreed with guidelines. Of the seven topics that disagreed with guidelines, three were based on moderate quality evidence (first line management of acute anal fissure in a young patient, fissure healing and faecal incontinence rates following anocutaneous flap) and four were based on low quality evidence (length of sphincter division during a lateral sphincterotomy in women, management of chronic low-pressure anal fissures postpartum, fissure healing rate following anoplasty with botulinum toxin or sphincterotomy and faecal incontinence rates following repeat sphincterotomy for recurrence). Consensus and/or agreement with guidelines were more prevalent in management when medical therapy failed. CONCLUSION While areas of consensus mostly agreed with guideline recommendations, there remain many areas of community equipoise which warrant further research.
Collapse
Affiliation(s)
- J Siddiqui
- Department of Colorectal Surgery, Royal Prince Alfred Hospital, Camperdown, New South Wales, Australia
| | - G E Fowler
- Department of Colorectal Surgery, Royal Prince Alfred Hospital, Camperdown, New South Wales, Australia
- Royal Devon and Exeter NHS Foundation Trust, Exeter, UK
| | - A Zahid
- Department of Colorectal Surgery, Royal Prince Alfred Hospital, Camperdown, New South Wales, Australia
| | - K Brown
- Department of Colorectal Surgery, Royal Prince Alfred Hospital, Camperdown, New South Wales, Australia
| | - C J Young
- Department of Colorectal Surgery, Royal Prince Alfred Hospital, Camperdown, New South Wales, Australia
- Central Clinical School, University of Sydney, Sydney, New South Wales, Australia
| |
Collapse
|
18
|
Calain P. The Ebola clinical trials: a precedent for research ethics in disasters. JOURNAL OF MEDICAL ETHICS 2018; 44:3-8. [PMID: 27573153 PMCID: PMC5749307 DOI: 10.1136/medethics-2016-103474] [Citation(s) in RCA: 26] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/18/2016] [Revised: 07/15/2016] [Accepted: 08/07/2016] [Indexed: 05/07/2023]
Abstract
The West African Ebola epidemic has set in motion a collective endeavour to conduct accelerated clinical trials, testing unproven but potentially lifesaving interventions in the course of a major public health crisis. This unprecedented effort was supported by the recommendations of an ad hoc ethics panel convened in August 2014 by the WHO. By considering why and on what conditions the exceptional circumstances of the Ebola epidemic justified the use of unproven interventions, the panel's recommendations have challenged conventional thinking about therapeutic development and clinical research ethics. At the same time, unanswered ethical questions have emerged, in particular: (i) the specification of exceptional circumstances, (ii) the specification of unproven interventions, (iii) the goals of interventional research in terms of individual versus collective interests, (iv) the place of adaptive trial designs and (v) the exact meaning of compassionate use with unapproved interventions. Examination of these questions, in parallel with empirical data from research sites, will help build pragmatic foundations for disaster research ethics. Furthermore, the Ebola clinical trials signal an evolution in the current paradigms of therapeutic research, beyond the case of epidemic emergencies.
Collapse
|
19
|
Siddiqui J, Zahid A, Hong J, Young CJ. Colorectal surgeon consensus with diverticulitis clinical practice guidelines. World J Gastrointest Surg 2017; 9:224-232. [PMID: 29225733 PMCID: PMC5714804 DOI: 10.4240/wjgs.v9.i11.224] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/06/2017] [Revised: 09/24/2017] [Accepted: 10/16/2017] [Indexed: 02/07/2023] Open
Abstract
AIM To determine the application of clinical practice guidelines for the current management of diverticulitis and colorectal surgeon specialist consensus in Australia and New Zealand. METHODS A survey was distributed to 205 colorectal surgeons in Australia and New Zealand, using 22 hypothetical clinical scenarios. RESULTS The response rate was 102 (50%). For 19 guideline-based scenarios, only 11 (58%) reached consensus (defined as > 70% majority opinion) and agreed with guidelines; while 3 (16%) reached consensus and did not agree with guidelines. The remaining 5 (26%) scenarios showed community equipoise (defined as less than/equal to 70% majority opinion). These included diagnostic imaging where CT scan was contraindicated, management options in the failure of conservative therapy for complicated diverticulitis, surgical management of Hinchey grade 3, proximal extent of resection in sigmoid diverticulitis and use of oral mechanical bowel preparation and antibiotics for an elective colectomy. The consensus areas not agreeing with guidelines were management of simple diverticulitis, management following the failure of conservative therapy in uncomplicated diverticulitis and follow-up after an episode of complicated diverticulitis. Fifty-percent of rural/regional based surgeons would perform an urgent sigmoid colectomy in failed conservative therapy of diverticulitis compared to only 8% of surgeons city-based (Fisher's exact test P = 0.016). In right-sided complicated diverticulitis, a greater number of those in practice for more than ten years would perform an ileocecal resection and ileocolic anastomosis (79% vs 41%, P < 0.0001). CONCLUSION While there are areas of consensus in diverticulitis management, there are areas of community equipoise for future research, potentially in the form of RCTs.
Collapse
Affiliation(s)
- Javariah Siddiqui
- Discipline of Surgery, University of Sydney, Sydney, NSW 2050, Australia
| | - Assad Zahid
- Discipline of Surgery, University of Sydney, Sydney, NSW 2050, Australia
- Department of Colorectal Surgery, Royal Prince Alfred Hospital, Sydney, NSW 2050, Australia
| | - Jonathan Hong
- Discipline of Surgery, University of Sydney, Sydney, NSW 2050, Australia
- Department of Colorectal Surgery, Royal Prince Alfred Hospital, Sydney, NSW 2050, Australia
| | - Christopher John Young
- Discipline of Surgery, University of Sydney, Sydney, NSW 2050, Australia
- Department of Colorectal Surgery, Royal Prince Alfred Hospital, Sydney, NSW 2050, Australia
| |
Collapse
|
20
|
MacDermid E, Young CJ, Moug SJ, Anderson RG, Shepherd HL. Heuristics and bias in rectal surgery. Int J Colorectal Dis 2017; 32:1109-1115. [PMID: 28444507 DOI: 10.1007/s00384-017-2823-7] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 04/19/2017] [Indexed: 02/04/2023]
Abstract
PURPOSE Deciding to defunction after anterior resection can be difficult, requiring cognitive tools or heuristics. From our previous work, increasing age and risk-taking propensity were identified as heuristic biases for surgeons in Australia and New Zealand (CSSANZ), and inversely proportional to the likelihood of creating defunctioning stomas. We aimed to assess these factors for colorectal surgeons in the British Isles, and identify other potential biases. METHODS The Association of Coloproctology of Great Britain and Ireland (ACPGBI) was invited to complete an online survey. Questions included demographics, risk-taking propensity, sensitivity to professional criticism, self-perception of anastomotic leak rate and propensity for creating defunctioning stomas. Chi-squared testing was used to assess differences between ACPGBI and CSSANZ respondents. Multiple regression analysis identified independent surgeon predictors of stoma formation. RESULTS One hundred fifty (19.2%) eligible members of the ACPGBI replied. Demographics between ACPGBI and CSSANZ groups were well-matched. Significantly more ACPGBI surgeons admitted to anastomotic leak in the last year (p < 0.001). ACPGBI surgeon age over 50 (p = 0.02), higher risk-taking propensity across several domains (p = 0.044), self-belief in a lower-than-average anastomotic leak rate (p = 0.02) and belief that the average risk of leak after anterior resection is 8% or lower (p = 0.007) were all independent predictors of less frequent stoma formation. Sensitivity to criticism from colleagues was not a predictor of stoma formation. CONCLUSIONS Unrecognised surgeon factors including age, everyday risk-taking, self-belief in surgical ability and lower probability bias of anastomotic leak appear to exert an effect on decision-making in rectal surgery.
Collapse
Affiliation(s)
- Ewan MacDermid
- Department of Surgery, Nepean Hospital, Kingswood, NSW, Australia
| | - Christopher J Young
- Department of Colorectal Surgery, Royal Prince Alfred Hospital, Camperdown, NSW, Australia.
- University of Sydney, Sydney, NSW, Australia.
| | - Susan J Moug
- Department of Surgery, Royal Alexandra Hospital, Paisley, UK
| | | | | |
Collapse
|
21
|
Current Practice Trends for Use of Early Venous Thromboembolism Prophylaxis After Intracerebral Hemorrhage. Neurosurgery 2017; 82:85-92. [DOI: 10.1093/neuros/nyx146] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2016] [Accepted: 03/03/2017] [Indexed: 11/14/2022] Open
Abstract
Abstract
BACKGROUND
Venous thromboembolism (VTE) is common after intracerebral hemorrhage (ICH). Guidelines recommend early VTE prophylaxis.
OBJECTIVE
To determine characteristics associated with early chemoprophylaxis (CP) after ICH in the Get With The Guidelines-Stroke registry.
METHODS
In this observational cohort study, we identified patients with ICH between January 1, 2009 and September 30, 2013, who (1) were non-ambulatory and/or not comfort care measures by hospital day 2; (2) were not transferred to another acute care facility; and (3) had known VTE prophylaxis status at end of hospital day 2. Categories for VTE prophylaxis were as follows: (1) mechanical non-CP or (2) CP with or without mechanical prophylaxis. Early prophylaxis was defined as occurring by hospital day 2. Using multivariable logistic regression, we assessed patient, hospital, and geographic factors independently associated with early CP use.
RESULTS
Among 74 283 patients with ICH from 1358 hospitals, 5929 (7.9%) received early CP, 66 444 (89.4%) received early mechanical/non-CP, and 1910 (2.6%) had no prophylaxis, mechanical or CP, within the first 2 days. There was no increase in early CP use over the study period; 60% of hospitals provided early CP to <9% of patients. In multivariable analysis, female sex, atrial fibrillation, diabetes, coronary, carotid, and peripheral artery disease, prior ischemic stroke or transient ischemic attack, hospital size >500 beds, and geographic region were independently associated with early vs no early CP use.
CONCLUSION
Nationwide, the large majority of ICH patients receive early mechanical VTE prophylaxis only, without CP. Patient comorbidities and hospital characteristics such as geographic location are determinants of higher use of early CP.
Collapse
|
22
|
Whybrow P, Pickard R, Hrisos S, Rapley T. Equipoise across the patient population: optimising recruitment to a randomised controlled trial. Trials 2017; 18:140. [PMID: 28347354 PMCID: PMC5369002 DOI: 10.1186/s13063-016-1711-8] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2016] [Accepted: 11/16/2016] [Indexed: 11/30/2022] Open
Abstract
BACKGROUND This paper proposes a novel perspective on the value of qualitative research for improving trial design and optimising recruitment. We report findings from a qualitative study set within the OPEN trial, a surgical randomised controlled trial (RCT) comparing two interventions for recurrent bulbar urethral stricture, a common cause of urinary problems in men. METHODS Interviews were conducted with men meeting trial eligibility criteria (n = 19) to explore reasons for accepting or declining participation and with operating urologists (n = 15) to explore trial acceptability. RESULTS Patients expressed various preferences and understood these in the context of relative severity and tolerability of their symptoms. Accounts suggest a common trajectory of worsening symptoms with a particular window within which either treatment arm would be considered acceptable. Interviews with clinician recruiters found that uncertainty varied between general and specialist sites, which reflect clinicians' relative exposure to different proportions of the patient population. CONCLUSION Recruitment post referral, at specialist sites, was challenging due to patient (and clinician) expectations. Trial design, particularly where there are fixed points for recruitment along the care pathway, can enable or constrain the possibilities for effective accrual depending on how it aligns with the optimum point of patient equipoise. Qualitative recruitment investigations, often focussed on information provision and patient engagement, may also look to better understand the target patient population in order to optimise the point at which patients are approached. TRIAL REGISTRATION ISRCTN Registry, ISRCTN98009168 . Registered on 29 November 2012.
Collapse
Affiliation(s)
- Paul Whybrow
- Newcastle University, Baddiley-Clark Building, Newcastle Upon Tyne, NE2 4AX UK
- Present address: School for Social and Community Medicine, Canynge Hall, 39 Whatley Road, Bristol, BS8 2PS UK
| | - Robert Pickard
- Institute of Cellular Medicine, The Medical School, Newcastle University, 3rd Floor William Leech Building, Newcastle upon Tyne, NE2 4HH UK
| | - Susan Hrisos
- Newcastle University, Baddiley-Clark Building, Newcastle Upon Tyne, NE2 4AX UK
| | - Tim Rapley
- Newcastle University, Baddiley-Clark Building, Newcastle Upon Tyne, NE2 4AX UK
| |
Collapse
|
23
|
Affiliation(s)
- Sanjay Kalra
- Department of Endocrinology, Bharti Hospital, Karnal, Haryana, India
| | - Mathew John
- Department of Endocrinology, Providence Clinic, Trivandrum, Kerala, India
- C.E.O, Chellaram Diabetes Institute, Pune, Maharashtra, India
| | | |
Collapse
|
24
|
Byrne MM, Thompson P. Collective Equipoise, Disappointment, and the Therapeutic Misconception: On the Consequences of Selection for Clinical Research. Med Decis Making 2016; 26:467-79. [PMID: 16997925 DOI: 10.1177/0272989x06290499] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Private information induces individuals to self-select as subjects into clinical research trials, and it induces researchers to select which trials they conduct. The authors show that selection can induce ex ante therapeutic misconception and ex post disappointment among research subjects, and it undermines the rationale of collective equipoise as an ethical basis for clinical trials. Selection provides a reason to make nontrivial payments to subjects, and it implies that researchers should not design experiments to maximize statistical power.
Collapse
Affiliation(s)
- Margaret M Byrne
- Department of Epidemiology and Public Health, University of Miami, Florida 33101, USA.
| | | |
Collapse
|
25
|
Mann H, London AJ, Mann J. Equipoise in the Enhanced Supression of the Platelet IIb/IIIa Receptor with Integrilin Trial (ESPRIT): a critical appraisal. Clin Trials 2016; 2:233-41; discussion 242-3. [PMID: 16279146 DOI: 10.1191/1740774505cn086oa] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Abstract
Enhanced Supression of the Platelet IIb/IIIa Receptor with Integrilin Trial (ESPRIT) was a multicenter randomized controlled clinical trial in which participants were randomized between eptifibatide and placebo. A “clinical hold” was initially placed on the trial by the US Food and Drug Administration (FDA), which was concerned about the placebo-only control arm. The hold was lifted after additional information concerning the use of platelet glycoprotein IIb/IIIa inhibitors in clinical practice, derived from a survey of interventional cardiologists, was provided. The trial's principal investigator and colleagues have described how these issues were resolved, and advance a claim of equipoise for the trial. In this critical appraisal we examine the information and arguments proffered in support of the trial design and conclude that they evidence a misunderstanding of equipoise. We believe that a placebo-only control arm was not justified by the information provided by the trialists.
Collapse
Affiliation(s)
- Howard Mann
- Department of Radiology, University of Utah School of Medicine, Salt Lake City, Utah 84132, USA.
| | | | | |
Collapse
|
26
|
Affiliation(s)
- Robert M. Veatch
- Kennedy Institute of Ethics, Georgetown University, Washington, District of Columbia
| |
Collapse
|
27
|
Bartlett RH. Clinical Research in Acute Fatal Illness. J Intensive Care Med 2016; 31:456-65. [DOI: 10.1177/0885066614550278] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/08/2014] [Accepted: 06/16/2014] [Indexed: 01/19/2023]
Abstract
Clinical research to evaluate the effectiveness of life support systems in acute fatal illness has unique problems of logistics, ethics, and consent. There have been 10 prospective comparative trials of extracorporeal membrane oxygenation in acute fatal respiratory failure, utilizing different study designs. The trial designs were prospective controlled randomized, prospective adaptive randomized, sequential, and matched pairs. The trials were reviewed with regard to logistics, ethics, consent, statistical methods, economics, and impact. The matched pairs method is the best study design for evaluation of life support systems in acute fatal illness.
Collapse
Affiliation(s)
- Robert H. Bartlett
- Department of Surgery, University of Michigan Medical School, Ann Arbor, MI, USA
| |
Collapse
|
28
|
Shuman AG. Ethics of Placebo Control in Trials for Idiopathic Sudden Sensorineural Hearing Loss. Otolaryngol Head Neck Surg 2016; 155:13-4. [DOI: 10.1177/0194599816644441] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2016] [Accepted: 03/23/2016] [Indexed: 11/15/2022]
Affiliation(s)
- Andrew G. Shuman
- Center for Bioethics and Social Sciences in Medicine and Department of Otolaryngology–Head and Neck Surgery, University of Michigan Medical School, Ann Arbor, Michigan, USA
| |
Collapse
|
29
|
Ghogawala Z, Schwartz JS, Benzel EC, Magge SN, Coumans JV, Harrington JF, Gelbs JC, Whitmore RG, Butler WE, Barker FG. Increased Patient Enrollment to a Randomized Surgical Trial Through Equipoise Polling of an Expert Surgeon Panel. Ann Surg 2016; 264:81-6. [PMID: 26501698 DOI: 10.1097/sla.0000000000001483] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/26/2022]
Abstract
OBJECTIVE To determine whether patients who learned the views of an expert surgeons' panel's assessment of equipoise between 2 alternative operative treatments had increased likelihood of consenting to randomization. BACKGROUND Difficulty obtaining patient consent to randomization is an important barrier to conducting surgical randomized clinical trials, the gold standard for generating clinical evidence. METHODS Observational study of the rate of patient acceptance of randomization within a 5-center randomized clinical trial comparing lumbar spinal decompression versus lumbar spinal decompression plus instrumented fusion for patients with symptomatic grade I degenerative lumbar spondylolisthesis with spinal stenosis. Eligible patients were enrolled in the trial and then asked to accept randomization. A panel of 10 expert spine surgeons was formed to review clinical information and images for individual patients to provide an assessment of suitability for randomization. The expert panel vote was disclosed to the patient by the patient's surgeon before the patient decided whether to accept randomization or not. RESULTS Randomization acceptance among eligible patients without expert panel review was 40% (19/48) compared with 81% (47/58) among patients undergoing expert panel review (P < 0.001). Among expert-reviewed patients, randomization acceptance was 95% when all experts or all except 1 voted for randomization, 75% when 2 experts voted against randomization, and 20% with 3 or 4 votes against (P < 0.001 for trend). CONCLUSIONS Patients provided with an expert panel's assessment of their own suitability for randomization were twice as likely to agree to randomization compared with patients receiving only their own surgeon's recommendation.
Collapse
Affiliation(s)
- Zoher Ghogawala
- *Alan and Jacqueline Stuart Spine Center, Department of Neurosurgery, Lahey Hospital and Medical Center, Burlington, MA†Tufts University School of Medicine, Boston, MA‡Wallace Trials Center, Greenwich Hospital, Greenwich, CT§Perelman School of Medicine, Wharton School of Business and Leonard Davis Institute, University of Pennsylvania, Philadelphia, PA¶The Center for Spine Health and Department of Neurosurgery, Cleveland Clinic Foundation, Cleveland, OH||Neurosurgical Service, Massachusetts General Hospital, and Department of Surgery, Harvard Medical School, Boston, MA**Department of Neurosurgery, University Of New Mexico, Albuquerque, NM
| | | | | | | | | | | | | | | | | | | |
Collapse
|
30
|
Bennette CS, Veenstra DL, Basu A, Baker LH, Ramsey SD, Carlson JJ. Development and Evaluation of an Approach to Using Value of Information Analyses for Real-Time Prioritization Decisions Within SWOG, a Large Cancer Clinical Trials Cooperative Group. Med Decis Making 2016; 36:641-51. [PMID: 27012232 DOI: 10.1177/0272989x16636847] [Citation(s) in RCA: 22] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2015] [Accepted: 12/16/2015] [Indexed: 11/17/2022]
Abstract
OBJECTIVE Value of information (VOI) analyses can align research with areas with the greatest potential impact on patient outcome, but questions remain concerning the feasibility and acceptability of these approaches to inform prioritization decisions. Our objective was to develop a process for calculating VOI in "real time" to inform trial funding decisions within SWOG, a large cancer clinical trials group. METHODS We developed an efficient and scalable VOI modeling approach using a selected sample of 9 randomized phase II/III trial proposals from the Breast, Gastrointestinal, and Genitourinary Disease Committees reviewed by SWOG's leadership between 2008 and 2013. There was bidirectional communication between SWOG investigators and the research team throughout the modeling development. Partial expected value of sample information for the treatment effect evaluated by the proposed trial's primary endpoint was calculated using Monte Carlo simulation. RESULTS We derived prior uncertainty in the treatment effect estimate from the sample size calculations. Our process was feasible for 8 of 9 trial proposals and efficient: the time required of 1 researcher was <1 week per proposal. We accommodated stakeholder input primarily by deconstructing VOI metrics into expected health benefits and incremental healthcare costs and assuming treatment decisions within our simulations were based on health benefits. Following customization, feedback from over 200 SWOG members was positive regarding the overall VOI framework, specific retrospective results, and potential for VOI analyses to inform future trial proposal evaluations. CONCLUSIONS We developed an efficient and customized process to calculate the expected VOI of cancer clinical trials that is feasible for use in decision making and acceptable to investigators. Prospective use and evaluation of this approach is currently underway within SWOG.
Collapse
Affiliation(s)
- Caroline S Bennette
- Departments of Pharmacy, University of Washington, Seattle, Washington (CSB, DLV, JJC)
| | - David L Veenstra
- Departments of Pharmacy, University of Washington, Seattle, Washington (CSB, DLV, JJC)
| | - Anirban Basu
- Washington Health Services, University of Washington, Seattle, Washington (AB)
| | | | - Scott D Ramsey
- Hutchinson Institute for Cancer Outcomes Research, Fred Hutchinson Cancer Research Center, Seattle, Washington (SDR)
| | - Josh J Carlson
- Departments of Pharmacy, University of Washington, Seattle, Washington (CSB, DLV, JJC)
| |
Collapse
|
31
|
Nickoloff JA. Photon, light ion, and heavy ion cancer radiotherapy: paths from physics and biology to clinical practice. ANNALS OF TRANSLATIONAL MEDICINE 2016; 3:336. [PMID: 26734646 DOI: 10.3978/j.issn.2305-5839.2015.12.18] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Subscribe] [Scholar Register] [Indexed: 11/14/2022]
Abstract
External beam radiotherapy has proven highly effective against a wide range of cancers, and in recent decades there have been rapid advances with traditional photon-based (X-ray) radiotherapy and the development of two particle-based techniques, proton and carbon ion radiotherapy (CIRT). There are major cost differences and both physical and biological differences among these modalities that raise important questions about relative treatment efficacy and cost-effectiveness. Randomized clinical trials (RCTs) represent the gold standard for comparing treatments, but there are significant cost and ethical barriers to their wide-spread use. Meta-analysis of non-coordinated clinical trials data is another tool that can be used to compare treatments, and while this approach has recognized limitations, it is argued that meta-analysis represents an early stage of investigation that can help inform the design of future RCTs.
Collapse
Affiliation(s)
- Jac A Nickoloff
- Department of Environmental and Radiological Health Sciences, Colorado State University, Fort Collins, CO 80523, USA
| |
Collapse
|
32
|
Prost A, Binik A, Abubakar I, Roy A, De Allegri M, Mouchoux C, Dreischulte T, Ayles H, Lewis JJ, Osrin D. Logistic, ethical, and political dimensions of stepped wedge trials: critical review and case studies. Trials 2015; 16:351. [PMID: 26278521 PMCID: PMC4538739 DOI: 10.1186/s13063-015-0837-4] [Citation(s) in RCA: 57] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2015] [Accepted: 07/01/2015] [Indexed: 12/24/2022] Open
Abstract
Background Three arguments are usually invoked in favour of stepped wedge cluster randomised controlled trials: the logistic convenience of implementing an intervention in phases, the ethical benefit of providing the intervention to all clusters, and the potential to enhance the social acceptability of cluster randomised controlled trials. Are these alleged benefits real? We explored the logistic, ethical, and political dimensions of stepped wedge trials using case studies of six recent evaluations. Methods We identified completed or ongoing stepped wedge evaluations using two systematic reviews. We then purposively selected six with a focus on public health in high, middle, and low-income settings. We interviewed their authors about the logistic, ethical, and social issues faced by their teams. Two authors reviewed interview transcripts, identified emerging issues through qualitative thematic analysis, reflected upon them in the context of the literature, and invited all participants to co-author the manuscript. Results Our analysis raises three main points. First, the phased implementation of interventions can alleviate problems linked to simultaneous roll-out, but also brings new challenges. Issues to consider include the feasibility of organising intervention activities according to a randomised sequence, estimating time lags in implementation and effects, and accommodating policy changes during the trial period. Second, stepped wedge trials, like parallel cluster trials, require equipoise: without it, randomising participants to a control condition, even for a short time, remains problematic. In stepped wedge trials, equipoise is likely to lie in the degree of effect, effectiveness in a specific operational milieu, and the balance of benefit and harm, including the social value of better evaluation. Third, the strongest arguments for a stepped wedge design are logistic and political rather than ethical. The design is advantageous when simultaneous roll-out is impractical and when it increases the acceptability of using counterfactuals. Conclusions The logistic convenience of phased implementation is context-dependent, and may be vitiated by the additional requirements of phasing. The potential for stepped wedge trials to enhance the social acceptability of cluster randomised trials is real, but their ethical legitimacy still rests on demonstrating equipoise and its configuration for each research question and setting.
Collapse
Affiliation(s)
- Audrey Prost
- Institute for Global Health, University College London, 30 Guilford Street, London, WC1N 1EH, UK.
| | | | | | - Anjana Roy
- Public Health England (PHE), Colindale, UK.
| | - Manuela De Allegri
- Institute of Public Health, Faculty of Medicine, University of Heidelberg, Heidelberg, Germany.
| | | | | | - Helen Ayles
- MRC Tropical Epidemiology Group, Department of Infectious Disease Epidemiology, London School of Hygiene and Tropical Medicine, London, UK.
| | - James J Lewis
- MRC Tropical Epidemiology Group, Department of Infectious Disease Epidemiology, London School of Hygiene and Tropical Medicine, London, UK.
| | - David Osrin
- Institute for Global Health, University College London, 30 Guilford Street, London, WC1N 1EH, UK.
| |
Collapse
|
33
|
Suen MKL, Zahid A, Young JM, Rodwell L, Solomon MJ, Young CJ. How to decide to undertake a randomized, controlled trial of stent or surgery in colorectal obstruction. Surgery 2015; 157:1137-1141. [PMID: 25796417 DOI: 10.1016/j.surg.2015.01.022] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2013] [Revised: 12/12/2014] [Accepted: 01/07/2015] [Indexed: 01/01/2023]
Abstract
BACKGROUND Colorectal stents have been available as a management option in obstruction for 23 years, yet there is little randomized evidence of their effectiveness. This study investigated current surgeon-related barriers to conducting a randomized, controlled trial (RCT) of colorectal stent insertion for obstruction in patients with colorectal cancer. METHODS A binational survey of current members of the Colorectal Surgical Society of Australia and New Zealand was conducted by a mailed questionnaire assessing perceived barriers to adoption of colonic stents and willingness to participate in future multicentre randomized controlled trials, and surgeons' treatment preferences in 16 hypothetical clinical scenarios. RESULTS Of 148 eligible surgeons, 96 (65%) responded. Colonic stenting was available to 98% of respondents. In the clinical setting of colorectal obstruction, only 29% (95% CI, 20-39%) of surgeons expressed a willingness to participate in a RCT involving colonic stents in the curative setting. More than 70% of surgeons preferred the use of stents in unfit patients for palliation, and preferred surgery in fit patients with curable disease. In the curative setting, most respondents considered colonic stents not cost effective (90%; 95% CI, 82-94%) and believed that their patients would not prefer stents over surgery (80%; 95% CI, 71-87%). CONCLUSION This study highlights the limitation to conducting a future randomized controlled trial to assess the efficacy of colonic stenting, especially in the curative setting, based on surgeon preference, despite the lack of level I evidence.
Collapse
Affiliation(s)
- Michael K L Suen
- Department of Colorectal Surgery, Royal Prince Alfred Hospital, NSW, Australia; University of Sydney, Sydney, Australia
| | - Assad Zahid
- Department of Colorectal Surgery, Royal Prince Alfred Hospital, NSW, Australia
| | - Jane M Young
- Surgical Outcomes Research Centre (SOuRCe), University of Sydney, Sydney, Australia
| | - Laura Rodwell
- Surgical Outcomes Research Centre (SOuRCe), University of Sydney, Sydney, Australia
| | - Michael J Solomon
- Department of Colorectal Surgery, Royal Prince Alfred Hospital, NSW, Australia; Surgical Outcomes Research Centre (SOuRCe), University of Sydney, Sydney, Australia
| | - Christopher J Young
- Department of Colorectal Surgery, Royal Prince Alfred Hospital, NSW, Australia; University of Sydney, Sydney, Australia.
| |
Collapse
|
34
|
Roy D, Raymond J, Bojanowski MW. [Variability in decision-making for treatment choice of intracranial aneurysms]. Neurochirurgie 2014; 60:288-92. [PMID: 25441708 DOI: 10.1016/j.neuchi.2014.06.013] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/03/2013] [Revised: 03/22/2014] [Accepted: 06/29/2014] [Indexed: 11/15/2022]
Abstract
OBJECTIVES To measure the variability in choosing treatment options in different clinical situations involving intracranial aneurysms. MATERIALS AND METHODS A questionnaire regarding 25 clinical cases was presented via visual projection, to attendees of the Congrès de la Société française de neurochirurgie et de la Société de langue française de neurochirurgie held in Toulouse from May 9th to May 12th, 2012. The audience (n=59) consisted of 58 neurosurgeons and one neuroradiologist. A minority of them (29.2%) stated that they specialized in vascular neurosurgery. The questionnaire dealt with 25 illustrative clinical cases, in which age, gender, and clinical context were provided along with the corresponding angiographic image of the aneurysm. The questionnaire asked whether the physician would have proposed treatment, and if so, which type of treatment (clip, coil or other). In addition, the physician had to indicate, on a scale of one to ten, the degree of confidence they had in their decision. RESULTS For one-third of the cases, there was at least 10% of the respondents who opted for a decision opposite to the one of the majority. For 41.7% of the cases, the proportion of respondents who opted for the clip was not significantly different from the proportion of those who opted for the coil. CONCLUSION Even in a relatively homogenous group of physicians, there were significantly diverging opinions regarding the management of cerebral aneurysms. This demonstrates the need for evidence-based data from controlled randomized studies.
Collapse
Affiliation(s)
- D Roy
- Département de radiologie, centre hospitalier de l'université de Montréal, Montréal Qc, Canada
| | - J Raymond
- Département de radiologie, centre hospitalier de l'université de Montréal, Montréal Qc, Canada
| | - M W Bojanowski
- Service de neurochirurgie, centre hospitalier de l'université de Montréal, H2L4M1 Montréal Qc, Canada.
| |
Collapse
|
35
|
Colli A, Pagliaro L, Duca P. The ethical problem of randomization. Intern Emerg Med 2014; 9:799-804. [PMID: 25194693 DOI: 10.1007/s11739-014-1118-z] [Citation(s) in RCA: 18] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/27/2014] [Accepted: 08/12/2014] [Indexed: 01/06/2023]
Abstract
The Fondazione Umberto Veronesi ethics committee recently published a statement concerning the inherent ethical issues of randomized clinical trials (RCTs), mainly focusing on randomization, raising many questions, and suggesting possible solutions. The main concern is that the patients enrolled in a RCT are used to improve medical knowledge, but they cannot be the beneficiaries of the results of the trials in which they are participating. Possible solutions come from a wider use of clinical and administrative databases, and an early termination of trials. We discuss this statement, emphasizing that the scientific and ethical reason for embarking on a clinical trial is uncertainty. The uncertainty regarding the comparative benefits and harms of each compared treatment (clinical equipoise) warrants equity in allocation. Randomization allows one to obtain unbiased evidence that we cannot know in advance. The expected probability of a new treatment to be successful describes the limits within which a study can be acceptable both from an ethical as well as a scientific point of view. Most people accept enrollment in a RCT if the probability of success of the experimental treatment is between 50 and 70%. The assumption and concern that there is a conflict between "scientific" and "ethical" aspects of a clinical trial due to randomization should at least be mitigated, considering that only scientifically sounded studies can be considered ethical. Randomization remains the appropriate approach to ensure the study's internal validity. Different aspects seem to be more important, from the ethical point of view, considering RCT and their publication.
Collapse
Affiliation(s)
- Agostino Colli
- Medical Department, Ospedale A Manzoni AO Provincia di Lecco, Via Eremo 9/11, 23900, Lecco, Italy,
| | | | | |
Collapse
|
36
|
Mhaskar R, B Bercu B, Djulbegovic B. At what level of collective equipoise does a randomized clinical trial become ethical for the members of institutional review board/ethical committees? Acta Inform Med 2013; 21:156-9. [PMID: 24167382 PMCID: PMC3804473 DOI: 10.5455/aim.2013.21.156-159] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2013] [Accepted: 06/20/2013] [Indexed: 01/11/2023] Open
Abstract
Background: The conduct of a randomized controlled trial (RCT) is deemed ethical only if we are in state of “equipoise” as to which treatment would be most beneficial for the patients. Individual equipoise applies to an individual clinician or a member of ethical, institutional review board (IRB), whilst collective equipoise refers to the profession as a whole. It is argued that physicians are not bound by the equipoise but their actions are directed by the confines of the expert opinion. Experts can agree or disagree in various proportions on the merit of a given treatment. Hence, the collective equipoise will be often incomplete. In turn, the opinions of content expert in the field of the proposed trial influence the IRB members’ decision regarding trial approval. Methods: We conducted a survey of IRB members at University of South Florida and the IRB members attending the bioethics conference organized in Clearwater, Florida, USA. The survey was made available as hard copy (paper based) and included six hypothetical scenarios outlining clinical trials targeted at measuring the collective equipoise. We defined the collective equipoise as the situation when survey participants were equally split (50:50) in their decision regarding whether a proposed clinical trial would be ethical to conduct. The opinion of 100 experts in the field expressed as proportion of experts favoring treatment A vs. B in each of the five scenarios was made available to the participants. Results: The response rate of our survey was 33% (71/218). Fifty percent of the IRB members would approve an RCT addressing the efficacy of two drugs for the management of headache even if 80% of experts favor one treatment over another (median: 80%; third quartile: 80%). Similarly, half of participating IRB members would approve the study when the median distribution of equipoise among experts was 70% (70 in favor of treatment A vs. 30 in favor of treatment B) for treatment of leukemia, 60% for treatment of geriatric patients and 70% for treatment of newborns. Half of IRB members would approve the study when the median distribution of equipoise among experts was 70% for treatment for leukemia in dogs and 85% for leukemia in rats (and 25% of IRB members would approve such a study even if 100% of experts favors one treatment over another). None of the demographic features of respondents affected collective equipoise. Conclusions: This is the first study assessing collective equipoise among ethical committee/IRB members. Our study findings show that IRB members perceived that conduct of a trial enrolling humans is unethical when the equipoise level is beyond 80% (80:20 distribution of uncertainty). IRB members require a higher level of equipoise when it comes to testing a new drug in humans than in animals. A relatively high level of equipoise is needed for IRB members to be comfortable to approve trials involving life-threatening situations, children and elderly patients.
Collapse
Affiliation(s)
- Rahul Mhaskar
- Clinical Translational Science Institute, Center for Evidence-based Medicine and Health Outcomes Research, Tampa, FLorida, USA ; Department of Internal Medicine, Division of Evidence-based Medicine and Health Outcomes Research University of South Florida, Tampa, FLorida, USA
| | | | | |
Collapse
|
37
|
NAVABI N, SHAHRAVAN A, MODABERI A. Reporting of Ethical Considerations Associated with Clinical Trials Published in Iranian Dental Journals between 2001 and 2011. IRANIAN JOURNAL OF PUBLIC HEALTH 2013; 42:594-601. [PMID: 23967427 PMCID: PMC3744256] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/16/2013] [Accepted: 05/21/2013] [Indexed: 10/31/2022]
Abstract
BACKGROUND Ethical consideration is a basic requirement for design of randomized clinical trials. The purpose of this study was to assess whether reports of Iranian dental clinical trials complied with the requirements of the ethical principles of human research. METHODS In this retrospective observational study electronic search was performed to identify all dental clinical trials published between 2001 and 2011. Each trial report was assessed for inclusion of a statement that 17 items about research ethics. RESULTS Totally 242 papers were identified, of which 15.3%, stated that ethical approval had been obtained and 50.4% of the trial reports indicated that informed consent had been obtained. The mean ethical score for the mentioned studies was 7/68 out of 17. CONCLUSIONS Most Iranian dental clinical trial reports failed to consider important ethical principles. The reporting of the ethical issues associated with these trials could be improved further not only by the instructions to authors, but also by Journal editors refusing to publish trials that do not comply.
Collapse
Affiliation(s)
- Nader NAVABI
- Oral and Dental Diseases Research Center, Kerman University of Medical Sciences, Kerman, Iran
| | - Arash SHAHRAVAN
- Oral and Dental Diseases Research Center, Kerman University of Medical Sciences, Kerman, Iran
| | - Ali MODABERI
- School of Dentistry, Kerman University of Medical Sciences, Kerman, Iran
| |
Collapse
|
38
|
Corona J, Miller DJ, Downs J, Akbarnia BA, Betz RR, Blakemore LC, Campbell RM, Flynn JM, Johnston CE, McCarthy RE, Roye DP, Skaggs DL, Smith JT, Snyder BD, Sponseller PD, Sturm PF, Thompson GH, Yazici M, Vitale MG. Evaluating the extent of clinical uncertainty among treatment options for patients with early-onset scoliosis. J Bone Joint Surg Am 2013; 95:e67. [PMID: 23677368 DOI: 10.2106/jbjs.k.00805] [Citation(s) in RCA: 26] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/01/2023]
Abstract
BACKGROUND Literature guiding the management of early-onset scoliosis consists primarily of studies with a low level of evidence. Evaluation of clinical equipoise (i.e., when there is no known superiority among treatment modalities) allows for prioritization of research efforts. The objective of this study was to evaluate areas of clinical uncertainty among pediatric spine surgeons regarding the treatment of early-onset scoliosis. METHODS Fourteen experienced pediatric spine surgeons participated in semistructured interviews to identify clinical variables that influence decision making in the treatment of early-onset scoliosis. A series of case scenarios of 315 patients with idiopathic and neuromuscular early-onset scoliosis was then developed to be representative of those encountered in clinical practice. Using an online survey, eleven surgeons selected their choice of eight treatment options for each case scenario. Associations between case characteristics and treatment choices were assessed with chi-square and logistic regression analysis. Participants then reviewed the areas of treatment uncertainty identified in the survey, nominated additional research questions of interest, and ranked their interest to further explore the identified research questions. RESULTS Collective equipoise was identified in numerous scenarios in the survey spanning a range of ages and magnitudes of scoliosis, and additional questions were identified during the nominal group technique. Areas that had the greatest clinical uncertainty included the management of patients who have finished treatment with a growing-rod, timing of rod-lengthening intervals, and indications for spine-based and rib-based proximal instrumentation anchors. The use of rib anchors compared with spine-based anchors was ranked highly for consideration in future clinical trials. CONCLUSIONS Variability in decision making with regard to the optimum treatment of certain subsets of patients with early-onset scoliosis reflects gaps in the available evidence. Structured consensus methods identified priorities for higher levels of research in this area of scoliosis. Higher-level studies, including randomized trials, should focus on answering the questions highlighted in this report.
Collapse
Affiliation(s)
- Jacqueline Corona
- Division of Orthopaedic Surgery, Southern Illinois University School of Medicine, 701 North First Street, Room D220, Springfield, IL 62702, USA
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
39
|
Aiken AM, Haddow JB, Symons NRA, Kaptanis S, Katz-Summercorn AC, Debnath D, Dent H, Tayeh S, Kung V, Clark S, Gahir J, Dindyal S, Farag S, Lazaridis A, Bretherton CP, Williams S, Currie A, West H, Davies J, Arora S, Kheraj A, Stubbs BM, Yassin N, Mallappa S, Garrett G, Hislop S, Bhangu A, Abbey Y, Al-Shoek I, Ahmad U, Sharp G, Memarzadeh A, Patel A, Ali F, Kaderbhai H, Knowles CH. Use of antibiotic prophylaxis in elective inguinal hernia repair in adults in London and south-east England: a cross-sectional survey. Hernia 2013; 17:657-64. [PMID: 23543332 PMCID: PMC3788180 DOI: 10.1007/s10029-013-1061-3] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2012] [Accepted: 02/08/2013] [Indexed: 11/30/2022]
Abstract
Purpose Evidence regarding whether or not antibiotic prophylaxis is beneficial in preventing post-operative surgical site infection in adult inguinal hernia repair is conflicting. A recent Cochrane review based on 17 randomised trials did not reach a conclusion on this subject. This study aimed to describe the current practice and determine whether clinical equipoise is prevalent. Methods Surgeons in training were recruited to administer the Survey of Hernia Antibiotic Prophylaxis usE survey to consultant-level general surgeons in London and the south-east of England on their practices and beliefs regarding antibiotic prophylaxis in adult elective inguinal hernia repair. Local prophylaxis guidelines for the participating hospital sites were also determined. Results The study was conducted at 34 different sites and received completed surveys from 229 out of a possible 245 surgeons, a 93 % response rate. Overall, a large majority of hospital guidelines (22/28) and surgeons’ personal beliefs (192/229, 84 %) supported the use of single-dose pre-operative intravenous antibiotic prophylaxis in inguinal hernia repair, although there was considerable variation in the regimens in use. The most widely used regimen was intravenous co-amoxiclav (1.2 g). Less than half of surgeons were adherent to their own hospital antibiotic guidelines for this procedure, although many incorrectly believed that they were following these. Conclusion In the south-east of England, there is a strong majority of surgical opinion in favour of the use of antibiotic prophylaxis in this procedure. It is therefore likely to be extremely difficult to conduct further randomised studies in the UK to support or refute the effectiveness of prophylaxis in this commonly performed procedure.
Collapse
Affiliation(s)
- A M Aiken
- c/o National Centre for Bowel Research and Surgical Innovation, 1st Floor Abernathy Building, 2 Newark St, Whitechapel, London, E1 2AT, UK
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
40
|
Djulbegovic B, Kumar A, Miladinovic B, Reljic T, Galeb S, Mhaskar A, Mhaskar R, Hozo I, Tu D, Stanton HA, Booth CM, Meyer RM. Treatment success in cancer: industry compared to publicly sponsored randomized controlled trials. PLoS One 2013; 8:e58711. [PMID: 23555593 PMCID: PMC3605423 DOI: 10.1371/journal.pone.0058711] [Citation(s) in RCA: 30] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2012] [Accepted: 02/05/2013] [Indexed: 11/19/2022] Open
Abstract
OBJECTIVE To assess if commercially sponsored trials are associated with higher success rates than publicly-sponsored trials. STUDY DESIGN AND SETTINGS We undertook a systematic review of all consecutive, published and unpublished phase III cancer randomized controlled trials (RCTs) conducted by GlaxoSmithKline (GSK) and the NCIC Clinical Trials Group (CTG). We included all phase III cancer RCTs assessing treatment superiority from 1980 to 2010. Three metrics were assessed to determine treatment successes: (1) the proportion of statistically significant trials favouring the experimental treatment, (2) the proportion of the trials in which new treatments were considered superior according to the investigators, and (3) quantitative synthesis of data for primary outcomes as defined in each trial. RESULTS GSK conducted 40 cancer RCTs accruing 19,889 patients and CTG conducted 77 trials enrolling 33,260 patients. 42% (99%CI 24 to 60) of the results were statistically significant favouring experimental treatments in GSK compared to 25% (99%CI 13 to 37) in the CTG cohort (RR = 1.68; p = 0.04). Investigators concluded that new treatments were superior to standard treatments in 80% of GSK compared to 44% of CTG trials (RR = 1.81; p<0.001). Meta-analysis of the primary outcome indicated larger effects in GSK trials (odds ratio = 0.61 [99%CI 0.47-0.78] compared to 0.86 [0.74-1.00]; p = 0.003). However, testing for the effect of treatment over time indicated that treatment success has become comparable in the last decade. CONCLUSIONS While overall industry sponsorship is associated with higher success rates than publicly-sponsored trials, the difference seems to have disappeared over time.
Collapse
Affiliation(s)
- Benjamin Djulbegovic
- Center for Evidence-Based Medicine and Health Outcomes Research, Tampa, Florida, USA.
| | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
41
|
Palmer AJR, Thomas GER, Pollard TCB, Rombach I, Taylor A, Arden N, Beard DJ, Andrade AJ, Carr AJ, Glyn-Jones S. The feasibility of performing a randomised controlled trial for femoroacetabular impingement surgery. Bone Joint Res 2013; 2:33-40. [PMID: 23610700 PMCID: PMC3626218 DOI: 10.1302/2046-3758.22.2000137] [Citation(s) in RCA: 24] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/01/2012] [Accepted: 01/09/2013] [Indexed: 12/02/2022] Open
Abstract
Objectives The number of surgical procedures performed each year to treat
femoroacetabular impingement (FAI) continues to rise. Although there
is evidence that surgery can improve symptoms in the short-term,
there is no evidence that it slows the development of osteoarthritis
(OA). We performed a feasibility study to determine whether patient
and surgeon opinion was permissive for a Randomised Controlled Trial
(RCT) comparing operative with non-operative treatment for FAI. Methods Surgeon opinion was obtained using validated questionnaires at
a Specialist Hip Meeting (n = 61, 30 of whom stated that they routinely
performed FAI surgery) and patient opinion was obtained from clinical
patients with a new diagnosis of FAI (n = 31). Results Clinical equipoise was demonstrated when surgeons were given
clinical scenarios and asked whether they would manage a patient
operatively or non-operatively. A total of 23 surgeons (77%) who
routinely perform FAI surgery were willing to recruit patients into
a RCT, and 28 patients (90%) were willing to participate. 75% of
responding surgeons believed it was appropriate to randomise patients
to non-operative treatment for ≥ 12 months. Conversely, only eight
patients (26%) felt this was acceptable, although 29 (94%) were
willing to continue non-operative treatment for six months. More
patients were concerned about their risk of developing OA than their
current symptoms, although most patients felt that the two were
of equal importance. Conclusions We conclude that a RCT comparing operative and non-operative
management of FAI is feasible and should be considered a research
priority. An important finding for orthopaedic surgical trials is
that patients without life-threatening pathology appear willing
to trial a treatment for six months without improvement in their
symptoms.
Collapse
Affiliation(s)
- A J R Palmer
- Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences (NDORMS), University of Oxford, Windmill Road, Headington, Oxford OX3 7LD, UK
| | | | | | | | | | | | | | | | | | | |
Collapse
|
42
|
Cook C, Sheets C. Clinical equipoise and personal equipoise: two necessary ingredients for reducing bias in manual therapy trials. J Man Manip Ther 2012; 19:55-7. [PMID: 22294855 DOI: 10.1179/106698111x12899036752014] [Citation(s) in RCA: 58] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/31/2022] Open
Abstract
Clinical and personal equipoise exists when a clinician has no good basis for a choice between two or more care options or when one is truly uncertain about the overall benefit or harm offered by the treatment to his/her patient. For most manual therapy trials, equipoise does not likely exist. Because of the nature of the intervention a lack of equipoise can lead to bias and may account for a portion of the 'effect' that has traditionally been assigned to the intervention. Although there are methodological mechanisms to reduce the risk of bias associated with a lack of equipoise, most of the manual therapy trials to date are likely guilty of this form of bias.
Collapse
Affiliation(s)
- Chad Cook
- Division of Physical Therapy, Walsh University, North Canton, OH, USA
| | | |
Collapse
|
43
|
Djulbegovic B, Hozo I. When is it rational to participate in a clinical trial? A game theory approach incorporating trust, regret and guilt. BMC Med Res Methodol 2012; 12:85. [PMID: 22726276 PMCID: PMC3473303 DOI: 10.1186/1471-2288-12-85] [Citation(s) in RCA: 11] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2011] [Accepted: 05/14/2012] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Randomized controlled trials (RCTs) remain an indispensable form of human experimentation as a vehicle for discovery of new treatments. However, since their inception RCTs have raised ethical concerns. The ethical tension has revolved around "duties to individuals" vs. "societal value" of RCTs. By asking current patients "to sacrifice for the benefit of future patients" we risk subjugating our duties to patients' best interest to the utilitarian goal for the good of others. This tension creates a key dilemma: when is it rational, from the perspective of the trial patients and researchers (as societal representatives of future patients), to enroll in RCTs? METHODS We employed the trust version of the prisoner's dilemma since interaction between the patient and researcher in the setting of a clinical trial is inherently based on trust. We also took into account that the patient may have regretted his/her decision to participate in the trial, while a researcher may feel guilty because he/she abused the patient's trust. RESULTS We found that under typical circumstances of clinical research, most patients can be expected not to trust researchers, and most researchers can be expected to abuse the patients' trust. The most significant factor determining trust was the success of experimental or standard treatments, respectively. The more that a researcher believes the experimental treatment will be successful, the more incentive the researcher has to abuse trust. The analysis was sensitive to the assumptions about the utilities related to success and failure of therapies that are tested in RCTs. By varying all variables in the Monte Carlo analysis we found that, on average, the researcher can be expected to honor a patient's trust 41% of the time, while the patient is inclined to trust the researcher 69% of the time. Under assumptions of our model, enrollment into RCTs represents a rational strategy that can meet both patients' and researchers' interests simultaneously 19% of the time. CONCLUSIONS There is an inherent ethical dilemma in the conduct of RCTs. The factors that hamper full co-operation between patients and researchers in the conduct of RCTs can be best addressed by: a) having more reliable estimates on the probabilities that new vs. established treatments will be successful, b) improving transparency in the clinical trial system to ensure fulfillment of "the social contract" between patients and researchers.
Collapse
Affiliation(s)
- Benjamin Djulbegovic
- Center for Evidence-based Medicine and Health Outcome Research, Clinical Translational Science Institute and Department of Internal Medicine, University of South Florida, Tampa, FL, USA
- Departments of Hematology and Health Outcome Behavior, H. Lee Moffitt Cancer Center & Research Institute, Tampa, FL, USA
- 12901 Bruce B. Downs Blvd, MDC02, Tampa, FL, 33612, USA
| | - Iztok Hozo
- Department of Mathematics, Indiana University, Gary, IN, 46408, USA
| |
Collapse
|
44
|
Cook C, Sheets C. Clinical equipoise and personal equipoise: two necessary ingredients for reducing bias in manual therapy trials. J Man Manip Ther 2012. [PMID: 22294855 DOI: 10.1179/106698111x12899036752014.] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/26/2022] Open
Abstract
Clinical and personal equipoise exists when a clinician has no good basis for a choice between two or more care options or when one is truly uncertain about the overall benefit or harm offered by the treatment to his/her patient. For most manual therapy trials, equipoise does not likely exist. Because of the nature of the intervention a lack of equipoise can lead to bias and may account for a portion of the 'effect' that has traditionally been assigned to the intervention. Although there are methodological mechanisms to reduce the risk of bias associated with a lack of equipoise, most of the manual therapy trials to date are likely guilty of this form of bias.
Collapse
Affiliation(s)
- Chad Cook
- Division of Physical Therapy, Walsh University, North Canton, OH, USA
| | | |
Collapse
|
45
|
Abstract
Randomized controlled trials (RCTs) are central to evidence-based clinical and health-policy decisions. However, RCTs highlight the tension between the therapeutic obligations of the physician and the scientific obligations of the investigator. Clinical equipoise, defined as honest professional disagreement among expert clinicians about the preferred treatment, is often cited as the solution to this RCT dilemma. Nevertheless, there are numerous practical and conceptual problems with the notion of equipoise. These problems include its mistaken imposition of therapeutic norms on the scientific enterprise of research, the difficulty of knowing when a state of equipoise exists, the susceptibility of expert judgment to bias and weak evidence, and its inability to support evidence necessary for health-policy decisions. An alternate approach to risk-benefit assessment that is congruent with the scientific purpose of RCTs can better guide ethical evaluation of these trials, as discussed in this Perspective.
Collapse
|
46
|
Parsons NR, Kulikov Y, Girling A, Griffin D. A statistical framework for quantifying clinical equipoise for individual cases during randomized controlled surgical trials. Trials 2011; 12:258. [PMID: 22166100 PMCID: PMC3261829 DOI: 10.1186/1745-6215-12-258] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2011] [Accepted: 12/13/2011] [Indexed: 12/28/2022] Open
Abstract
Background Randomised controlled trials are being increasingly used to evaluate new surgical interventions. There are a number of problematic methodological issues specific to surgical trials, the most important being identifying whether patients are eligible for recruitment into the trial. This is in part due to the diversity in practice patterns across institutions and the enormous range of available interventions that often leads to a low level of agreement between clinicians about both the value and the appropriate choice of intervention. We argue that a clinician should offer patients the option of recruitment into a trial, even if the clinician is not individually in a position of equipoise, if there is collective (clinical) equipoise amongst the wider clinical community about the effectiveness of a proposed intervention (the clinical equipoise principle). We show how this process can work using data collected from an ongoing trial of a surgical intervention. Results We describe a statistical framework for the assessment of uncertainty prior to patient recruitment to a clinical trial using a panel of expert clinical assessors and techniques for eliciting, pooling and modelling of expert opinions. The methodology is illustrated using example data from the UK Heel Fracture Trial. The statistical modelling provided results that were clear and simple to present to clinicians and showed how decisions regarding recruitment were influenced by both the collective opinion of the expert panel and the type of decision rule selected. Conclusions The statistical framework presented has potential to identify eligible patients and assist in the simplification of eligibility criteria which might encourage greater participation in clinical trials evaluating surgical interventions.
Collapse
|
47
|
Djulbegovic B. Uncertainty and equipoise: at interplay between epistemology, decision making and ethics. Am J Med Sci 2011; 342:282-9. [PMID: 21817885 DOI: 10.1097/maj.0b013e318227e0b8] [Citation(s) in RCA: 20] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
In recent years, various authors have proposed that the concept of equipoise be abandoned because it conflates the practice of clinical care with clinical research. At the same time, the equipoise opponents acknowledge the necessity of clinical research if there are unresolved uncertainties about the effects of proposed healthcare interventions. As equipoise represents just 1 measure of uncertainty, proposals to abandon equipoise while maintaining a requirement for addressing uncertainties are contradictory and ultimately not valid. As acknowledgment and articulation of uncertainties represent key scientific and moral requirements for human experimentation, the concept of equipoise remains the most useful framework to link the theory of human experimentation with the theory of rational choice. In this article, I show how uncertainty (equipoise) is at the intersection between epistemology, decision making and ethics of clinical research. In particular, I show how our formulation of responses to uncertainties of hoped-for benefits and unknown harms of testing is a function of the way humans cognitively process information. This approach is based on the view that considerations of ethics and rationality cannot be separated. I analyze the response to uncertainties as it relates to the dual-processing theory, which postulates that rational approach to (clinical research) decision making depends both on analytical, deliberative processes embodied in scientific method (system II), and good human intuition (system I). Ultimately, our choices can only become wiser if we understand a close and intertwined relationship between irreducible uncertainty, inevitable errors and unavoidable injustice.
Collapse
Affiliation(s)
- Benjamin Djulbegovic
- Center and Division for Evidence-based Medicine and Health Outcome Research, Clinical Translational Science Institute, University of South Florida, Tampa, Florida, USA.
| |
Collapse
|
48
|
H Hassanein A, A Herrera F, Hassanein O. Challenges of Randomized Controlled Trial Design in Plastic Surgery. THE CANADIAN JOURNAL OF PLASTIC SURGERY = JOURNAL CANADIEN DE CHIRURGIE PLASTIQUE 2011. [DOI: 10.1177/229255031101900302] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Randomized controlled trials are the gold standard of evidence-based medicine. In the field of plastic surgery, designing these studies is much more challenging than in pharmaceutical medicine. Randomized trials in plastic surgery encompass several road blocks including problems shared with other surgical trials: equipoise, high cost, placebo issues and learning curves following the establishment of a novel approach. In addition, plastic surgery has more subjective outcomes, thus making study design even more difficult in assessing the end result.
Collapse
Affiliation(s)
- Aladdin H Hassanein
- Department of Surgery, University of California San Diego, San Diego, California, USA
| | - Fernando A Herrera
- Department of Surgery, University of California San Diego, San Diego, California, USA
| | - Omar Hassanein
- Department of Surgery, University of California San Diego, San Diego, California, USA
| |
Collapse
|
49
|
Dent L, Raftery J. Treatment success in pragmatic randomised controlled trials: a review of trials funded by the UK Health Technology Assessment programme. Trials 2011; 12:109. [PMID: 21542934 PMCID: PMC3113983 DOI: 10.1186/1745-6215-12-109] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2010] [Accepted: 05/04/2011] [Indexed: 11/19/2022] Open
Abstract
BACKGROUND Previous research reviewed treatment success and whether the collective uncertainty principle is met in RCTs in the US National Cancer Institute portfolio. This paper classifies clinical trials funded by the UK HTA programme by results using the method applied to the US Cancer Institute trials, and compares the two portfolios. METHODS Data on all completed randomised controlled trials funded by the HTA programme 1993-2008 were extracted. Each trial's primary results was classified into six categories; 1) statistically significant in favour of the new treatment, 2) statistically significant in favour of the control treatment 3) true negative, 4) truly inconclusive, 5) inconclusive in favour of new treatment or 6) inconclusive in favour of control treatment. Trials were classified by comparing the 95% confidence interval for the difference in primary outcome to the difference specified in the sample size calculation. The results were compared with Djulbegovic's analysis of NCI trials. RESULTS Data from 51 superiority trials were included, involving over 48,000 participants and a range of diseases and interventions. 85 primary comparisons were available because some trials had more than two randomised arms or had several primary outcomes. The new treatment had superior results (whether significant or not) in 61% of the comparisons (52/85 95% CI 49.9% to 71.6%). The results were conclusive in 46% of the comparisons (19% statistically significant in favour of the new treatment, 5% statistically significant in favour of the control and 22% true negative). The results were classified as truly inconclusive (i.e. failed to answer the question asked) for 24% of comparisons (20/85). HTA trials included fewer truly inconclusive and statistically significant results and more results rated as true negative than NCI trials. CONCLUSIONS The pattern of results in HTA trials is similar to that of the National Cancer Institute portfolio. Differences that existed were plausible given the differences in the types of trials -HTA trials are more pragmatic. The results indicate HTA trials are compatible with equipoise. This classification usefully summarises the results from clinical trials and enables comparisons of different portfolios of trials.
Collapse
Affiliation(s)
- Louise Dent
- University of Southampton Clinical Trials Unit, MP131, Southampton General Hospital, SO16 6YD, UK
| | - James Raftery
- NIHR Evaluation, Trials and Studies Coordinating Centre, University of Southampton, Southampton, SO16 7NS, UK
| |
Collapse
|
50
|
Hassanein AH, Herrera FA, Hassanein O. Challenges of randomized controlled trial design in plastic surgery. THE CANADIAN JOURNAL OF PLASTIC SURGERY = JOURNAL CANADIEN DE CHIRURGIE PLASTIQUE 2011; 19:e28-e29. [PMID: 22942666 PMCID: PMC3269337] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Subscribe] [Scholar Register] [Indexed: 06/01/2023]
Abstract
Randomized controlled trials are the gold standard of evidence-based medicine. In the field of plastic surgery, designing these studies is much more challenging than in pharmaceutical medicine. Randomized trials in plastic surgery encompass several road blocks including problems shared with other surgical trials: equipoise, high cost, placebo issues and learning curves following the establishment of a novel approach. In addition, plastic surgery has more subjective outcomes, thus making study design even more difficult in assessing the end result.
Collapse
Affiliation(s)
- Aladdin H Hassanein
- Correspondence: Dr Aladdin H Hassanein, Department of Surgery, University of California San Diego, 200 West Arbor Drive, San Diego, California 92103, USA. Telephone 619-543-6711, fax 619-543-5869, e-mail
| | | | | |
Collapse
|