1
|
Nel D, Jonas E, Burch V, Cairncross L, Nel A, Alseidi A, George B, Ten Cate O. Entrustable Professional Activities in Postgraduate General Surgery Training: A Scoping Review. Ann Surg 2025; 281:960-967. [PMID: 38881436 DOI: 10.1097/sla.0000000000006400] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/18/2024]
Abstract
OBJECTIVE To provide an overview of the current use of Entrustable Professional Activities (EPAs) in postgraduate general surgery training internationally. BACKGROUND Entrustable Professional Activities (EPAs) were introduced to connect clinical competencies and the professional activities to be entrusted to trainees on graduation. The popularity of EPAs as a framework for assessment is growing globally, including in general surgery. Anecdotally, there appears to be substantial variation in how they are implemented, yet a formal comparison of their use in postgraduate general surgery training is lacking. METHODS A scoping review was performed based on the original 5-stage approach described by Arksey and O'Malley with the addition of protocol-specific items from the Preferred Reporting Items for Systematic Reviews and Meta-Analysis Protocols extension for scoping reviews (PRISMA-ScR). RESULTS Twenty-nine published and grey literature sources were included in the review. Entrustable Professional Activity use in postgraduate general surgery training was identified in 11 unique contexts, including from North America, South America, Europe, Asia, Africa, and Australia. There were substantial differences in the scope and number of EPAs, tools used for EPA assessment, and how EPAs were sequenced through training. Despite the wide variation, 8 distinct EPAs were common to the majority (>80%) of countries. Several articles described findings of EPA use in postgraduate general surgery training, allowing the identification of multiple barriers and facilitators to integration. CONCLUSIONS This review provides guidance for certification and regulatory bodies, program directors, and institutions with ambitions to implement EPAs for assessment and curricular design. In settings where EPAs are already used, the data may facilitate the refinement of programs and strategies.
Collapse
Affiliation(s)
- Daniel Nel
- Department of Surgery, Groote Schuur Hospital and University of Cape Town, Cape Town, South Africa
| | - Eduard Jonas
- Department of Surgery, Groote Schuur Hospital and University of Cape Town, Cape Town, South Africa
| | - Vanessa Burch
- Department of Medicine, Groote Schuur Hospital and University of Cape Town, and the Colleges of Medicine of South Africa
| | - Lydia Cairncross
- Department of Surgery, Groote Schuur Hospital and University of Cape Town, Cape Town, South Africa
| | - Amy Nel
- Department of Public Health, University of Cape Town, South Africa
| | - Adnan Alseidi
- Department of Surgery, University of California, San Francisco, CA
| | - Brian George
- Center for Surgical Training and Research, Department of Surgery, University of Michigan, Ann Arbor, MI
| | - Olle Ten Cate
- Center for Research and Development of Education, University Medical Centre Utrecht, Utrecht, The Netherlands
| |
Collapse
|
2
|
Smaoui S, Ganesan S, Williams T. Dysphagia education in Addis Ababa, Ethiopia: student self-competency ratings during their dysphagia course. BMC MEDICAL EDUCATION 2025; 25:737. [PMID: 40394575 DOI: 10.1186/s12909-025-07365-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Received: 12/03/2024] [Accepted: 05/19/2025] [Indexed: 05/22/2025]
Abstract
PURPOSE Training programs focused on dysphagia have been identified as an area needing improvement due to the specialized skills required to provide clinical care to patients with dysphagia. Globally, a lack of standardized training has been recognized and has led to the introduction of competency and training frameworks in the clinical practice of dysphagia. Previous studies have explored the experiences of students in training programs and their self-perceived competency; however, none have explored this in the Ethiopian context due to the infancy of the Speech Language Therapy (SLT) profession within this region. The objectives of this study were to explore patterns in self-perceived competency ratings for SLT students at AAU and determine the impact of clinical experiences during student training. METHODS First- and second-year students enrolled in the two-year SLT Master's program in Ethiopia were taught the dysphagia course in a combined class in English by visiting faculty. A modified Dysphagia Competency Verification Tool (DCVT) was used to assess self-perception of competency in dysphagia. The tool was administered in April 2024, before any dysphagia-related clinical exposure occurred and once again in May 2024, after clinical exposure to patients with dysphagia occurred. Generalized estimating equations (GEE) models were used for the General Skills (DCVT-GS) and Direct Patient Care (DCVT-DPC) subtests to study variations in responses for self-perceived competency. The models included covariates of sex, background in SLT, dysphagia-specific patient exposure and a repeated factor of survey timepoint. RESULTS In total, 38 responses were collected across two time points and from all 19 participants. The SLT students were mostly female (n = 16; 84%) with ages ranging from 21 to 46 years. The GEE model for DCVT-GS identified significant main effects of background in SLT (p = 0.018), dysphagia patient exposure (p = 0.019), and survey timepoint (p < 0.001). The GEE model for DCVT-DPC demonstrated significance for background in SLT (p < 0.001), dysphagia patient exposure (p = 0.009), and sex (p = 0.031). CONCLUSION Regardless of DCVT domain, SLT graduate student clinicians were more likely to perceive themselves as "adequate" in their ratings at the second timepoint following clinical interactions, if they had prior SLT experience, including prior dysphagia experience. Training programs exploring dysphagia competency are encouraged to provide increased exposure to patients with dysphagia to support increased self-perceived competency scores.
Collapse
Affiliation(s)
- Sana Smaoui
- Department of Hearing and Speech Sciences, Faculty of Allied Health Sciences, Kuwait University, Kuwait City, Kuwait.
- Li Ka Shing Knowledge Institute, St. Michael's Hospital, Unity Health Toronto, Toronto, ON, Canada.
- Department of Speech-Language Pathology, Faculty of Medicine, University of Toronto, Toronto, ON, Canada.
- Division of Otolaryngology-Head and Neck Surgery, The George Washington University School of Medicine & Health Sciences, Washington, DC, USA.
| | - Sandhya Ganesan
- Division of Otolaryngology-Head and Neck Surgery, The George Washington University School of Medicine & Health Sciences, Washington, DC, USA
- The Renaissance School of Medicine at Stony Brook University, Stony Brook, NY, USA
| | - Trish Williams
- Department of Speech-Language Pathology, Faculty of Medicine, University of Toronto, Toronto, ON, Canada
- Toronto General Hospital, University Health Network, Toronto, ON, Canada
| |
Collapse
|
3
|
Pillai BB, Ip E, James KS, Martin J. Surgical Trainees' Lived Experience of Entrustable Professional Activities: Assessment in the Australasian Context. ANZ J Surg 2025. [PMID: 40353557 DOI: 10.1111/ans.70171] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2025] [Revised: 04/27/2025] [Accepted: 05/01/2025] [Indexed: 05/14/2025]
Abstract
BACKGROUND The Royal Australasian College of Surgeons' Board in General Surgery implemented Entrustable Professional Activities (EPAs) in its competency-based training programme in 2022. As this is a new method for surgical trainees, a qualitative study was performed to evaluate its implementation and use by exploring the pioneer trainees' perceptions and experiences of EPAs. METHODS Seven first-year general surgery trainees were recruited to participate in semi-structured interviews. The interviews explored the trainees' experiences of EPAs, their perceptions of the effect on their independence with completing clinical activities and patient safety, and their suggestions for how to improve this form of assessment in the training program. RESULTS The findings of the study suggest that EPAs can be a useful tool for assessing the competence of trainees. However, the study also found that EPAs can be challenging for trainees, particularly in terms of the level of self-regulation and independence required. CONCLUSION Although EPAs may positively contribute to a trainee's experience, considerations to support trainees and trainers in their practical implementation may increase the value of the learning encounter. Graded assessment of entrustment and explicit year-level milestone progress points could promote more effective learning and support developmental feedback by trainers.
Collapse
Affiliation(s)
- Balakavitha Balaravi Pillai
- University of Edinburgh, Edinburgh, Scotland, UK
- Eastern Health Clinical School, Monash University, Australia
- Eastern Health, Melbourne, Australia
| | | | | | - Jenepher Martin
- Eastern Health Clinical School, Monash University, Australia
- Eastern Health, Melbourne, Australia
| |
Collapse
|
4
|
Zhang Y, Zhang A, Jiao X, Zhao D, Zhang Y, Yue T, Yang K, Zhao C. Entrustable professional activities for pediatric and subspecialties residency training in China. BMC MEDICAL EDUCATION 2025; 25:697. [PMID: 40355914 PMCID: PMC12070538 DOI: 10.1186/s12909-025-07231-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/15/2024] [Accepted: 04/25/2025] [Indexed: 05/15/2025]
Abstract
BACKGROUND AND OBJECTIVES Outcome-based medical education is the latest focus in the past decade, and Entrustable Professional Activities(EPAs) have emerged as efficient vehicles to assess physicians. However, few studies have discussed the use of EPAs for residency training in pediatric medicine and its subspecialties. We conducted a pilot study to examine the feasibility of EPAs as a component of the clinical program of assessment in pediatric standardized residency training. METHODS We conducted a cross-sectional study for standardized residency training in different subspecialties within pediatric medicine at Qilu Hospital of Shandong University. Totally 65 residents and 35 directors joined in this study. An electronic EPA survey using 8 scales composed of 15 categories was distributed among residents and directors. Kruskal-Wallis test and Mann-Whitney U test were applied for comparing the self-assessments and director-assessments. Generalized estimated equation (GEE) was used to analyze the effect of postgraduate year(PGY), gender, and position on the EPA scores of director assessments. RESULTS A total of 401 director-assessment and 65 residents' self-assessment ( response rate 100%) questionnaires were collected, both demonstrating rising trends in scores across PGYs. Significant differences were found between PGY1 and PGY2 (p < 0.01) and between PGY1 and PGY3 (p < 0.01), but not between PGY2 and PGY3 (p > 0.01). With an effect analysis of PGY, gender, and position on EPA scores performed, PGY had a significant effect on 13 out of 15 EPA scores, while gender affected only four EPA scores significantly, and position affected only three EPA categories. Meanwhile, some EPA categories revealed significant differences across various pediatric subspecialties (p < 0.01). CONCLUSIONS The study findings suggest that EPA assessments is feasible among different PGYs in standardized Chinese residency training in pediatric medicine and its subspecialties. Postgraduate year had a significant impact on EPA scores, while gender and resident position also affected EPA scores to a certain extent. Improved stratified teaching programs are required for better subspecialty consistency.
Collapse
Affiliation(s)
- Yun Zhang
- Department of Pediatrics, Qilu Hospital of Shandong University, West Wenhua Road, Jinan, 250012, China
- Medical Training Office, Qilu Hospital of Shandong University, Jinan, China
| | - Aijun Zhang
- Department of Pediatrics, Qilu Hospital of Shandong University, West Wenhua Road, Jinan, 250012, China
| | - Xiaoyu Jiao
- Department of Pediatrics, Qilu Hospital of Shandong University, West Wenhua Road, Jinan, 250012, China
| | - Dongxiu Zhao
- Medical Training Office, Qilu Hospital of Shandong University, Jinan, China
| | - Yuankai Zhang
- Medical Training Office, Qilu Hospital of Shandong University, Jinan, China
| | - Tong Yue
- Medical Training Office, Qilu Hospital of Shandong University, Jinan, China
| | - Ke Yang
- Medical Training Office, Qilu Hospital of Shandong University, Jinan, China
| | - Cuifen Zhao
- Department of Pediatrics, Qilu Hospital of Shandong University, West Wenhua Road, Jinan, 250012, China.
| |
Collapse
|
5
|
Smit MP, van der Velden JAEM, Gemke RJBJ, van Loon KA, de Hoog M. Residents' Experiences of Learning, Working, and Developing in Entrustable Professional Activity-Based Training. PERSPECTIVES ON MEDICAL EDUCATION 2025; 14:255-263. [PMID: 40351519 PMCID: PMC12063573 DOI: 10.5334/pme.1464] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Received: 07/08/2024] [Accepted: 04/10/2025] [Indexed: 05/14/2025]
Abstract
Introduction Entrustable Professional Activity (EPA)-based residency programmes are designed to offer structure, flexibility, and a gradual increase in autonomy. While residents are expected to take an active role in their learning, little is known about how they actually experience learning and working within the EPA framework. This study explores paediatric residents' experiences of learning, working, and developing within an EPA-based training programme. Methods We conducted a qualitative study using semi-structured interviews with 11 paediatric residents from three of the seven Dutch training regions. Interviews were transcribed verbatim, anonymised, and analysed using template analysis to identify themes related to residents' learning and professional development within EPA-based training. Results Residents described increasing confidence and competence in the phase prior to entrustment. Some linked this development to the EPA structure, as it supported goal setting and feedback-seeking, while others attributed this development primarily to learning through clinical experience.The entrustment decision process-particularly the Clinical Competence Committee (CCC) feedback-was seen as reassuring, though residents also described discomfort with being evaluated by a group. After entrustment, residents experienced greater autonomy but noted variation in supervision practices. Some felt unsure about when to request supervision, particularly in apparently straightforward settings. Others described feeling empowered to pursue individualised learning opportunities. Discussion In reflecting on these findings, we drew on the concept of Self-Regulated Learning to explore how residents engaged with their training. Making these principles more explicit within EPA-based programmes may support residents in optimising their learning and strengthen their preparation for independent practice.
Collapse
Affiliation(s)
- Maaike P. Smit
- Erasmus MC-Sophia Children’s Hospital, Department of Neonatal & Pediatric Intensive Care, Division of Pediatric Intensive Care, University Medical Center Rotterdam, The Netherlands
| | | | | | - Karsten A. van Loon
- Department for Postgraduate Medical Training, Amsterdam University Medical Center, The Netherlands
| | - Matthijs de Hoog
- Erasmus MC-Sophia Children’s Hospital, Department of Neonatal & Pediatric Intensive Care, Division of Pediatric Intensive Care, University Medical Center Rotterdam, The Netherlands
| |
Collapse
|
6
|
Kosić N, Gerhardt-Szép S. Twenty-one Entrusted Professional Activities in German Dental Education-Day-One Competencies. J Dent Educ 2025:e13931. [PMID: 40317480 DOI: 10.1002/jdd.13931] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2024] [Revised: 04/08/2025] [Accepted: 04/18/2025] [Indexed: 05/07/2025]
Abstract
INTRODUCTION In medical education, entrusted professional activities (EPAs) have been an integral part of the curriculum, primarily being used in clinical traineeships and postgraduate medical education. The use of EPAs in postgraduate medical education is transferable to dental training, as clinical skills are already part of the curriculum. The data from this study could help propose dental EPAs that reflect competencies expected in the professional field, potentially aiding in more effectively evaluating student competencies and standardizing assessment criteria. METHODS After research on the use of EPAs in dental education across Europe, Asia, and the United States, 21 EPAs were chosen, covering all areas currently taught in the German dental graduate program, and matched with the domains of the National Catalog of Learning Objectives in Dentistry. Following, an electronic survey was developed and distributed to dentists working at university hospitals in the Rhine-Main region, as well as in private practices. Participants were asked to evaluate each EPA statement on a 6-point Likert scale and encouraged to provide qualitative feedback on the EPAs. RESULTS 120 participants responded to the survey (20.7%). Overall, there was substantial agreement on the EPAs chosen to represent the tasks expected of young dentists on their first day in practice. Participants also provided qualitative feedback in the form of optional comments. Concerns raised included the perceived lack of experience for certain tasks. CONCLUSION The data from this study suggest that the proposed EPAs accurately reflect the professional tasks expected of newly graduated dentists on their first day in practice.
Collapse
Affiliation(s)
- Nejra Kosić
- Department of Operative Dentistry, Center of Dentistry and Oral Medicine (Carolinum), Goethe University Frankfurt, Frankfurt am Main, Germany
| | - Susanne Gerhardt-Szép
- Department of Operative Dentistry, Center of Dentistry and Oral Medicine (Carolinum), Goethe University Frankfurt, Frankfurt am Main, Germany
| |
Collapse
|
7
|
Schumacher DJ, Michelson C, Winn A, Henry D, O'Connor M, Li STT, Blair RJ, Velazquez-Campbell M, Kihlstrom MJ, Borman-Shoap E, Ponitz K, Salvador-Sison J, Kinnear B, Turner DA, Martini A, Burrows HL, Patel R, Newhall LM, Osborn R, Mallory M, Scheurer JM, Grant M, Myers RE, Griego EC, Kravtchenko S, Jain S, Vu T, Schwartz A. Graduating Residents' Readiness for Unsupervised Practice. Pediatrics 2025; 155:e2024070307. [PMID: 40199502 DOI: 10.1542/peds.2024-070307] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/09/2024] [Accepted: 01/28/2025] [Indexed: 04/10/2025] Open
Abstract
OBJECTIVE This study sought to determine whether graduating residents were deemed ready for unsupervised practice for each of the 17 general pediatrics entrustable professional activities (EPAs). METHODS At the end of the 2021-22, 2022-23, and 2023-24 academic years, the authors collected entrustment-supervision levels assigned by clinical competency committees for graduating residents from pediatric and medicine/pediatrics residency training programs to determine readiness for unsupervised practice at the time of graduation. They did this for each of the general pediatrics EPAs and examined the levels reported to determine the proportion of residents ready for unsupervised practice on each EPA and on all EPAs. They compared rates of readiness by academic year using a mixed-effects logistic regression model. RESULTS Across all EPAs, 33 190 total entrustment-supervision levels were reported for 2276 graduating pediatrics residents, and 2607 entrustment-supervision levels were reported for 168 graduating medicine/pediatrics residents. There were no EPAs in which programs reported more than 89% of residents as ready for unsupervised practice at the time of graduation. Only 31.3% of graduating residents with observations on all EPAs (414/1322) were deemed ready for unsupervised practice for all EPAs. Graduating medicine/pediatrics residents were more likely than pediatrics residents to be deemed ready for all EPAs (P = .002). Across study years, the rates of readiness at graduation for all EPAs rose from 18.0% to 38.5% (linear contrast P < .001). CONCLUSION While there are reasons beyond actual resident readiness that may contribute, this study highlights a gap in readiness for unsupervised practice at the time of graduation.
Collapse
Affiliation(s)
- Daniel J Schumacher
- Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio
- Department of Pediatrics, University of Cincinnati College of Medicine, Cincinnati, Ohio
| | - Catherine Michelson
- Department of Pediatrics, Northwestern Feinberg School of Medicine, Chicago, Illinois
| | - Ariel Winn
- Department of Pediatrics, Harvard Medical School, Boston, Massachusetts
| | - Duncan Henry
- Department of Pediatrics, University of California, San Francisco, San Francisco, California
| | - Meghan O'Connor
- Department of Pediatrics, University of Utah, Salt Lake City, Utah
| | - Su-Ting T Li
- Department of Pediatrics, University of California Davis, Sacramento, California
| | - Robyn J Blair
- Department of Pediatrics, Stony Brook University Renaissance School of Medicine, Stony Brook, New York
| | | | - Margaret J Kihlstrom
- Department of Pediatrics, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina
| | - Emily Borman-Shoap
- Department of Pediatrics, University of Minnesota Medical School, Minneapolis, Minnesota
| | - Keith Ponitz
- Department of Pediatrics, Case Western Reserve University School of Medicine, Cleveland, Ohio
| | | | - Benjamin Kinnear
- Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio
- Department of Pediatrics, University of Cincinnati College of Medicine, Cincinnati, Ohio
- Department of Internal Medicine, University of Cincinnati College of Medicine, Cincinnati, Ohio
| | - David A Turner
- American Board of Pediatrics, Chapel Hill, North Carolina
| | - Abigail Martini
- Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio
| | - Heather L Burrows
- Department of Pediatrics, The University of Michigan, Ann Arbor, Michigan
| | - Rita Patel
- Jane Pauley Community Health Center, Indianapolis, Indiana
| | - Lauren M Newhall
- Department of Pediatrics, Medical College of Georgia at Augusta University, Augusta, Georgia
| | - Rachel Osborn
- Department of Pediatrics, Yale School of Medicine, New Haven, Connecticut
| | - Mia Mallory
- Department of Pediatrics, Duke University School of Medicine, Durham, North Carolina
| | - Johannah M Scheurer
- Department of Pediatrics, University of Minnesota Medical School, Minneapolis, Minnesota
| | - Matthew Grant
- Department of Pediatrics, University of Maryland School of Medicine, Baltimore, Maryland
| | - Ross E Myers
- Department of Pediatrics, Case Western Reserve University School of Medicine, Cleveland, Ohio
| | - Elena C Griego
- Department of Pediatrics, University of Washington School of Medicine, Seattle, Washington
| | | | - Shivika Jain
- Ascension St Vincent/Peyton Manning Children's Hospital, Indianapolis, Indiana
| | - Thao Vu
- Department of Pediatrics, University of Florida Health Shands Children's Hospital, Gainesville, Florida
| | - Alan Schwartz
- Departments of Medical Education and Pediatrics, University of Illinois Chicago, Chicago, Illinois
| |
Collapse
|
8
|
Violato C, Englander R, Dale E, Gauer JL. Implementing Core Entrustable Professional Activities in Undergraduate Medical Education: A Psychometric Study. ACADEMIC MEDICINE : JOURNAL OF THE ASSOCIATION OF AMERICAN MEDICAL COLLEGES 2025; 100:585-591. [PMID: 39485120 DOI: 10.1097/acm.0000000000005907] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/03/2024]
Abstract
PURPOSE This study examines the feasibility and psychometric results of an assessment of entrustable professional activities (EPAs) as a core component of the clinical program of assessment in undergraduate medical education, assesses the learning curves for each EPA, explores the time to entrustment, and investigates the dependability of the EPA data based on generalizability theory (G theory) analysis. METHOD Third-year medical students from the University of Minnesota Medical School in 7 required clerkships from May 2022 through April 2023 were assessed. Students were required to obtain at least 4 EPA assessments per week on average from clinical faculty, residents supervising the students, or assessment and coaching experts. Student ratings were depicted as curves describing their performance over time; regression models were used to fit the curves. RESULTS The complete class of 240 (138 women [58.0%] and 102 men [42.0%]) third-year medical students at the University of Minnesota Medical School (mean [SD] age at matriculation, 24.2 [2.7] years) participated. There were 32,614 EPA-based assessments (mean [SD], 136 [29.6] assessments per student). Reliability analysis using G theory found that an overall score dependability of 0.75 (range, 0-1) was achieved with 4 assessors on 4 occasions. The desired level of entrustment by academic year end was met by all 240 students (100%) for EPAs 1, 6, and 7, 237 (98.8%), 236 (98.3%), and 218 (90.8%) students for EPAs 2, 5, and 9, respectively, 197 students (82.1%) for EPA 3, 178 students (74.2%) for EPA 4, and 145 students (60.4%) for EPA 12. The most rapid growth was for EPA 2 (β 0 = .286), followed by EPA 1 (β 0 = .240), EPA 4 (β 0 = .236), and EPA 10 (β 0 = .230). CONCLUSIONS The study findings suggest that EPA ratings provide reliable and dependable data to make entrustment decisions about students' performance.
Collapse
|
9
|
Hentzen C, Remy-Neris O, Pradeau C, Bensoussan L, Boyer FC, Daviet JC, Nguyen C, De Boissezon X. Developing entrustable professional activities for residents in physical and rehabilitation medicine: A Delphi study. Ann Phys Rehabil Med 2025; 68:101978. [PMID: 40252604 DOI: 10.1016/j.rehab.2025.101978] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2024] [Revised: 03/04/2025] [Accepted: 03/06/2025] [Indexed: 04/21/2025]
Abstract
Entrustable professional activities (EPAs) are set to assess residents' capacity to perform professional units close to the context of their future clinical practice. The aim was to define a concise list of EPAs covering the broad specialty of Physical and Rehabilitation Medicine (PRM) to implement a systematic and consistent assessment of trainees' competencies during their residency. A list of EPAs was developed based on a literature review and working group. This list was then submitted to academic PRM professors for validation via a Delphi process. Two rounds were planned with intermediate and final discussion meetings by an external steering committee. Ten EPAs were developed in a first draft. Each of the seven parts of the EPAs obtained validation through the Delphi process. A list of 11 clinical contexts of application was approved to integrate the EPAs in the different areas of PRM. The next step will be the deployment of these EPAs for the validation of residency internships.
Collapse
Affiliation(s)
- Claire Hentzen
- Sorbonne University, GRC 01, GREEN Group of clinical REsEarch in Neurourology, AP-HP, Hôpital Pitié Salpétrière, 43-87 bd de l'Hôpital, F-75013 Paris, France.
| | - Olivier Remy-Neris
- Université de Brest, CHU de Brest, INSERM, UMR 1101, 22 rue Camille Desmoulins, Brest 29200, France
| | - Charles Pradeau
- Hôpitaux Universitaires de Strasbourg, Pôle de médecine Physique et de Réadaptation, 1 pl de l'Hôpital, Strasbourg 67000, France; Institut Universitaire de Réadaptation Clemenceau, Pôle de Médecine Physique et de Réadaptation, 45 bd Clemenceau, Strasbourg 67000, France; Université de Strasbourg, Unité de Recherche 3072, Centre Européen d'Enseignement, de Recherche et d'Innovation en Physiologie de l'exercice, 1 pl de l'Hôpital, Strasbourg 67000, France
| | - Laurent Bensoussan
- Aix Marseille Université, CNRS, INT UMR 7289, 27 bd Jean Moulin - 13005 Marseille, France; Department of Physical and Rehabilitation Medicine, Marseille University Hospital, 64, rue Saint Pierre, 13385 Marseille CEDEX, France; UGECAM Institut Universitaire de Réadaptation de Valmante Sud, Marseille 13009, France
| | - François Constant Boyer
- Unités de Médecine Physique et de Réadaptation, UR3797 VieFra, Université Reims Champagne Ardenne (URCA), Centre Hospitalier Universitaire de Reims, Hôpital Sébastopol, 48 rue de Sébastopol, Reims Cedex 51098, France
| | - Jean-Christophe Daviet
- Université de Limoges, HAVAE, UR 20217, 123 avenue Albert Thomas, Limoges Cedex 87060, France; CHU Limoges, Department Physical Medicine and Rehabilitation, 2 Av. Martin Luther King, Limoges 87000, France
| | - Christelle Nguyen
- Université Paris Cité, Faculté de Santé, UFR de Médecine, 15 Rue de l'École de Médecine, Paris 75006, France; AP-HP.Centre-Université Paris Cité, Service de Rééducation et de Réadaptation de l'Appareil Locomoteur et des Pathologies du Rachis, Hôpital Cochin, 27 Rue du Faubourg Saint-Jacques, Paris 75014, France; INSERM UMR-S 1124, Campus Saint-Germain-des-Prés, 45 Rue des Saints-Pères, Paris 75006, France
| | - Xavier De Boissezon
- ToNIC, Université de Toulouse, Inserm, UT3, Pl. du Dr Joseph Baylac, Toulouse 31300, France; Department of Physical and Rehabilitation Medicine, Pole Neurosciences, University Hospital of Toulouse, Hôpital de Purpan, Pl. du Dr Joseph Baylac, Toulouse 31300, France
| |
Collapse
|
10
|
Fleck L, Amelung D, Fuchs A, Mayer B, Escher M, Listunova L, Schultz JH, Möltner A, Schütte C, Wittenberg T, Schneider I, Herpertz SC. Interactional competencies in medical student admission- what makes a "good medical doctor"? ADVANCES IN HEALTH SCIENCES EDUCATION : THEORY AND PRACTICE 2025; 30:439-458. [PMID: 39008161 PMCID: PMC11965163 DOI: 10.1007/s10459-024-10348-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/12/2023] [Accepted: 06/02/2024] [Indexed: 07/16/2024]
Abstract
Doctors' interactional competencies play a crucial role in patient satisfaction, well-being, and compliance. Accordingly, it is in medical schools' interest to select candidates with strong interactional abilities. While Multiple Mini Interviews (MMIs) provide a useful context to assess such abilities, the evaluation of candidate performance during MMIs is not always based on a solid theoretical framework. The newly developed selection procedure "Interactional Competencies - Medical Doctors (IC-MD)" uses an MMI circuit with five simulation patient scenarios and is rated based on the theoretically and empirically grounded construct of emotional availability. A first validation study with N = 70 first-semester medical students took place in 2021. In terms of convergent validity, IC-MD ratings showed strong correlations with simulation patients' satisfaction with the encounter (r =.57) but no association with emotional intelligence measures. IC-MD ratings were not related to high school performance or a cognitive student aptitude test, indicating divergent validity. Inter-rater reliability (ICC = 0.63) and generalizability (Eρ2 = 0.64) were satisfactory. The IC-MD proved to be fair regarding participants' age and gender. Participants with prior work experience in healthcare outperformed those without such experience. Participant acceptance of the procedure were good. The IC-MD is a promising selection procedure capable of assessing interactional competencies relevant to the medical setting. Measures of interactional competencies can complement the use of cognitive selection criteria in medical student admission. The predictive validity of the IC-MD needs to be addressed in future studies.
Collapse
Affiliation(s)
- Leonie Fleck
- Medical Faculty, Heidelberg University, Heidelberg, Germany
- Central Institute of Mental Health, Mannheim, Germany
| | | | - Anna Fuchs
- Department of Child & Adolescent Psychiatry, University of Heidelberg, Heidelberg, Germany
| | - Benjamin Mayer
- Medical Faculty, Heidelberg University, Heidelberg, Germany
| | - Malvin Escher
- Medical Faculty, Heidelberg University, Heidelberg, Germany
| | - Lena Listunova
- Medical Faculty, Heidelberg University, Heidelberg, Germany
| | - Jobst-Hendrik Schultz
- Department of General Internal Medicine and Psychosomatics, University of Heidelberg, Heidelberg, Germany
| | | | - Clara Schütte
- Medical Faculty, Heidelberg University, Heidelberg, Germany
| | - Tim Wittenberg
- Medical Faculty, Heidelberg University, Heidelberg, Germany
| | - Isabella Schneider
- Department of General Psychiatry, Heidelberg University Hospital, Voßstraße 4, 69115, Heidelberg, Germany.
| | - Sabine C Herpertz
- Medical Faculty, Heidelberg University, Heidelberg, Germany
- Department of General Psychiatry, Heidelberg University Hospital, Voßstraße 4, 69115, Heidelberg, Germany
| |
Collapse
|
11
|
Guo F, Chen Y, Hsu W, Wang P, Chen M, Chen J. EMYWAY Workplace-Based Entrustable Professional Activities Assessments in Otolaryngology Residency Training: A Nationwide Experience. Otolaryngol Head Neck Surg 2025; 172:1242-1253. [PMID: 39739526 PMCID: PMC11947863 DOI: 10.1002/ohn.1104] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2024] [Revised: 11/20/2024] [Accepted: 12/08/2024] [Indexed: 01/02/2025]
Abstract
OBJECTIVE To present workplace-based entrustable professional activities (EPAs) assessment data from the first 2 years of the EMYWAY platform in otolaryngology residency training in Taiwan. STUDY DESIGN Two-year cross-sectional study. SETTING Otolaryngology training programs. METHODS In 2020, the Taiwan Society of Otorhinolaryngology-Head and Neck Surgery (TSO-HNS) developed a workplace-based assessment (WBA) framework with 11 EPAs, integrating milestones to evaluate resident competency. In 2021, TSO-HNS piloted the EMYWAY platform for WBAs, which includes an EPA-based assessment workflow, coaching feedback, and a dashboard displaying residents' entrustment-supervision levels. Data are analyzed annually for accreditation and curriculum enhancement. This study reports on the pilot year and the first full-scale year of implementation. RESULTS Eleven programs participated in the pilot year. Subsequently, 362 faculty members and 274 resident physicians from 34 programs nationwide engaged with EMYWAY. In the full-scale year from August 2022 to July 2023, 9805 responses were recorded, primarily from surgical theaters (45.9%; 4502/9805) and third-year residents (23.8%; 2331/9805). The most frequently evaluated EPAs were "head and neck" (17.5%; 1716/9805), "sinonasal" (13.5%; 1324/9805), and "ear" (12.2%; 1193/9805), with task complexity increasing with resident seniority (P < .0001). A positive correlation was found between residents' self-assessments and faculty members' ratings (r = 0.531; P < .001). Over 98.2% of residents and 88.4% of faculty members provided substantial feedback (>10 words). Analysis of WBAs reported by training programs identified faculty development targets and teaching-intensive tasks. CONCLUSION EMYWAY effectively documents workplace learning and tracks resident competency progression. Continuous improvement of WBA quality is essential for advancing the competency-based medical education ecosystem.
Collapse
Affiliation(s)
- Fang‐Cen Guo
- School of Medicine, College of MedicineFu Jen Catholic UniversityNew Taipei CityTaiwan
| | - Yu‐Ting Chen
- School of Medicine, College of MedicineFu Jen Catholic UniversityNew Taipei CityTaiwan
| | - Wei‐Chung Hsu
- Department of Otolaryngology–Head and Neck SurgeryNational Taiwan University Hospital and Children's HospitalTaipeiTaiwan
| | - Pa‐Chun Wang
- Department of Otolaryngology–Head and Neck SurgeryCathay General HospitalTaipeiTaiwan
| | - Mingchih Chen
- Department of Medical Management, Graduate Institute of Business AdministrationFu Jen Catholic UniversityNew Taipei CityTaiwan
- Center for Artificial Intelligence DevelopmentFu Jen Catholic UniversityNew Taipei CityTaiwan
| | - Jeng‐Wen Chen
- Department of Otolaryngology–Head and Neck SurgeryNational Taiwan University Hospital and Children's HospitalTaipeiTaiwan
- Department of Medical Management, Graduate Institute of Business AdministrationFu Jen Catholic UniversityNew Taipei CityTaiwan
- Department of Otolaryngology–Head and Neck Surgery, Cardinal Tien Hospital and School of MedicineFu Jen Catholic UniversityNew Taipei CityTaiwan
- Department of Education and ResearchCardinal Tien Junior College of Healthcare and ManagementNew Taipei CityTaiwan
| |
Collapse
|
12
|
Watt K, Jalbert I, Jhala P, Robinson L. Could entrustable professional activities support assessment in optometric clinical education in Australia and New Zealand? Clin Exp Optom 2025; 108:240-247. [PMID: 39832452 DOI: 10.1080/08164622.2024.2448230] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2024] [Revised: 12/20/2024] [Accepted: 12/23/2024] [Indexed: 01/22/2025] Open
Abstract
Entrustable professional activities (EPAs) are increasingly being adopted as an assessment tool by medicine and other health professions in a bid to enhance competency-based health professional education. EPAs are well-defined professional activities that can be entrusted to students to perform with varying levels of supervision. They were introduced to overcome some of the limitations of traditional assessment methods of competency such as individual skills assessment or Direct Observation of Procedures and Objective Structured Clinical Examinations. Could EPAs be beneficial in Australian and New Zealand optometric clinical education for advanced skills training and accreditation including the credentialing assessment of overseas educated practitioners? This paper discusses the historical context of how competencies were introduced and assessed in Australian optometry, the evolution of the concept of EPAs in medicine and other health professions, their design and implementation worldwide and whether EPAs could be adopted into optometric training and assessment in Australia and New Zealand.
Collapse
Affiliation(s)
- Kathleen Watt
- School of Optometry and Vision Science, UNSW Sydney, Sydney, Australia
| | - Isabelle Jalbert
- School of Optometry and Vision Science, UNSW Sydney, Sydney, Australia
| | - Prashant Jhala
- School of Clinical Medicine, UNSW Sydney, Sydney, Australia
| | - Linda Robinson
- Department of Optometry, Deakin University, Geelong, Australia
| |
Collapse
|
13
|
Surace R, Palermo C, Porter J. Factors influencing the incorporation of Entrustable Professional Activities into assessment in nutrition and dietetics education: A systematic review. Nutr Diet 2025. [PMID: 40103014 DOI: 10.1111/1747-0080.70004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2024] [Revised: 02/10/2025] [Accepted: 02/18/2025] [Indexed: 03/20/2025]
Abstract
AIMS This study aimed to identify and synthesise the evidence on factors influencing the incorporation of Entrustable Professional Activities into assessment in nutrition and dietetics education. METHODS A systematic review was conducted with a narrative synthesis and was undertaken and reported in accordance with the PRISMA guidelines. Six electronic databases were searched (MEDLINE, CINAHL, SCOPUS, PsycINFO, Web of Science, and EMBASE) on 9 September 2024. Methodological quality was assessed using the Critical Appraisal Skills Program checklists. Key patterns identified from the narrative synthesis of the included manuscripts were labelled as themes and represented in a figure. RESULTS Across the international literature, six articles were identified revealing six main and interconnected themes related to factors influencing the incorporation of Entrustable Professional Activities in nutrition and dietetics. In summary, development and review processes for Entrustable Professional Activities require key stakeholder engagement in addition to ensuring they are linked to assessment structures and existing frameworks. Furthermore, technology platforms and applications appeared to support Entrustable Professional Activity incorporation, and training is an important part of integration. CONCLUSIONS Further research on factors influencing incorporation is occurring and is suggested to continue, especially given Entrustable Professional Activities seemingly offer a tangible option to simplify the intricacy of competency-based assessment in work-based practice. However, further research to enhance understanding of whether Entrustable Professional Activities support nutrition and dietetics learners and assessors in undertaking high-quality assessment with utility is warranted.
Collapse
Affiliation(s)
- Ryan Surace
- Deakin University, School of Exercise and Nutrition Sciences, Burwood, Victoria, Australia
| | - Claire Palermo
- Monash University, Faculty of Medicine, Nursing and Health Sciences, Clayton, Victoria, Australia
| | - Judi Porter
- Deakin University, School of Exercise and Nutrition Sciences, Burwood, Victoria, Australia
| |
Collapse
|
14
|
Schumacher DJ, Martini A, Michelson C, Turner DA, Winn AS, Kinnear B. A realist evaluation of prospective entrustment decisions in paediatric residency clinical competency committees. MEDICAL EDUCATION 2025; 59:292-301. [PMID: 39237478 DOI: 10.1111/medu.15530] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/29/2024] [Revised: 08/01/2024] [Accepted: 08/14/2024] [Indexed: 09/07/2024]
Abstract
PURPOSE Making entrustment decisions (granting more responsibility, advancement and graduation) are important actions in medical training that pose risks to trainees and patients if not done well. A previous realist synthesis of the existing literature revealed that clinical competency committees (CCCs) do not typically make deliberate entrustment decisions, instead defaulting to the promotion and graduation of trainees in the absence of red flags. This study sought further understanding of these areas through empirical data. METHODS The authors conducted a realist inquiry to better understand how CCC prospective entrustment decision-making is carried out in paediatric residency programs. They conducted four CCC meeting observations and 18 interviews with CCC members at eight sites in an effort to confirm, disconfirm, and elaborate an existing theory that was based on a literature synthesis. RESULTS The literature-based theory held up well against the empiric data collected in this study. Therefore, the authors did not modify that theory and instead developed three new demi-regularities (recurring patterns in data when conducting realist work) that add detail and nuance to their previous understanding of this model. These new demi-regularities focus on (i) expounding on how deliberate actions of CCCs focus more on resident development than on resident entrustment; (ii) elucidating that effortful work is not only about reconciling a paucity of data or incongruent data but also working hard to 'do the right thing' for residents; and (iii) describing how programs consider bias, equity and fairness, with a wide range of intentionality from being reactive to being proactive. CONCLUSION This study offers evidence of deliberate CCC efforts to support resident development. Moving forward, a similar focus should be more consistently placed on equitable entrustment and advancement decisions to balance both of these foundational goals.
Collapse
Affiliation(s)
- Daniel J Schumacher
- Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio, USA
- University of Cincinnati College of Medicine, Cincinnati, Ohio, USA
| | - Abigail Martini
- Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio, USA
| | - Catherine Michelson
- Ann and Robert H. Lurie Children's Hospital of Chicago, Chicago, Illinois, USA
- Northwestern University, Chicago, Illinois, USA
| | - David A Turner
- American Board of Pediatrics, Chapel Hill, North Carolina, USA
| | - Ariel S Winn
- Boston Children's Hospital, Boston, Massachusetts, USA
- Harvard Medical School, Boston, Massachusetts, USA
| | - Benjamin Kinnear
- Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio, USA
- University of Cincinnati College of Medicine, Cincinnati, Ohio, USA
| |
Collapse
|
15
|
Linde P, Hallal H, Charkina P, Adams A, Frank J, Wegen S, Fan J, Nadjiri L, Zims H, Stosch C, Baues C. Diversity competence in medical education: short-term effectiveness of an interprofessional diversity-specific undergraduate learning. BMC MEDICAL EDUCATION 2025; 25:226. [PMID: 39934836 PMCID: PMC11817347 DOI: 10.1186/s12909-025-06824-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/21/2023] [Accepted: 02/04/2025] [Indexed: 02/13/2025]
Abstract
BACKGROUND Diversity competence, diversity itself, and a corresponding awareness of possible (intersectional) discrimination mechanisms have not been anchored in the German National Competence based Learning Objectives Catalogue for Medicine 2.0 (Nationaler Kompetenzbasierter Lernzielkatalog 2.0., NKLM) yet, highlighting a systemic gap in national competency frameworks. We present our first experience with a prospective diversity-specific intervention in medical students to assess its short-term impact on students' diversity acceptance (DA) and to develop actionable recommendations for integrating diversity into medical education. METHODS We designed a prospective cohort study using a control group (CG) and intervention group (IG) design. The IG absolved a five-day diversity-specific intervention (50 h; field trip; seminar). Quantitative data were collected using the validated DWD-O5 scale at baseline (T0), three months (T3), and six months (T6), complemented by qualitative responses (diversity issues in the medical curriculum; perceptions and criticisms) categorized using Mayring's content analysis. Descriptive and non-parametric statistics were performed. RESULTS Thirty-one medical students (n = 10, IG vs n = 21, CG) were enrolled. The IG demonstrated a short-term improvement in diversity competence (+ 9.72%) across all DWD-O5 factors during the intervention. While scores slightly declined at T6, they remained above baseline levels. 35% (CG) vs. 56% (IG) have experienced discrimination in context of medical studies on their own. Participants in both groups stressed the importance of integrating diversity criteria into curricula at an early stage (100% agreement). Findings revealed three key themes: perceived inadequacies in current curricula, self-reported discrimination experiences, and a strong desire for practical diversity training, such as simulation-based learning. CONCLUSION The intervention shows promise as an initial step toward addressing diversity gaps in medical education. By combining historical, cultural, and experiential learning approaches, the program fosters essential competencies such as empathy, self-reflection, and bias recognition. More broadly, sustained improvements in diversity competence require longitudinal integration of diversity training across curricula and systemic reforms to national frameworks like the NKLM. Future research should explore the long-term impact of such interventions and strategies for institutionalizing equity-focused medical education.
Collapse
Affiliation(s)
- Philipp Linde
- Department of Radiation Oncology, Cyberknife and Radiation Therapy, Faculty of Medicine and University Hospital of Cologne, University of Cologne, Kerpener St 62, Cologne, 50937, Germany.
| | - Houda Hallal
- University of Cologne, Faculty of Medicine, Office of the Vice Dean for Teaching and Studies, Faculty of Medicine and University Hospital of Cologne, University of Cologne, Kerpener St 62, Cologne, 50937, Germany
| | - Polina Charkina
- Department of Radiation Oncology, Cyberknife and Radiation Therapy, Faculty of Medicine and University Hospital of Cologne, University of Cologne, Kerpener St 62, Cologne, 50937, Germany
| | - Anne Adams
- Institute of Medical Statistics and Computational Biology, Faculty of Medicine and University of Cologne, Kerpener St 62, Cologne, 50937, Germany
| | - Julia Frank
- Institute of Medical Statistics and Computational Biology, Faculty of Medicine and University of Cologne, Kerpener St 62, Cologne, 50937, Germany
| | - Simone Wegen
- Department of Radiation Oncology, Cyberknife and Radiation Therapy, Faculty of Medicine and University Hospital of Cologne, University of Cologne, Kerpener St 62, Cologne, 50937, Germany
| | - Jiaqi Fan
- Department of Radiation Oncology, Cyberknife and Radiation Therapy, Faculty of Medicine and University Hospital of Cologne, University of Cologne, Kerpener St 62, Cologne, 50937, Germany
| | - Lukas Nadjiri
- Department of Radiation Oncology, Cyberknife and Radiation Therapy, Faculty of Medicine and University Hospital of Cologne, University of Cologne, Kerpener St 62, Cologne, 50937, Germany
| | - Heike Zims
- Institute of Medical Statistics and Computational Biology, Faculty of Medicine and University of Cologne, Kerpener St 62, Cologne, 50937, Germany
| | - Christoph Stosch
- Institute of Medical Statistics and Computational Biology, Faculty of Medicine and University of Cologne, Kerpener St 62, Cologne, 50937, Germany
| | - Christian Baues
- Department of Radiation Oncology, Cyberknife and Radiation Therapy, Faculty of Medicine and University Hospital of Cologne, University of Cologne, Kerpener St 62, Cologne, 50937, Germany
| |
Collapse
|
16
|
Snijders BMG, Koek HL, Peters MJL, Mali WPTM, van Beek MM, Betman MJC, Golüke NMS, Kruyswijk T, de Lange SV, Lith BDWT, Pekelharing RM, Roos MJ, Rutgers DR, Venema SMU, Verberne WR, Emmelot-Vonk MH, de Jong PA. Inter- and Intrarater Agreement of CT Brain Calcification Scoring in Primary Familial Brain Calcification. AJNR Am J Neuroradiol 2025; 46:147-152. [PMID: 39134371 PMCID: PMC11735432 DOI: 10.3174/ajnr.a8446] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/28/2024] [Accepted: 07/19/2024] [Indexed: 12/14/2024]
Abstract
BACKGROUND AND PURPOSE The total calcification score (TCS) is a visual rating scale to measure primary familial brain calcification (PFBC)-related calcification severity on CT. We investigated the inter- and intrarater agreement of a modified TCS. MATERIALS AND METHODS Patients aged ≥18 years with PFBC or Fahr syndrome who visited the outpatient clinic of a Dutch academic hospital were included. The TCS was modified, for example, by adding hippocampal calcification, and ranged from 0 to 95 points. Fifteen raters evaluated all CTs, of whom 3 evaluated the CTs twice. Their entrustable professional activity (EPA) level ranged from II (medical student) to V (neuroradiologist). Agreement was assessed by using the intraclass correlation coefficient (ICC) for the total score. Kendall's W and weighted Cohen κ were used to determine the inter- and intrarater agreement for individual locations, respectively. RESULTS Forty patients were included (mean age 60 years, 53% women). The median modified TCS was 34 (range 4-76). For all EPA levels, the interrater agreement of the modified TCS was excellent (ICC = 0.97 [95% CI 0.95-0.98]). The Kendall W values were good to excellent for commonly affected locations, but poor to moderate for less commonly affected locations for raters with lower levels of expertise. The intrarater agreement of the modified TCS was excellent. The Cohen κ of most locations were substantial to almost perfect. CONCLUSIONS The modified TCS can be used with excellent reproducibility of the overall amount of brain calcifications and with limited training, although for some individual calcification locations more expertise is needed.
Collapse
Affiliation(s)
- Birgitta M G Snijders
- From the Departments of Geriatrics (B.M.G.S., H.L.K., M.J.LP., M.M.v.B., T.K., B.D.W.T.L., R.M.P., M.J.R., W.R.V., M.H.E.-V.), University Medical Center Utrecht, Utrecht, the Netherlands
| | - Huiberdina L Koek
- From the Departments of Geriatrics (B.M.G.S., H.L.K., M.J.LP., M.M.v.B., T.K., B.D.W.T.L., R.M.P., M.J.R., W.R.V., M.H.E.-V.), University Medical Center Utrecht, Utrecht, the Netherlands
| | - Mike J L Peters
- From the Departments of Geriatrics (B.M.G.S., H.L.K., M.J.LP., M.M.v.B., T.K., B.D.W.T.L., R.M.P., M.J.R., W.R.V., M.H.E.-V.), University Medical Center Utrecht, Utrecht, the Netherlands
- Department of Internal Medicine (M.J.L.P., W.R.V.), University Medical Center Utrecht, Utrecht, the Netherlands
| | - Willem P T M Mali
- Department of Radiology (W.P.T.M.M., M.J.C.B., S.V.d.L., D.R.R., S.M.U.V. P.A.d.J.), University Medical Center Utrecht, Utrecht, the Netherlands
| | - Michelle M van Beek
- From the Departments of Geriatrics (B.M.G.S., H.L.K., M.J.LP., M.M.v.B., T.K., B.D.W.T.L., R.M.P., M.J.R., W.R.V., M.H.E.-V.), University Medical Center Utrecht, Utrecht, the Netherlands
| | - Merel J C Betman
- Department of Radiology (W.P.T.M.M., M.J.C.B., S.V.d.L., D.R.R., S.M.U.V. P.A.d.J.), University Medical Center Utrecht, Utrecht, the Netherlands
| | - Nienke M S Golüke
- Department of Geriatrics (N.M.S.G.), Ziekenhuis Gelderse Vallei, Ede, the Netherlands
| | - Tijl Kruyswijk
- From the Departments of Geriatrics (B.M.G.S., H.L.K., M.J.LP., M.M.v.B., T.K., B.D.W.T.L., R.M.P., M.J.R., W.R.V., M.H.E.-V.), University Medical Center Utrecht, Utrecht, the Netherlands
| | - Stéphanie V de Lange
- Department of Radiology (W.P.T.M.M., M.J.C.B., S.V.d.L., D.R.R., S.M.U.V. P.A.d.J.), University Medical Center Utrecht, Utrecht, the Netherlands
| | - Bouke D W T Lith
- From the Departments of Geriatrics (B.M.G.S., H.L.K., M.J.LP., M.M.v.B., T.K., B.D.W.T.L., R.M.P., M.J.R., W.R.V., M.H.E.-V.), University Medical Center Utrecht, Utrecht, the Netherlands
| | - Ruth M Pekelharing
- From the Departments of Geriatrics (B.M.G.S., H.L.K., M.J.LP., M.M.v.B., T.K., B.D.W.T.L., R.M.P., M.J.R., W.R.V., M.H.E.-V.), University Medical Center Utrecht, Utrecht, the Netherlands
| | - Marvin J Roos
- From the Departments of Geriatrics (B.M.G.S., H.L.K., M.J.LP., M.M.v.B., T.K., B.D.W.T.L., R.M.P., M.J.R., W.R.V., M.H.E.-V.), University Medical Center Utrecht, Utrecht, the Netherlands
| | - Dirk R Rutgers
- Department of Radiology (W.P.T.M.M., M.J.C.B., S.V.d.L., D.R.R., S.M.U.V. P.A.d.J.), University Medical Center Utrecht, Utrecht, the Netherlands
| | - Simone M Uniken Venema
- Department of Radiology (W.P.T.M.M., M.J.C.B., S.V.d.L., D.R.R., S.M.U.V. P.A.d.J.), University Medical Center Utrecht, Utrecht, the Netherlands
| | - Wouter R Verberne
- From the Departments of Geriatrics (B.M.G.S., H.L.K., M.J.LP., M.M.v.B., T.K., B.D.W.T.L., R.M.P., M.J.R., W.R.V., M.H.E.-V.), University Medical Center Utrecht, Utrecht, the Netherlands
- Department of Internal Medicine (M.J.L.P., W.R.V.), University Medical Center Utrecht, Utrecht, the Netherlands
| | - Marielle H Emmelot-Vonk
- From the Departments of Geriatrics (B.M.G.S., H.L.K., M.J.LP., M.M.v.B., T.K., B.D.W.T.L., R.M.P., M.J.R., W.R.V., M.H.E.-V.), University Medical Center Utrecht, Utrecht, the Netherlands
| | - Pim A de Jong
- Department of Radiology (W.P.T.M.M., M.J.C.B., S.V.d.L., D.R.R., S.M.U.V. P.A.d.J.), University Medical Center Utrecht, Utrecht, the Netherlands
| |
Collapse
|
17
|
Borges MC, Kennedy MM, Kropf CW, Caldwell MD, Huang RD, Kim GJ, Hughes DT, Gruppen LD, Rooney DM. Cost and Challenges of Clinical Competency Committees and Milestones Assessment. JOURNAL OF MEDICAL EDUCATION AND CURRICULAR DEVELOPMENT 2025; 12:23821205251336279. [PMID: 40432835 PMCID: PMC12106988 DOI: 10.1177/23821205251336279] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/23/2024] [Accepted: 04/04/2025] [Indexed: 05/29/2025]
Abstract
Background Several challenges regarding Clinical Competency Committee (CCC) processes have been previously reported. Few studies have addressed the cost of assessment in healthcare professional education. This study aimed to assess the time spent on and the cost of CCC processes, and faculty perception of the Milestones assessment in three residency programs. Methods We surveyed CCC faculty members to capture time devoted to, and satisfaction with, CCC processes from three residency programs at the University of Michigan: Anesthesiology, Emergency Medicine, and Surgery. During preparatory periods before CCC meetings, administrative staff used daily logs to record time spent in the CCC preparatory period to develop meeting documents and resident reports. CCC faculty members supplied estimated time spent preparing residents' assessments through a survey administered the day following the meeting. Additionally, the duration of each CCC meeting was recorded, and salaries were confirmed to estimate total cost. Total faculty and staff time was summed and reviewed by each departmental CCC program director. Results CCC members found the unstandardized semi-annual report compiled by the programs was poorly organized, not easy to review, and did not provide high-quality information for setting Milestones. The majority of CCC members reported the current CCC process does not allow enough time for review of resident data, does not provide valuable feedback to inform resident progression, and does not provide adequate rigor to defend CCC decisions. Annually, administrative staff spent 162.9 ± 151.7 h preparing the reports. Faculty spent 147.0 ± 78.4 h for the resident assessment preparation and 97.3 ± 24.1 h in CCCs meeting. Based on salaries, the cost of CCC processes for Milestone assessment totaled USD83,437, with USD22,776, USD31,764, and USD28,897 for Anesthesiology, Emergency Medicine, and Surgery, respectively. With an average of USD395.44 per resident, the total annual CCC cost for University of Michigan Medical was extrapolated to be USD404,531. Conclusions Though Milestones were implemented more than ten years ago, CCC processes are still unsatisfactory to faculty and pose a significant institutional cost. Alternative approaches are still needed to improve resident competency assessment processes.
Collapse
Affiliation(s)
- Marcos C Borges
- Department of Internal Medicine, Ribeirao Preto Medical School, University of São Paulo, Ribeirão Preto, Brazil
- Department of Learning Health Sciences, University of Michigan, Ann Arbor, Michigan, USA
| | - McKenzie M Kennedy
- Department of Learning Health Sciences, University of Michigan, Ann Arbor, Michigan, USA
| | - Charles W Kropf
- Department of Emergency Medicine, University of Michigan, Ann Arbor, Michigan, USA
| | - Matthew D Caldwell
- Department of Anesthesiology, University of Michigan, Ann Arbor, Michigan, USA
| | - Robert D Huang
- Department of Emergency Medicine, University of Michigan, Ann Arbor, Michigan, USA
| | - Grace J Kim
- Department of Surgery, University of Michigan, Ann Arbor, Michigan, USA
| | - David T Hughes
- Department of Surgery, University of Michigan, Ann Arbor, Michigan, USA
| | - Larry D Gruppen
- Department of Learning Health Sciences, University of Michigan, Ann Arbor, Michigan, USA
| | - Deborah M Rooney
- Department of Learning Health Sciences, University of Michigan, Ann Arbor, Michigan, USA
| |
Collapse
|
18
|
Breil SM, Amelung D, Oberst S, Rollinger T, Ahrens H, Garbe A, Kadmon M, Marschall B, Back MD, Peters H. Physicians' Social Skills - Conceptualization, Taxonomy, and Behavioral Assessment. PERSPECTIVES ON MEDICAL EDUCATION 2024; 13:635-645. [PMID: 39735823 PMCID: PMC11673732 DOI: 10.5334/pme.1171] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/23/2023] [Accepted: 11/14/2024] [Indexed: 12/31/2024]
Abstract
Social skills (e.g., assertiveness, empathy, ability to accept criticism) are essential for the medical profession and therefore also for the selection and development of medical students. However, the term "social skills" is understood differently in different contexts. There is no agreed upon taxonomy for classifying physicians' social skills, and skills with the same meaning often have different names. This conceptual ambiguity presents a hurdle to cross-context communication and to the development of methods to assess social skills. Drawing from behavioral psychology, we aim to contribute to a better understanding of social skills in the medical context. To this end, we introduce a theoretically and empirically informed taxonomy that can be used to integrate the large number of different social skills. We consider how skills manifest at the behavioral level to ensure that we focus only on skills that are actually observable, distinguishable, and measurable. Here, behavioral research has shown that three overarching skill dimensions can be seen in interpersonal situations and are clearly distinguishable from each other: agency skill (i.e., getting ahead in social situations), communion skill (i.e., getting along in social situations), and interpersonal resilience (i.e., staying calm in social situations). We show that almost all social skills relevant for physicians fit into this structure. The approach presented allows redundant descriptions to be combined under three clearly distinguishable and behavior-based dimensions of social skills. This approach has implications for the assessment of social skills in both the selection and development of students.
Collapse
Affiliation(s)
- Simon M. Breil
- Department of Psychology, University of Münster, Germany
| | | | - Sebastian Oberst
- Dieter Scheffner Center for Medical Education and Educational Research, Dean’s Office for Study Affairs, Charité – Universitätsmedizin Berlin, Germany
| | - Torsten Rollinger
- Dieter Scheffner Center for Medical Education and Educational Research, Dean’s Office for Study Affairs, Charité – Universitätsmedizin Berlin, Germany
| | - Helmut Ahrens
- Institute of Education and Student Affairs, Faculty of Medicine, University of Münster, Germany
| | - Amelie Garbe
- Dieter Scheffner Center for Medical Education and Educational Research, Dean’s Office for Study Affairs, Charité – Universitätsmedizin Berlin, Germany
| | - Martina Kadmon
- Medical Faculty, Heidelberg University, Germany
- Medical Education Sciences, DEMEDA, Faculty of Medicine, University of Augsburg, Germany
| | - Bernhard Marschall
- Institute of Education and Student Affairs, Faculty of Medicine, University of Münster, Germany
| | - Mitja D. Back
- Department of Psychology, University of Münster, Germany
- JICE, Joint Institute for Individualisation in a Changing Environment, University of Münster and Bielefeld University, Germany
| | - Harm Peters
- Dieter Scheffner Center for Medical Education and Educational Research, Dean’s Office for Study Affairs, Charité – Universitätsmedizin Berlin, Germany
| |
Collapse
|
19
|
Hennus MP, Chen HC. Equity, diversity, and inclusion in entrustable professional activities based assessment. MEDICAL EDUCATION 2024; 58:1426-1428. [PMID: 39225392 DOI: 10.1111/medu.15526] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/19/2024] [Revised: 08/13/2024] [Accepted: 08/20/2024] [Indexed: 09/04/2024]
Abstract
Recognizing the value of Entrustable Professional Activities, Hennus and Chen argue that deliberate and conscious efforts at implementation are pivotal to addressing and mitigating the risks of racism and bias.
Collapse
Affiliation(s)
- Marije P Hennus
- Department of Pediatric Intensive Care, University Medical Center Utrecht, Utrecht, The Netherlands
| | - H Carrie Chen
- Medical Education Research and Scholarship and Professor of Health Systems Science, Kaiser Permanente Bernard J. Tyson School of Medicine, Pasadena, California, USA
| |
Collapse
|
20
|
Quinonez RB, Vamos CA, Obure R, Çankaya Uyan D, Tittemore A, Susin C, Broome A, Duqum I, Musskopf ML, Phillips K, Stewart D, Guthmiller JM. Using implementation science to evaluate longitudinal assessment of entrustable professional activities in dental education. J Dent Educ 2024; 88:1709-1719. [PMID: 39568169 DOI: 10.1002/jdd.13780] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2024] [Revised: 09/21/2024] [Accepted: 11/01/2024] [Indexed: 11/22/2024]
Abstract
PURPOSE To evaluate the implementation of a longitudinal assessment framework utilizing entrustable professional activities (EPAs) in dental education during the initial 2-year implementation. METHOD The Consolidated Framework for Implementation Research was utilized to evaluate contextual factors influencing implementation across the following domains: innovation, outer setting, inner setting, individuals, and process. Purposive sampling was used to ascertain a diverse pool of participants and various perspectives. Inclusion criteria required engagement for >12 months at the time of the study. A semi-structured interview guide was developed. Two focus groups of faculty and staff and four individual leadership interviews were conducted via Microsoft Teams, transcribed, and thematic analyses were performed using MAXQDA. RESULTS Fifteen participants described innovation design details, adaptability, complexity, and relative advantage. The contextual fabric of the setting was evaluated, highlighting the influence of the pandemic, institutional culture, structural shifts, and the pivotal role played by champions. The implementation process was investigated with a focus on training, engagement, access to information, faculty capability, motivation, learner experience, and continual assessment of implementation processes. Data suggests the framework was multi-dimensional, evolving, and learner-centered. It facilitated early identification of learners requiring support, provided comprehensive information guiding entrustment and practice readiness decisions and demonstrated preliminary evidence of effectiveness of the innovation. CONCLUSION Engaging in longitudinal assessment using EPAs is multifaceted and influenced by implementation context and intrinsic motivation prevalent among faculty members. The study identifies areas for refinement in support of continuous quality improvement and implementation of this innovative assessment framework in dental education, including technological support, training, and ongoing alignment.
Collapse
Affiliation(s)
- Rocio B Quinonez
- Academic Affairs, University of North Carolina at Chapel Hill Adams School of Dentistry, Chapel Hill, North Carolina, USA
| | - Cheryl A Vamos
- Science and Practice, University of South Florida's Center of Excellence in MCH Education, Tampa, Florida, USA
- Chiles Center for Women, Children & Families, College of Public Health, University of South Florida, Tampa, Florida, USA
| | - Renice Obure
- College of Public Health, University of South Florida, Tampa, Florida, USA
| | - Dilek Çankaya Uyan
- Division of Restorative Sciences, University of North Carolina at Chapel Hill Adams School of Dentistry, Chapel Hill, North Carolina, USA
| | - Ashley Tittemore
- Academic Affairs, University of North Carolina at Chapel Hill Adams School of Dentistry, Chapel Hill, North Carolina, USA
| | - Cristiano Susin
- Division of Periodontology, Endodontics and Dental Hygiene, University of North Carolina at Chapel Hill Adams School of Dentistry, Chapel Hill, North Carolina, USA
| | - Angela Broome
- Division of Diagnostic Sciences, University of North Carolina at Chapel Hill Adams School of Dentistry, Chapel Hill, North Carolina, USA
| | - Ibrahim Duqum
- Division of Restorative Sciences, University of North Carolina at Chapel Hill Adams School of Dentistry, Chapel Hill, North Carolina, USA
| | - Marta L Musskopf
- Division of Restorative Sciences, University of North Carolina at Chapel Hill Adams School of Dentistry, Chapel Hill, North Carolina, USA
| | - Keith Phillips
- Division of Restorative Sciences, University of North Carolina at Chapel Hill Adams School of Dentistry, Chapel Hill, North Carolina, USA
| | - Denice Stewart
- Academic Affairs, University of North Carolina at Chapel Hill Adams School of Dentistry, Chapel Hill, North Carolina, USA
| | - Janet M Guthmiller
- Dean, University of North Carolina at Chapel Hill Adams School of Dentistry, Chapel Hill, North Carolina, USA
| |
Collapse
|
21
|
Elmes-Patel AT, Allen SM, Djuric Kachlic M, Schriever AE, Driscoll TP, Tekian A, Cheung JJH, Podsiadlik E, Haines ST, Schwartz A, Jarrett JB. Preceptor Perspectives Using Entrustable Professional Activity-Based Assessments During Advanced Pharmacy Practice Experiences. AMERICAN JOURNAL OF PHARMACEUTICAL EDUCATION 2024; 88:101332. [PMID: 39549744 DOI: 10.1016/j.ajpe.2024.101332] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/27/2024] [Revised: 10/07/2024] [Accepted: 11/10/2024] [Indexed: 11/18/2024]
Abstract
OBJECTIVE To explore advanced pharmacy practice experience (APPE) preceptor perspectives including implementation recommendations, barriers, and facilitators to using entrustable professional activity (EPA) assessment in pharmacy experiential education. METHODS Two 90-min virtual focus group sessions were conducted to elucidate preceptor perspectives on EPA integration into APPEs through semistructured discussion. Preceptors with experience utilizing entrustment-supervision scales with EPAs for assessments for at least 4 APPE learners in the last year were eligible. The primary outcome was a description of implementation guidance for assessing learners using an EPA framework. Secondary outcomes include descriptions of barriers and facilitators to using an EPA framework in APPE learner assessment. All sessions were recorded, transcribed, and analyzed using inductive thematic analysis. RESULTS Eleven APPE preceptors representing 9 institutions participated. Commonly identified implementation recommendations were regular, repetitive preceptor education using case practice vignettes, student orientation to assessment expectations, clear delineation of minimum competency level, frequent discussions with preceptors, and use of institutional resources. Identified barriers were the abstractness of entrustability, subjectivity of the entrustment-supervision scale and preceptor assessments, unclear grading schemes, length and complexity of the assessments, and EPA applicability to the specific practice setting. Commonly identified facilitators were clearly defined scales and expectations, preceptor education, student education, pass/fail grading schemes, and shorter, more frequent assessments. CONCLUSION EPA-based assessments can be used by preceptors for workplace-based assessments during APPEs. Faculty/preceptor development and student orientation with benchmarking and clear expectations are needed to support implementation.
Collapse
Affiliation(s)
| | - Sheila M Allen
- University of Illinois Chicago Retzky College of Pharmacy, Chicago, IL, USA
| | | | - Allison E Schriever
- University of Illinois Chicago Retzky College of Pharmacy - Rockford, Rockford, IL, USA
| | - Tara P Driscoll
- University of Illinois Chicago Retzky College of Pharmacy, Chicago, IL, USA
| | - Ara Tekian
- University of Illinois College of Medicine, Department of Medical Education, Chicago, IL, USA
| | - Jeffrey J H Cheung
- University of Illinois College of Medicine, Department of Medical Education, Chicago, IL, USA
| | - Edward Podsiadlik
- University of Illinois Chicago College of Education, Chicago, IL, USA
| | - Stuart T Haines
- University of Mississippi School of Pharmacy, University, MS, USA
| | - Alan Schwartz
- University of Illinois College of Medicine, Department of Medical Education, Chicago, IL, USA
| | - Jennie B Jarrett
- University of Illinois Chicago Retzky College of Pharmacy, Chicago, IL, USA.
| |
Collapse
|
22
|
Maguire T, Daffern M, Willetts G, McKenna B. Exploring the Utility of a Novel Approach of Evaluating Application of a Validated Violence Risk Assessment Instrument. Nurs Health Sci 2024; 26:e13167. [PMID: 39353580 DOI: 10.1111/nhs.13167] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2024] [Revised: 09/12/2024] [Accepted: 09/13/2024] [Indexed: 10/04/2024]
Abstract
Mental health nurses are often responsible for assessment/management of inpatient aggression. Validated instruments such as the Dynamic Appraisal of Situational Aggression (DASA), can aid risk assessment. However, limited attention has been paid to evaluating nurses' ability to administer risk assessment instruments. An entrustable professional activity may offer way of evaluating risk assessment clinical activities. DASA trainers' perceptions of the value and utility of an EPA were explored via collection of data through focus groups, with 17 participants from six countries. Thematic analysis was conducted to analyze the data. Three themes were interpreted: (1) DASA trainers-a way of knowing and being (2) An EPA-something you did not know you need until you see it; (3) The DASA-EPA supports the need for training and importance of integrity in assessment. Trainers engaged in innovative ways to ensure training is suitable and responsive to needs of nurses and their setting. Participants understood how an EPA could be used to evaluate DASA administration, monitor DASA use, provide feedback, and highlight the importance of training to ensure best practice.
Collapse
Affiliation(s)
- Tessa Maguire
- Centre for Forensic Behavioural Science, Swinburne University of Technology, Melbourne, Australia
- The Victorian Institute of Forensic Mental Health (Forensicare), Melbourne, Australia
- Institute Health and Wellbeing, Federation University Australia, Melbourne, Victoria, Australia
| | - Michael Daffern
- Centre for Forensic Behavioural Science, Swinburne University of Technology, Melbourne, Australia
- The Victorian Institute of Forensic Mental Health (Forensicare), Melbourne, Australia
| | - Georgina Willetts
- Centre for Forensic Behavioural Science, Swinburne University of Technology, Melbourne, Australia
| | - Brian McKenna
- Centre for Forensic Behavioural Science, Swinburne University of Technology, Melbourne, Australia
- Auckland University of Technology, Auckland, New Zealand
| |
Collapse
|
23
|
Hamed O, Verstegen D, Alsheikh G, Alqarni MA, Taleb R, Rege N, Barua P, Cymet T, Shamim MS, Hegazy MS. International Delphi study on developing entrustable professional activities (EPAs) for master's learners in health professions education. BMC MEDICAL EDUCATION 2024; 24:1362. [PMID: 39587515 PMCID: PMC11590636 DOI: 10.1186/s12909-024-06377-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/17/2024] [Accepted: 11/19/2024] [Indexed: 11/27/2024]
Abstract
BACKGROUND Competencies-based education has gained global recognition, emphasizing the need for educators to align educational outcomes with healthcare system requirements. However, limited literature exists on competency frameworks and Entrustable Professional Activities (EPAs) specific to health professions educationists, hindering the development of tailored Master's programs. AIM This study aimed to develop a competency framework outlining the roles and functions for Master's learners in Health Professions Education (MHPE) and identify the key EPAs that form the foundation of a task-based MHPE curriculum, along with the expected levels of entrustment. METHODS An international Delphi study was conducted involving three rounds of surveys and qualitative discussions with an expert panel of health professions educationists from diverse contexts (n = 29). The Delphi technique, including open-ended and quantitative rating scales, was employed to reach consensus on the EPAs and their levels of entrustment. The final list of EPAs was validated using the EQual rubric. RESULTS A total of 16 EPAs were identified and validated, mapped to core and potential roles and functions of health professions educationists. There is less agreement on the level of entrustment that should be attained at the master level, resulting in EPAs that must be fully entrusted before graduation and others which need further development afterwards. CONCLUSION The study presents a comprehensive competency framework and a set of EPAs tailored for MHPE programs, providing a structured approach to curriculum design and learner assessment. The findings underscore the importance of incorporating context-specific considerations and aligning educational objectives with the evolving roles and responsibilities of health professions educationists.
Collapse
Affiliation(s)
- Omayma Hamed
- Medical Education Department, Armed Forces College of Medicine, Heliopolis, Cairo Governorate, Egypt
| | - Daniëlle Verstegen
- School of Health Professions Education, Faculty of Health, Medicine and Life Sciences, Maastricht University, Maastricht, The Netherlands
| | - Ghanim Alsheikh
- College of Medicine, Tikrit University (TUCOM), Tikrit, Iraq
| | - Mohammed A Alqarni
- College of Medicine, Sulaiman Al Rajhi University, Al Bukayriyah, Saudi Arabia
| | - Rim Taleb
- Faculty of Medicine, Beirut Arab University, Beirut, Lebanon.
| | - Nirmala Rege
- Era's Lucknow Medical College, Lucknow, India
- Seth GS Medical College & KEM Hospital, Mumbai, India
| | | | - Tyler Cymet
- Maryland College of Osteopathic Medicine, Morgan State University, Baltimore, USA
| | | | - Mohamed Saad Hegazy
- Medical Education Department, Military Medical Academy, Heliopolis, Cairo Governorate, Egypt
| |
Collapse
|
24
|
Kohale N, Kini P, Mohammed C. Relevance of Competency Based Education for Architectural Education in India. F1000Res 2024; 13:835. [PMID: 39588265 PMCID: PMC11587234 DOI: 10.12688/f1000research.148617.2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 10/30/2024] [Indexed: 11/27/2024] Open
Abstract
Background A holistic architectural education is the culmination of learning knowledge, skills, attitudes, and values, which eventually reflects in the quality of graduates. Even though different schools of thought have made various kinds of qualitative contributions towards the evolution of architectural education in India, it has largely been dominated by the quantitative and technical aspects of its regulating framework. Architects engage with the demanding contradictions between responsibilities of an ethical nature, the dynamic challenges of practice, and the intricacies of architectural imagination. The aesthetical and imaginative foundations of the field make it incumbent upon the architects to possess a balance of ecumenical proficiencies for accountability and personalization. The purpose of the study is to identify relevant attributes of Competency Based Education (CBE) that can be adopted for architectural education in India. Methods This research follows a narrative review approach and a descriptive-analytic method to broadly understand the attributes of CBE and its potential relevance to architectural education in India. 323 articles were searched on various search strings based on their relevance to the inquiry. 76 documents written in English language were included and appraised through the Scale of the Assessment for Narrative Review Articles (SANRA) tool to avoid any risk of bias. The PRISMA 2020 checklist and flow diagram has been used to report the findings of this narrative review. Result The study identifies eight critical parameters of CBE with respect to its definitions, origins, transitions, regulatory environment, characteristics, approaches and implications on teaching-learning, frameworks and models of assessment; and challenges, which makes a case for the relevance of CBE for architectural education in India, which hasn't been explored yet. Conclusion The broader expectations of 'being competent' can be addressed through a conscious adoption of strategies of relevant attributes of CBE which can encourage building attitudes and temperament for life-long learning.
Collapse
Affiliation(s)
- Nikhil Kohale
- Manipal School of Architecture and Planning, Manipal Academy of Higher Education, Karnataka, Manipal, 576104, India
| | - Pradeep Kini
- Manipal School of Architecture and Planning, Manipal Academy of Higher Education, Karnataka, Manipal, 576104, India
| | - Ciraj Mohammed
- College of Medicine & Health Sciences, National University of Science & Technology, National University of Science & Technology, Oman, P.O. 391, P.C. 321, Oman
| |
Collapse
|
25
|
Kasmirski JA, Wu C, Lindeman B. Where the rubber meets the road: pearls and pitfalls of implementing competency-based assessment. ANZ J Surg 2024; 94:1906-1909. [PMID: 39350719 DOI: 10.1111/ans.19246] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2024] [Accepted: 09/17/2024] [Indexed: 11/20/2024]
Affiliation(s)
| | - Christopher Wu
- Department of Surgery, University of Alabama at Birmingham, Birmingham, Alabama, USA
| | - Brenessa Lindeman
- Department of Surgery, University of Alabama at Birmingham, Birmingham, Alabama, USA
| |
Collapse
|
26
|
Meng Z, Haidan C, Junye T, Qian L, Xin Q, Cheng W. Development of entrustable professional activities for novice nurses: A modified Delphi study. Nurse Educ Pract 2024; 81:104181. [PMID: 39486350 DOI: 10.1016/j.nepr.2024.104181] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2024] [Revised: 10/22/2024] [Accepted: 10/25/2024] [Indexed: 11/04/2024]
Abstract
AIM This study aimed to develop a tailored EPA framework for novice nurses to support their integration and performance in hospital settings. BACKGROUND Novice nurses often struggle with the transition from education to practice due to the gap between theoretical knowledge and practical skills. EPAs help bridge this gap by defining and assessing key competencies, but a framework specific to novice nurses is needed to address their unique challenges. DESIGN A modified Delphi method was used. METHODS Conducted from October 2023 to March 2024, the study followed a four-stage process: team formation, identification, revision and evaluation of EPAs. Initial EPAs were identified through literature reviews, clinical guidelines and focus groups, then refined using the EQual rubric. Two Delphi rounds were conducted for validation. Experts rated the importance of EPAs in the first round, followed by online discussions, with the second round focusing on dimensions including Focus, Observable, Realistic, Generalizable and Multiple competencies. RESULTS The final framework included 12 EPAs: 1) Manage Admission and Discharge, 2) Provide Basic Care, 3) Collect Specimens, 4) Administer Medications, 5) Perform Non- Medication Therapies, 6) Monitor Conditions, 7) Respond to Emergencies, 8) Educate Patients, 9) Prevent Adverse Events, 10) Conduct Handovers, 11) Document Care and 12) Operate Equipment. CONCLUSION This EPA framework integrates theory and practice to improve training and assessment. Future research should focus on its implementation and refinement in diverse clinical settings to ensure broader applicability.
Collapse
Affiliation(s)
- Zhang Meng
- Nursing Department, Peking University First Hospital, Beijing 100034, China.
| | - Cheng Haidan
- Nursing Department, Peking University First Hospital, Beijing 100034, China.
| | - Tian Junye
- Nursing Department, Peking University First Hospital, Beijing 100034, China.
| | - Lu Qian
- Division of Medical & Surgical Nursing, School of Nursing, Peking University, Beijing 100191, China.
| | - Qi Xin
- Division of Plastic and Burn Surgery, Peking University First Hospital, Beijing 100034, China.
| | - Wang Cheng
- Operating Room Department, Peking University First Hospital, Beijing 100034, China.
| |
Collapse
|
27
|
Gliedt JA, Mathers KS, King J, Schneider MJ, Wiles MR. The development and introduction of entrustable professional activities at 2 community-based chiropractic student preceptorship sites in the United States. THE JOURNAL OF CHIROPRACTIC EDUCATION 2024; 38:161-171. [PMID: 38626920 PMCID: PMC11774292 DOI: 10.7899/jce-23-26] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/27/2023] [Revised: 10/17/2023] [Accepted: 02/09/2024] [Indexed: 10/24/2024]
Abstract
OBJECTIVE Entrustable professional activities (EPAs) have seen widespread adoption in medical education and other health professions education. EPAs aim to provide a bridge between competency-based education and clinical practice by translating competencies into fundamental profession-specific tasks associated with clinical practice. Despite the extensive use of EPAs in health professions education, EPAs have yet to be introduced into chiropractic education. The purpose of this paper is to describe the development and introduction of EPAs as part of 2 community-based chiropractic student preceptorship education programs in the United States. METHODS EPAs were developed and introduced at 2 community-based chiropractic preceptorship sites in 5 distinct steps: (1) differentiating EPAs from competencies, learning objectives, and knowledge, skills, and attitudes; (2) identifying EPAs; (3) mapping EPAs to competencies and necessary experience, knowledge, and skills; (4) designing EPA assessment strategies; and (5) implementing the use of EPAs. RESULTS A total of 13 individual EPAs were developed and mapped to Council on Chiropractic Education meta-competency outcomes and underlying experience, knowledge, and skills. Three assessment tools were created to evaluate student entrustability for EPAs and enhance student self-assessment. The EPAs and assessment tools were integrated into chiropractic student preceptorships at each site. CONCLUSION This paper describes the development and introduction of EPAs at 2 community-based chiropractic preceptorship sites. Future research is needed to develop and standardize EPA use and assessment, and to evaluate outcomes associated with EPA use.
Collapse
|
28
|
Zhu MM, Brennan MT, Pierce S. ComPACT (Competency-Based Peer-Assisted Coaching and Tutoring): A Proposed Curricular Framework for Near-Peer Tutoring in Medical Education. MEDICAL SCIENCE EDUCATOR 2024; 34:1133-1159. [PMID: 39450010 PMCID: PMC11496457 DOI: 10.1007/s40670-024-02070-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 05/07/2024] [Indexed: 10/26/2024]
Abstract
Near-peer tutoring (NPT) programs greatly prepare tutors for future teaching roles. However, without a comprehensive curricular framework, institutions may not adequately track the knowledge and skills tutors gain from these programs. We propose a competency-based peer-assisted coaching and tutoring (ComPACT) framework that captures tutors' progression as educators and supports their training through a community of practice. This framework leverages specialized teaching paths, digital micro-credentials, and a recognition system to track skill development. Overall, the ComPACT model is designed to create NPT programs that provide as much value to tutors as they do to the students they teach.
Collapse
|
29
|
Moffatt ME, Ford R, Lujano BN, Reed S, Singh A, Stewart DA, Turner DA. Competency based medical education - Where do I start? Curr Probl Pediatr Adolesc Health Care 2024; 54:101674. [PMID: 39218715 DOI: 10.1016/j.cppeds.2024.101674] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 09/04/2024]
Affiliation(s)
- Mary E Moffatt
- Department of Pediatrics, Children's Mercy Kansas City, University of Missouri Kansas City School of Medicine, Kansas City, MO, USA.
| | - Rashaan Ford
- Department of Pediatrics, University of Colorado Anschutz Medical Campus, Kempe Center for the Prevention and Treatment of Child Abuse and Neglect, Aurora, CO, USA
| | - Brenda Nuncio Lujano
- Program Coordinator, Competency Based Medical Education, American Board of Pediatrics, Chapel Hill, NC, USA
| | - Suzanne Reed
- Department of Pediatrics, The Ohio State University/Nationwide Children's Hospital, Columbus, Ohio, USA
| | - Alvin Singh
- Division of Allergy, Immunology, Pulmonary and Sleep Medicine, Children's Mercy, Kansas City, Department of Pediatrics, University of Missouri Kansas City School of Medicine, Kansas City, MO, USA
| | - David A Stewart
- Department of Pediatrics, University of Michigan Medical School, Ann Arbor, MI, USA
| | - David A Turner
- Vice President for Competency Based Medical Education, American Board of Pediatrics, Chapel Hill, NC, USA
| |
Collapse
|
30
|
Voronovi S, Simonia G, Taylor DCM. Medical education in Georgia. MEDICAL TEACHER 2024; 46:1296-1303. [PMID: 38963305 DOI: 10.1080/0142159x.2024.2370899] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/27/2024] [Accepted: 06/18/2024] [Indexed: 07/05/2024]
Abstract
Since 1991, there have been significant changes in medical education in Georgia. Key changes include adapting national legislation toward international standards, establishing the National Center for Education Quality Enhancement (NCEQE), which was recognized in 2018 by the World Federation for Medical Education (WFME) as an accrediting agency and opening the Association for Medical Education in Europe (AMEE) International Networking Center in 2019. Undergraduate medical education, regulated by the Ministry of Education, Science and Youth of Georgia, spans six years. MD graduates then have options for further career paths, including working as junior doctors, residency, and/or pursuing PhD research.The main challenges the country presently faces are: the need to reduce the increasing number of (mainly) private medical schools. Recent updates to the national standards for undergraduate medical education have imposed stricter accreditation requirements for MD programs, resulting in the closure of schools that fail to meet these standards;postgraduate medical education is governed by the Ministry of Internally Displaced Persons from the Occupied Territories, Labor, Health and Social Affairs of Georgia (MOH) and needs further reform due to limited and paid residency positions;continuous professional development (CPD) was optional until recently, which led to an increase in professional inaccuracy and malpractice cases. To address this, regulatory bodies, including the MOH and professional associations, are preparing the legal basis for introducing compulsory CPD.
Collapse
Affiliation(s)
| | | | - David C M Taylor
- Gulf Medical University, Ajman, United Arab Emirates
- Public Health and Policy, University of Liverpool, United Kingdom of Great Britain and Northern Ireland
| |
Collapse
|
31
|
Belcher RM, Shultz B, Mucksavage J, Herrera E, Benken S. Qualitative analysis of preparation and planning habits of students with low-performance on high-stakes practice examinations (pre-NAPLEX®). CURRENTS IN PHARMACY TEACHING & LEARNING 2024; 16:102160. [PMID: 39029391 DOI: 10.1016/j.cptl.2024.102160] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/13/2024] [Revised: 06/14/2024] [Accepted: 07/11/2024] [Indexed: 07/21/2024]
Abstract
OBJECTIVE The purpose of this analysis was to identify, analyze, and report patterns (or themes) of planning and preparation considerations of students that scored less than the historic average score on the Pre-NAPLEX® exam. METHODS This qualitative study was a retrospective, inductive thematic analysis of de-identified semi-structured interview field notes collected from student interviews for those students that scored less than the historic average score on the Pre-NAPLEX® exam. RESULTS Ninety-one students were initially contacted based on their score on the Pre-NAPLEX® exam to participate in one-on-one virtual discussions (i.e., interviews) with faculty members. Fifty-two responded and participated with their responses analyzed and included in thematic categorization. Four major themes were identified during the analysis. These include 1) Organization and Messaging of NAPLEX® Preparation Efforts, 2) Time Management during Competing Obligations, 3) Test Taking Experience, and 4) Curricular Disconnect. CONCLUSION Student performance on the NAPLEX licensing exam is of great concern to many colleges of pharmacy. As a result, many institutions are looking at root-causes for poor performance and working to implement structural changes at their institution to address these concerns. This investigation identified four major themes surrounding the preparation and planning for the Pre-NAPLEX® for students that scored less than the historic average score on the Pre-NAPLEX®. These include 1) Organization and Messaging of NAPLEX® Preparation Efforts, 2) Time Management during Competing Obligations, 3) Test Taking Experience, and 4) Curricular Disconnect. Each of these themes provides potentially actionable items to improve how students prepare and plan for the Pre-NAPLEX®, which may be translatable to informing actions to improve results on the actual NAPLEX exam itself.
Collapse
Affiliation(s)
| | - Benjamin Shultz
- University of Illinois Chicago College of Pharmacy, United States of America.
| | - Jeffrey Mucksavage
- University of Illinois Chicago College of Pharmacy, United States of America.
| | - Everton Herrera
- University of Illinois Chicago College of Pharmacy, United States of America.
| | - Scott Benken
- University of Illinois Chicago College of Pharmacy, United States of America.
| |
Collapse
|
32
|
Jones MD, Guiton G, Yost CC, Torr CB, Gong J, Parker TA. Structured Debriefing to Assess Performance of Entrustable Professional Activities. J Grad Med Educ 2024; 16:607-610. [PMID: 39416407 PMCID: PMC11475426 DOI: 10.4300/jgme-d-24-00247.1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/13/2024] [Revised: 08/02/2024] [Accepted: 08/07/2024] [Indexed: 10/19/2024] Open
Abstract
Background The medical workplace presents challenges for workplace-based learning. Structured debriefing of shared clinical experiences has been proposed as a way to take advantage of workplace-based learning in a setting that facilitates deep learning conversations. Objective To investigate faculty and learner acceptance of private, face-to-face, structured debriefing of performance of entrustable professional activities (EPAs). Methods During the 2020-2021 academic year, faculty at the University of Colorado (CU) and the University of Utah (UU) debriefed fellow performance of jointly selected EPAs in neonatal-perinatal medicine pertinent to shared 1- to 3-week clinical rotations. Private face-to-face debriefing was structured by a comprehensive EPA-specific list of behavioral anchors describing 3 levels of entrustment/accomplishment. Sessions ended with joint decisions as to level of entrustment/accomplishment and goals for improvement. We used thematic analysis of semistructured fellow interviews and faculty focus groups to identify themes illustrated with representative quotations. Results We interviewed 17 fellows and 18 faculty. CU participants debriefed after clinical rotations; UU usually debriefed during rotations. Debriefing sessions for 1 to 2 EPAs lasted 20 to 40 minutes. Themes represented in fellow interviews and faculty focus groups suggested that debriefing facilitated formative feedback along with shared understanding of clinical performance and assessment criteria. The standardized format and private conversations supported assessment of aspects of performance for which review might otherwise have been overlooked or avoided. The conversations also provided valuable opportunities for formative discussion of other matters of importance to fellows. Conclusions Structured debriefing of recently shared clinical experiences fostered formative assessment viewed positively by teachers and learners.
Collapse
Affiliation(s)
- M. Douglas Jones
- M. Douglas Jones Jr, MD, is Professor Emeritus, Department of Pediatrics, University of Colorado School of Medicine, Aurora, Colorado, USA, and Associate Editor, Journal of Graduate Medical Education, Chicago, Illinois, USA
| | - Gretchen Guiton
- Gretchen Guiton, PhD, is Associate Professor Emerita, Department of Internal Medicine, and Former Director, Office of Evaluation, University of Colorado School of Medicine, Aurora, Colorado, USA
| | - Christian Con Yost
- Christian Con Yost, MD, is Former Program Director, Neonatal-Perinatal Medicine, and Professor, Department of Pediatrics, University of Utah School of Medicine, Salt Lake City, Utah, USA
| | - Carrie B. Torr
- Carrie B. Torr, MD, MA, is Program Director, Neonatal-Perinatal Medicine, and Assistant Professor Department of Pediatrics, University of Utah School of Medicine, Salt Lake City, Utah, USA
| | - Jennifer Gong
- Jennifer Gong, PhD†, was Assistant Professor, Department of Family Medicine, and Former Assistant Director, Office of Evaluation, University of Colorado School of Medicine, Aurora, Colorado, USA; and
| | - Thomas A. Parker
- Thomas A. Parker, MD, is Program Director, Neonatal-Perinatal Medicine, and Professor, Department of Pediatrics, University of Colorado School of Medicine, Aurora, Colorado, USA
| |
Collapse
|
33
|
Wade DT. Does a service provide safe, effective rehabilitation? An evaluation method for providers and purchasers. Clin Rehabil 2024; 38:1147-1157. [PMID: 39053145 PMCID: PMC11476344 DOI: 10.1177/02692155241259644] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2024] [Accepted: 05/20/2024] [Indexed: 07/27/2024]
Abstract
BACKGROUND Independent organisations monitor the safety and governance of clinical services but do not assess specialist expertise. Peer review can assess service capability but is resource-intense and infeasible. THE PROBLEM How can you ensure a service provides safe, effective rehabilitation? You ask them to provide data as evidence that they can be trusted to do so. This article suggests a structured approach to providing data on entrustability. AN ANALOGY How is the specialist skill of a doctor in training established? They provide evidence about high-level outcomes (capabilities in practice) related to their speciality. An educational supervisor assesses whether they can be trusted to perform safely and effectively without supervision. The capabilities in practice define their expertise. THE SOLUTION A service can use seven high-level rehabilitation service capabilities, based on the clinical capabilities associated with medical training, with observable indicative descriptors, to collect evidence of their rehabilitation approach. A service must also select four to eight high-level competencies indicating they can rehabilitate their patient caseload safely and effectively. These competencies also need indicative descriptors as evidence of their performance in the service; 11 examples are given. CAPABILITIES. The seven rehabilitation capabilities are: using the biopsychosocial model, having a multi-professional team, making a person-centred rehabilitation plan, working collaboratively across all boundaries, tailoring treatments to the patient's needs, ensuring staff have specific competencies required for their caseload, and acknowledging and managing uncertainty and complexity. CONCLUSION. Service providers could use this structured approach to develop and provide users with evidence of their rehabilitation expertise.
Collapse
Affiliation(s)
- Derick T Wade
- Centre for Movement, Occupation and Rehabilitation Sciences (MOReS), Faculty of Health Sciences, Oxford Brookes University, Headington Campus, Oxford OX3 0BP, UK
| |
Collapse
|
34
|
Burke AE, Sklansky DJ, Haftel HM, Mitchell A, Mann KJ. Competency-based medical education and the education continuum: Establishing a framework for lifelong learning. Curr Probl Pediatr Adolesc Health Care 2024; 54:101642. [PMID: 38851971 DOI: 10.1016/j.cppeds.2024.101642] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 06/10/2024]
Affiliation(s)
- Ann E Burke
- Wright State University Boonshoft School of Medicine and Dayton Children's Hospital.
| | - Daniel J Sklansky
- University of Wisconsin School of Medicine and Public Health and American Family Children's Hospital
| | - Hilary M Haftel
- American Academy of Pediatrics, Senior Vice President, Education
| | - Andrew Mitchell
- Wright State University Boonshoft School of Medicine and Dayton Children's Hospital
| | - Keith J Mann
- American Board of Pediatrics, Vice President for Continuing Certification
| |
Collapse
|
35
|
Pool IA, van Zundert H, Ten Cate O. Facilitating flexibility in postgraduate nursing education through entrustable professional activities to address nursing shortages and career prospects. Int Nurs Rev 2024; 71:419-423. [PMID: 37822125 DOI: 10.1111/inr.12892] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2023] [Accepted: 09/18/2023] [Indexed: 10/13/2023]
Abstract
AIM To communicate how the Dutch postgraduate nursing education landscape was redesigned using entrustable professional activities (EPAs). The goal of this initiative was to reduce training time, enhance transfer across nursing specialities and contribute to a better-aligned continuum of initial education, postgraduate education and continuing professional development. BACKGROUND Nursing shortages continue to worsen worldwide. An approach to address this growing shortage is to create a more flexible postgraduate training structure, offering training in the just-in-time and just-as-needed models. EPAs can be used as building blocks for training and assessment. Experience with EPAs (i.e. units of professional practice that can be entrusted once a trainee has demonstrated the required competencies) in health professions education, including nursing, is rising rapidly. While EPAs are largely used to create training flexibility within a programme, they can also be used to create flexibility across programmes. In 2018-2022, training hospitals and education institutions in the Netherlands collaborated in the CZO Flex Level Project to redesign the postgraduate nursing education landscape using EPAs. DISCUSSION The implementation of a flexible postgraduate nursing education model nationwide will face several challenges. An overview of these challenges and suggestions for future research on the effects of the new structure on nursing competence, satisfaction and career development are provided. CONCLUSION EPAs can imbue flexibility within and across training programmes. Designing an EPA-based educational landscape requires nationally coordinated efforts. IMPLICATIONS FOR NURSING POLICY Redesigning educational structures to allow for more flexibility is critical to address major societal challenges in healthcare.
Collapse
Affiliation(s)
- Inge A Pool
- Isala Academy, Isala Hospitals, Zwolle, The Netherlands
| | - Helma van Zundert
- Institute for Accreditation of Health Care Education Programs (CZO), Utrecht, The Netherlands
| | - Olle Ten Cate
- Utrecht Center for Research and Development of Health Professions Education, University Medical Center Utrecht, Utrecht, The Netherlands
| |
Collapse
|
36
|
Abdelghani R, Hassab-El-Naby HMM, Hegazy MS, Hamed O. How to develop entrustable professional activities in a training dermatology program; practical tips for dermatology educators. Arch Dermatol Res 2024; 316:556. [PMID: 39177703 DOI: 10.1007/s00403-024-03285-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2024] [Revised: 07/06/2024] [Accepted: 08/05/2024] [Indexed: 08/24/2024]
Abstract
Entrustable professional activities (EPAs) are units of professional practice that could be observed, assessed, monitored, documented, and entrusted. EPAs when entrusted, outline the physician's qualifications, and shape the scope of practice. This insight highlights the importance of development of EPAs in all medical specialties including dermatology to ensure the best standards for patient's care. Development of EPAs-based training program is considered a challenge for clinical educators. In this paper, we describe practical tips and reflections on our experience in developing EPAs in dermatology doctoral training program that could be a guide for dermatology educators to implement EPAs in dermatology training programs.
Collapse
Affiliation(s)
- Rania Abdelghani
- Dermatology and Venereology Department, Faculty of Medicine for Girls, Al-Azhar University, 3 Al-Fedaa street, Nasr City, Cairo, 11371, Egypt.
- Armed Forces College of Medicine (AFCM), Cairo, Egypt.
| | - Hussein M M Hassab-El-Naby
- Armed Forces College of Medicine (AFCM), Cairo, Egypt
- Dermatology and Venereology, Faculty of Medicine for Boys, Al-Azhar University, Cairo, Egypt
| | - Mohammed Saad Hegazy
- Dermatology and Venereology, Armed Forces College of Medicine, Cairo, Egypt
- Military Medical Academy, Cairo, Egypt
| | - Omayma Hamed
- Medical Education Department, Armed Forces College of Medicine, Cairo, Egypt
| |
Collapse
|
37
|
Doster D, Hunt ML, Thomas CM, Krusing MB, Miller PM, Choi J, Stefanidis D, Matthew Ritter E. Using ACGME General Surgery Milestones to Define the Competent Foundational Surgical Resident. JOURNAL OF SURGICAL EDUCATION 2024; 81:973-982. [PMID: 38749820 DOI: 10.1016/j.jsurg.2024.03.016] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/18/2023] [Revised: 03/06/2024] [Accepted: 03/25/2024] [Indexed: 06/11/2024]
Abstract
OBJECTIVE In transitioning to competency-based surgical training, the need to clearly define competency is paramount. The purpose of this study is to define the well-prepared foundational resident using the ACGME General Surgery Milestones as our conceptual framework. DESIGN Participants reflected on their expectations of a well-prepared resident at the end of PGY1, then assigned milestone levels reflecting this level of competence for General Surgery Milestones 1.0 and 2.0. Subcompetency scores were averaged among residents and faculty. The level of the well-prepared foundational resident was determined based on the highest level within one standard deviation of faculty, resident, and total group averages. SETTING This took place during a dedicated education retreat at a single, large academic general surgery residency program. PARTICIPANTS Key faculty stakeholders and a representative sample of residents (PGY 1-5) within our institution participated. RESULTS Eight faculty and five residents completed Milestones 1.0 and 2.0 scoring. Mean scores between faculty and residents were compared. For 1.0, mean scores for Practice-Based Learning and Improvement 3 (PBLI 3) and Interpersonal Communication Skills 3 (ICS 3) were discernably lower for residents than for faculty (PBLI 3 1.3 (0.3) v 0.9 (0.2), p = 0.01; ICS3 1.6 (0.6) v 1.1 (1), p = 0.01). Scores of 2.0 were comparable across all subcompetency domains. With this broad agreement, Milestone-based competency standards were determined. Descriptive narratives of the KSAs were created for each subcompetency, combining the determined Milestones 1.0 and 2.0 levels. CONCLUSIONS We were able to clearly define the competent foundational resident using the ACGME Milestones as a conceptual framework. These Milestone levels reflect the culture and expectations in our department, providing a foundation upon which to build a program of assessment. This methodology can be readily replicated in other programs to reflect specific expectations of the program within the larger ACGME frameworks of competency.
Collapse
Affiliation(s)
- Dominique Doster
- Department of Surgery, Indiana University School of Medicine, Indianapolis, Indiana
| | - Maya L Hunt
- Department of Surgery, Indiana University School of Medicine, Indianapolis, Indiana.
| | - Christopher M Thomas
- Department of Surgery, Indiana University School of Medicine, Indianapolis, Indiana
| | - Madeline B Krusing
- Department of Surgery, Indiana University School of Medicine, Indianapolis, Indiana
| | - Payton M Miller
- Department of Surgery, Indiana University School of Medicine, Indianapolis, Indiana
| | - Jennifer Choi
- Department of Surgery, Indiana University School of Medicine, Indianapolis, Indiana
| | - Dimitrios Stefanidis
- Department of Surgery, Indiana University School of Medicine, Indianapolis, Indiana
| | - E Matthew Ritter
- Department of Surgery, Indiana University School of Medicine, Indianapolis, Indiana
| |
Collapse
|
38
|
Favier R, Proot J, Matiasovic M, Roos A, Knaake F, van der Lee A, den Toom M, Paes G, van Oostrom H, Verstappen F, Beukers M, van den Herik T, Bergknut N. Towards a flexible and personalised development of veterinarians and veterinary nurses working in a companion animal referral care setting. Vet Med Sci 2024; 10:e1518. [PMID: 38952266 PMCID: PMC11217593 DOI: 10.1002/vms3.1518] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2024] [Revised: 05/15/2024] [Accepted: 06/10/2024] [Indexed: 07/03/2024] Open
Abstract
In the Netherlands, the demand for veterinarians and veterinary nurses (VNs) working within referral care is rapidly growing and currently exceeds the amount of available board-certified specialists. Simultaneously, a transparent structure to guide training and development and to assess quality of non-specialist veterinarians and VNs working in a referral setting is lacking. In response, we developed learning pathways guided by an entrustable professional activity (EPA) framework and programmatic assessment to support personalised development and competence of veterinarians and VNs working in referral settings. Between 4 and 35 EPAs varying per discipline (n = 11) were developed. To date, 20 trainees across five disciplines have been entrusted. Trainees from these learning pathways have proceeded to acquire new EPAs in addition to their already entrusted set of EPAs or progressed to specialist training during (n = 3) or after successfully completing (n = 1) the learning pathway. Due to their outcome-based approach, the learning pathways support flexible ways of development.
Collapse
Affiliation(s)
| | - Joachim Proot
- Evidensia Dierenziekenhuis BarendrechtBarendrechtThe Netherlands
| | | | - Arno Roos
- Evidensia Dierenziekenhuis NieuwegeinNieuwegeinThe Netherlands
| | - Frans Knaake
- Evidensia Dierenziekenhuis Den HaagDen HaagThe Netherlands
| | | | | | - Geert Paes
- IVC Evidensia the NetherlandsVleutenThe Netherlands
| | - Hugo van Oostrom
- Evidensia Dierenziekenhuis BarendrechtBarendrechtThe Netherlands
- Evidensia Dierenziekenhuis ArnhemArnhemThe Netherlands
| | | | - Martijn Beukers
- Evidensia Dierenziekenhuis BarendrechtBarendrechtThe Netherlands
- Evidensia Dierenziekenhuis Hart van BrabantWaalwijkThe Netherlands
| | | | - Niklas Bergknut
- Evidensia Dierenziekenhuis Hart van BrabantWaalwijkThe Netherlands
| |
Collapse
|
39
|
Schumacher DJ, Michelson C, Winn AS, Turner DA, Martini A, Kinnear B. A realist synthesis of prospective entrustment decision making by entrustment or clinical competency committees. MEDICAL EDUCATION 2024; 58:812-824. [PMID: 38088227 DOI: 10.1111/medu.15296] [Citation(s) in RCA: 9] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/11/2023] [Revised: 11/03/2023] [Accepted: 11/21/2023] [Indexed: 06/04/2024]
Abstract
INTRODUCTION The real-world mechanisms underlying prospective entrustment decision making (PEDM) by entrustment or clinical competency committees (E/CCCs) are poorly understood. To advance understanding in this area, the authors conducted a realist synthesis of the published literature to address the following research question: In E/CCC efforts to make defensible prospective entrustment decisions (PEDs), what works, for whom, under what circumstances and why? METHODS Realist work seeks to understand the contexts (C), mechanisms (M) and outcomes (O) that explain how and why things work (or do not). In the authors' study, contexts included individual E/CCC members, E/CCC structures and processes, and training programmes. The outcome (i.e. desired outcome) was a PED. Mechanisms were a substantial focus of the analysis and informed the core findings. To define a final corpus of 52 included papers, the authors searched four databases, screened all results from those searches and performed a full-text review of a subset of screened papers. Data extraction focused on developing context-mechanism-outcome configurations from the papers, which were used to create a theory for how PEDM leads to PEDs. RESULTS PEDM is often driven by default (non-deliberate) decision making rather than a deliberate process of deciding whether a trainee should be entrusted or not. When defaulting, some E/CCCs find red flags that sometimes lead to being more deliberate with decision making. E/CCCs that seek to be deliberate describe PEDM that can be effortful (when data are insufficient or incongruent) or effortless (when data are robust and tell a congruent story about a trainee). Both information about trainee trustworthiness and the sufficiency of data about trainee performance influence PEDM. Several moderators influence what is considered to be sufficient data, how trustworthiness data are viewed and how PEDM is carried out. These include perceived consequences and associated risks, E/CCC member trust propensity, E/CCC member personal knowledge of and experience with trainees and E/CCC structures and processes. DISCUSSION PEDM is rarely deliberate but should be. Data about trainee trustworthiness are foundational to making PEDs. Bias, equity and fairness are nearly absent from the papers in this synthesis, and future efforts must seek to advance understanding and practice regarding the roles of bias, equity and fairness in PEDM.
Collapse
Affiliation(s)
- Daniel J Schumacher
- Cincinnati Children's Hospital Medical Center/University of Cincinnati College of Medicine, Cincinnati, Ohio, USA
| | - Catherine Michelson
- Ann and Robert H. Lurie Children's Hospital of Chicago/Northwestern University, Chicago, Illinois, USA
| | - Ariel S Winn
- Boston Children's Hospital/Harvard Medical School, Boston, Massachusetts, USA
| | - David A Turner
- American Board of Pediatrics, Chapel Hill, North Carolina, USA
| | - Abigail Martini
- Division of Emergency Medicine, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio, USA
| | - Benjamin Kinnear
- Cincinnati Children's Hospital Medical Center/University of Cincinnati College of Medicine, Cincinnati, Ohio, USA
| |
Collapse
|
40
|
Perry R, Forshaw A, Childs J, Chester D, Edwards C. Cultivating Competency in Cardiac Sonography: Aligning Entrustable Professional Activities With Industry Expectations. Heart Lung Circ 2024; 33:1067-1073. [PMID: 38458932 DOI: 10.1016/j.hlc.2024.01.027] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2023] [Revised: 01/17/2024] [Accepted: 01/18/2024] [Indexed: 03/10/2024]
Abstract
BACKGROUND & AIM Echocardiography education involves the teaching and assessment of multiple competencies to ensure work-ready graduates. To connect these competency standards to professional practice, it is important that the industry expectation around specific entrustable professional activities (EPAs) is determined. In Australia, echocardiography examinations are eligible for Medicare reimbursement when performed by sonographers listed on the Australian Sonographers Accreditation Registry (ASAR), either as an Accredited Medical Sonographer or as an Accredited Student Sonographer. A key criterion for acceptance onto the registry is the completion of, or active enrolment in, an accredited cardiac sonography course. Eligible courses apply for accreditation and are assessed by ASAR against their Standards for Accreditation of Sonographer Courses. This study sought to investigate the existing cardiac EPAs and provide insights into the industry's expectations for graduate cardiac sonographers in Australia. METHODS Using an anonymous online survey tool, an invitation to participate was circulated via professional sonography groups and social media platforms. Accredited Medical Sonographers, Accredited Student Sonographers or interested stakeholders (academic, employer, medical specialist) working in Australia or New Zealand were invited to complete the survey. Survey questions were structured around the existing EPAs and knowledge items described in published sonography competency documents. Participants were asked if each individual EPA should be considered appropriate at the threshold of graduation, or at a higher level following a period of working in the profession. RESULTS There were 211 cardiac sonographers who completed the survey. The majority of respondents (148 of 211, 72.2%) indicated that the current EPAs should be updated. At 80% agreement, the following EPAs were considered essential for the graduate: left ventricular structure and function, right ventricular structure and function, atrial size, valvular disease, systemic hypertension, cardiomyopathies, diseases of the aorta, coronary artery disease, pulmonic hypertension, and basic congenital heart disease. This list is more extensive than the current ASAR-endorsed EPAs, and the findings in this research will guide the revision of current ASAR-endorsed EPAs for graduate-level cardiac sonography. CONCLUSIONS The results of this study show Accredited Medical Sonographers completing a cardiac sonography course in Australia should be entrusted to perform a wide range of examinations however, greater alignment between educational providers, ASAR and industry is still required.
Collapse
Affiliation(s)
- Rebecca Perry
- Allied Health and Human Performance, University of South Australia, Adelaide, SA, Australia.
| | - Anthony Forshaw
- School of Clinical Sciences, Faculty of Health, Queensland University of Technology, Brisbane, Qld, Australia
| | - Jessie Childs
- Allied Health and Human Performance, University of South Australia, Adelaide, SA, Australia
| | - Deanne Chester
- School of Health, Medical and Applied Sciences, Central Queensland University, Brisbane, Qld, Australia
| | - Christopher Edwards
- School of Clinical Sciences, Faculty of Health, Queensland University of Technology, Brisbane, Qld, Australia
| |
Collapse
|
41
|
Fu CP, Huang CK, Yang YC, Liao WS, Huang SM, Chang WD, Chen YJ, Li MW, Lin YJ, Wu CL, Chi HY, Lee CY, Chiang FM, Chen YL, Tsou CF, Liu TH, Su CT, Yang AL, Kuo NC, Chang WY. Developing an entrustable professional activity for providing health education and consultation in occupational therapy and examining its validity. BMC MEDICAL EDUCATION 2024; 24:705. [PMID: 38943116 PMCID: PMC11214254 DOI: 10.1186/s12909-024-05670-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Subscribe] [Scholar Register] [Received: 02/03/2024] [Accepted: 06/18/2024] [Indexed: 07/01/2024]
Abstract
BACKGROUND Entrustable Professional Activities (EPA)-based assessment is easily and intuitively used in evaluating the learning outcomes of competency-based medical education (CBME). This study aimed to develop an EPA for occupational therapy focused on providing health education and consultation (TP-EPA3) and examine its validity. METHODS Nineteen occupational therapists who had completed online training on the EQual rubric evaluation participated in this study. An expert committee identified six core EPAs for pediatric occupational therapy. TP-EPA3 was developed following the EPA template and refined through consensus meetings. The EQual rubric, a 14-item, five-point criterion-based anchor system, encompassing discrete units of work (DU), entrustable, essential, and important tasks of the profession (EEIT), and curricular role (CR), was used to evaluate the quality of TP-EPA3. Overall scores below 4.07, or scores for DU, EEIT, and CR domains below 4.17. 4.00, and 4.00, respectively, indicate the need for modifications. RESULTS The TP-EPA3 demonstrated good validity, surpassing the required cut-off score with an average overall EQual score of 4.21 (SD = 0.41). Specific domain scores for DU, EEIT, and CR were 3.90 (SD = 0.69), 4.46 (SD = 0.44), and 4.42 (SD = 0.45), respectively. Subsequent revisions clarified observation contexts, enhancing specificity and focus. Further validation of the revised TP-EPA3 and a thorough examination of its reliability and validity are needed. CONCLUSION The successful validation of TP-EPA3 suggests its potential as a valid assessment tool in occupational therapy education, offering a structured approach for developing competency in providing health education and consultation. This process model for EPA development and validation can guide occupational therapists in creating tailored EPAs for diverse specialties and settings.
Collapse
Affiliation(s)
- Chung-Pei Fu
- Department of Occupational Therapy, College of Medicine, Fu Jen Catholic University, New Taipei City, Taiwan
| | - Ching-Kai Huang
- Department of Rehabilitation, Occupational Therapy, Linkuo Chang Gung Memorial Hospital, Taoyuan, Taiwan
| | - Yi-Chiun Yang
- Department of Rehabilitation, Lotung Poh-Ai Hospital, Yilan, Taiwan
| | - Wei-Sheng Liao
- Department of Rehabilitation, Taipei Medical University Hospital, Taipei, Taiwan
| | - Shih-Min Huang
- Department of Rehabilitation, Sijhih Cathay General Hospital, New Taipei City, Taiwan
| | - Wei-Di Chang
- Department of Rehabilitation, Mackay Memorial Hospital, Taipei, Taiwan
| | - Yi-Ju Chen
- Department of Rehabilitation, Kaohsiung Chang Gung Memorial Hospital, Kaohsiung, Taiwan
| | - Ming-Wei Li
- Department of Rehabilitation, Sijhih Cathay General Hospital, New Taipei City, Taiwan
| | - Yi-Ju Lin
- Department of Rehabilitation, Changhua Christian Hospital, Changhua, Taiwan
| | - Chin-Lung Wu
- Department of Rehabilitation, Changhua Christian Hospital, Changhua, Taiwan
| | - Hsin-Yu Chi
- Department of Rehabilitation, Sijhih Cathay General Hospital, New Taipei City, Taiwan
| | - Chia-Yi Lee
- Department of Rehabilitation, Cathay General Hospital, Taipei, Taiwan
| | - Fu-Mei Chiang
- Department of Physical Medicine and Rehabilitation, National Taiwan University Hospital, Taipei, Taiwan
| | - Yu-Lan Chen
- Department of Physical Medicine and Rehabilitation, Taipei Veterans General Hospital, Taipei, Taiwan
| | - Ching-Fen Tsou
- Department of Rehabilitation, Cathay General Hospital, Taipei, Taiwan
| | - Tzu-Hung Liu
- Department of Family Medicine, Taipei Tzu Chi Hospital, New Taipei City, Taiwan
- School of Medicine, Tzu Chi University, Hualien City, Taiwan
| | - Chia-Ting Su
- Department of Occupational Therapy, College of Medicine, Fu Jen Catholic University, New Taipei City, Taiwan
| | - Ai-Lun Yang
- Institute of Sports Sciences, University of Taipei, Taipei, Taiwan
| | - Nung-Chen Kuo
- Department of Occupational Therapy, Taoyuan General Hospital, Ministry of Health and Welfare,, No. 1492, Zhongshan Rd.,Taoyuan Dist., Taoyuan, 330, Taiwan.
| | - Wan-Ying Chang
- Department of Physical Medicine and Rehabilitation, Taipei Hospital, Ministry of Health and Welfare, No. 127, Su-Yuan Rd., Hsin-Chung Dist., New Taipei City, Taiwan.
| |
Collapse
|
42
|
Nagai M, Oikawa M, Komagata T, Basuana JDB, Ulyabo GK, Minagawa Y, Matsuoka S, Egami Y, Honda M, Tamura T. Clinical competency of nurses trained in competency-based versus objective-based education in the Democratic Republic of the Congo: a qualitative study. HUMAN RESOURCES FOR HEALTH 2024; 22:38. [PMID: 38835031 PMCID: PMC11151529 DOI: 10.1186/s12960-024-00921-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/17/2023] [Accepted: 05/16/2024] [Indexed: 06/06/2024]
Abstract
BACKGROUND Designing competency-based education (CBE) programmes is a priority in global nursing education for better nursing care for the population. In the Democratic Republic of the Congo (DRC), object-based education (OBE) remains mainstream in pre-service nursing education programmes. Recently, the Ministry of Health developed a self-assessment tool and quantitatively compared the clinical competency of CBE- and OBE-trained nurses. This study aimed to qualitatively triangulate the results of self-evaluation by exploring perception of supervisors, incumbent CBE-, and OBE-trained nurses in comparison with the competence of the two types of nurses, and to identify influential factors or barriers to their competence in clinical settings. METHODS A qualitative descriptive approach with conventional content analysis was applied. Twenty interviews with clinical supervisors who oversaw both CBE- and OBE-trained nurses, 22 focus group discussions (FGDs) with CBE-trained nurses, and 21 FGDs with OBA-trained nurses currently working in health facilities were conducted. Participants of the FGDs were selected from the participants of the DRC self-assessment competency comparison study where there was no statistically significance between CBE- and OBE-trained nurses in the demographic characteristics. Data were analysed in terms of the competencies identified by the Ministry of Health. RESULTS The supervisors recognised that the CBE-trained nurses had stronger competencies in professional communication, making decisions about health problems, and engaging in professional development, but were weak in clinical skills. This study identified challenges for supervisors in assuring standardised care in health facilities with OBE- and CBE-trained nurses, as well as barriers for CBE-trained nurses as a minority in the workplace in demonstrating their competencies. CONCLUSIONS The study results support the Ministry of Health's policy to expand CBE in pre-service education programmes but reveal that its slow implementation impedes full utilisation of the acquired competencies at health facilities. Implementation could be accelerated by strengthening cooperation among the Ministry of Health's three human resource departments, and developing and implementing a well-planned, legally binding, long-term CBE reform strategy, including an approach to the Continuing Professional Development system.
Collapse
Affiliation(s)
- Mari Nagai
- Bureau of International Health Cooperation, National Center for Global Health and Medicine, Tokyo, Japan.
| | - Miyuki Oikawa
- National College of Nursing, National Center for Global Health and Medicine, Tokyo, Japan
| | - Tomoko Komagata
- School of Nursing, Tokyo Women's Medical University, Tokyo, Japan
| | | | - Gérard Kahombo Ulyabo
- Department of Health Science Education, Ministry of Public Health, Kinshasa, Democratic Republic of the Congo
| | - Yui Minagawa
- Bureau of International Health Cooperation, National Center for Global Health and Medicine, Tokyo, Japan
| | - Sadatoshi Matsuoka
- Bureau of International Health Cooperation, National Center for Global Health and Medicine, Tokyo, Japan
| | - Yuriko Egami
- Bureau of International Health Cooperation, National Center for Global Health and Medicine, Tokyo, Japan
| | - Mari Honda
- Bureau of International Health Cooperation, National Center for Global Health and Medicine, Tokyo, Japan
| | - Toyomitsu Tamura
- Bureau of International Health Cooperation, National Center for Global Health and Medicine, Tokyo, Japan
| |
Collapse
|
43
|
Kitto S, Fantaye AW, Zevin B, Fowler A, Sachdeva AK, Raiche I. A Scoping Review of the Literature on Entrustable Professional Activities in Surgery Residency Programs. JOURNAL OF SURGICAL EDUCATION 2024; 81:823-840. [PMID: 38679495 DOI: 10.1016/j.jsurg.2024.02.011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/08/2023] [Accepted: 02/20/2024] [Indexed: 05/01/2024]
Abstract
OBJECTIVE Entrustable professional activities (EPAs) are a crucial component of contemporary postgraduate medical education with many surgery residency programs having implemented EPAs as a competency assessment framework to assess and provide feedback on the performance of their residents. Despite broad implementation of EPAs, there is a paucity of evidence regarding the impact of EPAs on the learners and learning environments. A first step in improving understanding of the use and impact of EPAs is by mapping the rising number of EPA-related publications from the field of surgery. The primary objective of this scoping review is to examine the nature, extent, and range of articles on the development, implementation, and assessment of EPAs. The second objective is to identify the experiences and factors that influence EPA implementation and use in practice in surgical specialties. DESIGN Scoping review. Four electronic databases (Medline, Embase, Education Source, and ERIC) were searched on January 20, 2022, and then again on July 19, 2023. A quasi-statistical content analysis was employed to quantify and draw meaning from the information related to the development, implementation, assessment, validity, reliability, and experiences with EPAs in the workplace. PARTICIPANTS A total of 42 empirical and nonempirical articles were included. RESULTS Four thematic categories describe the topic areas in included articles related to: 1) the development and refinement of EPAs, including the multiple steps taken to develop and refine unique EPAs for surgery residency programs; 2) the methods for implementing EPAs; 3) outcomes of EPA use in practice; 4) barriers, facilitators, and areas for improvement for the implementation and use of EPAs in surgical education. CONCLUSIONS This scoping review highlights the key trends and gaps from the rapidly increasing number of publications on EPAs in surgery residency, from development to their use in the workplace. Existing EPA studies lack a theoretical and/or conceptual basis; future development and implementation studies should adopt implementation science frameworks to better structure and operationalize EPAs within surgery residency programs.
Collapse
Affiliation(s)
- Simon Kitto
- Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore
| | - Arone W Fantaye
- Office of Continuing Professional Development, Faculty of Medicine, University of Ottawa, Ottawa, Canada
| | - Boris Zevin
- Department of Surgery, Queen's University, Kingston, Canada
| | - Amanda Fowler
- Department of Surgery, Memorial University of Newfoundland, St. John's, Newfoundland, Canada
| | - Ajit K Sachdeva
- Division of Education, American College of Surgeons, Chicago, Illinios
| | - Isabelle Raiche
- Department of Surgery, University of Ottawa, Ottawa, Canada.
| |
Collapse
|
44
|
Chopra S, Harley JM, Keuhl A, Bassilious E, Sherbino J, Bilgic E. Understanding Emotions Impacted by New Assessment Mandates Implemented in Medical Education: A Survey of Residents and Faculty Across Multiple Specialties. Cureus 2024; 16:e62013. [PMID: 38983997 PMCID: PMC11233152 DOI: 10.7759/cureus.62013] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/31/2024] [Indexed: 07/11/2024] Open
Abstract
Background Previous research findings show that the overall perception of residents regarding the new entrustable professional activity (EPA) assessment mandates is primarily negative. Hence, this study aims to explore the link between EPA assessment experiences and resident and faculty emotions and expectancy of successfully completing residency training. Methods A standardized questionnaire (Medical Emotions Scale (MES)), which measures 20 unique emotions on a 5-point Likert scale, was used to explore the emotions of residents and faculty members regarding EPA assessments and residents' expectancy of success. Data analysis included descriptive statistics and analysis of variance (ANOVA). Results Ninety-one (N=91) participants (46 faculty members and 45 residents) completed the survey. The results revealed that residents have more negative emotions toward EPA assessments compared to faculty. Additionally, resident and faculty emotions regarding EPA assessments vary across specialty and gender. Conclusions These findings will be crucial in providing the Royal College of Physicians and Surgeons of Canada and medical education programs with concrete evidence and guidance in understanding the perspectives and emotions of residents and faculty towards EPA assessments and residents' beliefs about successfully completing their medical training.
Collapse
Affiliation(s)
- Sonaina Chopra
- McMaster Education Research, Innovation and Theory (MERIT) Program, McMaster University, Hamilton, CAN
| | | | - Amy Keuhl
- McMaster Education Research, Innovation and Theory (MERIT) Program, McMaster University, Hamilton, CAN
| | | | - Jonathan Sherbino
- McMaster Education Research, Innovation and Theory (MERIT) Program, McMaster University, Hamilton, CAN
- Emergency Medicine, McMaster University, Hamilton, CAN
| | - Elif Bilgic
- McMaster Education Research, Innovation and Theory (MERIT) Program, McMaster University, Hamilton, CAN
- Pediatrics, McMaster University, Hamilton, CAN
| |
Collapse
|
45
|
Chlebowski MM, Migally K, Werho DK, Sznycer-Taub N, Rhodes LA, Szadkowski A, Hupp S, Sacks LD, Chen J, Zyblewski SC. Cardiac Critical Care Fellowship Training in the United States and Canada: Pediatric Cardiac Intensive Care Society-Endorsed Subcompetencies to the 2022 Entrustable Professional Activities. Pediatr Crit Care Med 2024; 25:e303-e309. [PMID: 38329380 DOI: 10.1097/pcc.0000000000003464] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/09/2024]
Abstract
OBJECTIVES We aimed to define and map subcompetencies required for pediatric cardiac critical care (PCCC) fellowship education and training under the auspices of the Pediatric Cardiac Intensive Care Society (PCICS). We used the 2022 frameworks for PCCC fellowship learning objectives by Tabbutt et al and for entrustable professional activities (EPAs) by Werho et al and integrated new subcompetencies to the EPAs. This complementary update serves to provide a foundation for standardized trainee assessment tools for PCCC. DESIGN A volunteer panel of ten PCICS members who are fellowship education program directors in cardiac critical care used a modified Delphi method to develop the update and additions to the EPA-based curriculum. In this process, the experts rated information independently, and repetitively after feedback, before reaching consensus. The agreed new EPAs were later reviewed and unanimously accepted by all PCICS program directors in PCCC in the United States and Canada and were endorsed by the PCICS in 2023. PROCEDURE AND MAIN RESULTS The procedure for defining new subcompetencies to the established EPAs comprised six consecutive steps: 1) literature search; 2) selection of key subcompetencies and curricular components; 3) written questionnaire; 4) consensus meeting and critical evaluation; 5) approval by curriculum developers; and 6) PCICS presentation and endorsement. Overall, 110 subcompetencies from six core-competency domains were mapped to nine EPAs with defined levels of entrustment and examples of simple and complex cases. To facilitate clarity and develop a future assessment tool, three EPAs were subcategorized with subcompetencies mapped to the appropriate subcategory. The latter covering common procedures in the cardiac ICU. CONCLUSIONS This represents the 2023 update to the PCCC fellowship education and training EPAs with the defining and mapping of 110 subcompetencies to the nine established 2022 EPAs. This goal of this update is to serve as the next step in the integration of EPAs into a standardized competency-based assessment framework for trainees in PCCC.
Collapse
Affiliation(s)
- Meghan M Chlebowski
- Division of Pediatric Cardiology, Department of Pediatrics, Cincinnati Children's Hospital, University of Cincinnati, Cincinnati, OH
| | - Karl Migally
- Division of Pediatric Cardiology, Ann & Robert H. Lurie Children's Hospital of Chicago, Northwestern University Feinberg School of Medicine, Chicago, IL
| | - David K Werho
- Division of Pediatric Cardiology, Rady Children's Hospital-San Diego, University of California San Diego, San Diego, CA
| | - Nathaniel Sznycer-Taub
- Division of Pediatric Cardiology, Department of Pediatrics, University of Michigan, Ann Arbor, MI
| | - Leslie A Rhodes
- Division of Pediatric Cardiology, Department of Pediatrics, University of Alabama, Birmingham, AL
| | - Adam Szadkowski
- Division of Pediatric Critical Care, Department of Pediatrics, Medical College of Wisconsin, Milwaukee, WI
| | - Susan Hupp
- Divisions of Cardiology and Critical Care Medicine, Department of Pediatrics, Emory University, Atlanta, GA
| | - Loren D Sacks
- Division of Pediatric Cardiology, Department of Pediatrics, Stanford University, Stanford, CA
| | - Jodi Chen
- Division of Cardiac Critical Care Medicine, Department of Anesthesiology and Critical Care Medicine, Children's Hospital of Philadelphia, University of Pennsylvania, Philadelphia, PA
| | - Sinai C Zyblewski
- Division of Pediatric Cardiology, Department of Pediatrics, Medical University of South Carolina, Charleston, SC
| |
Collapse
|
46
|
de Laat JM, van der Horst-Schrivers AN, Appelman-Dijkstra NM, Bisschop PH, Dreijerink KM, Drent ML, van de Klauw MM, de Ranitz WL, Stades AM, Stikkelbroeck NM, Timmers HJ, ten Cate O. Assessment of Entrustable Professional Activities Among Dutch Endocrine Supervisors. JOURNAL OF CME 2024; 13:2360137. [PMID: 38831939 PMCID: PMC11146265 DOI: 10.1080/28338073.2024.2360137] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/04/2024] [Accepted: 05/19/2024] [Indexed: 06/05/2024]
Abstract
Entrustable Professional Activities (EPAs) are an important tool to support individualisation of medical training in a competency-based setting and are increasingly implemented in the clinical speciality training for endocrinologist. This study aims to assess interrater agreement and factors that potentially impact EPA scores. Five known factors that affect entrustment decisions in health profesions training (capability, integrity, reliability, humility, agency) were used in this study. A case-vignette study using standardised written cases. Case vignettes (n = 6) on the topics thyroid disease, pituitary disease, adrenal disease, calcium and bone disorders, diabetes mellitus, and gonadal disorders were written by two endocrinologists and a medical education expert and assessed by endocrinologists experienced in the supervision of residents in training. Primary outcome is the inter-rater agreement of entrustment decisions for endocrine EPAs among raters. Secondary outcomes included the dichotomous interrater agreement (entrusted vs. non-entrusted), and an exploration of factors that impact decision-making. The study protocol was registered and approved by the Ethical Review Board of the Netherlands Association for Medical Education (NVMO-ERB # 2020.2.5). Nine endocrinologists from six different academic regions participated. Overall, the Fleiss Kappa measure of agreement for the EPA level was 0.11 (95% CI: 0.03-0.22) and for the entrustment decision 0.24 (95% CI 0.11-0.37). Of the five features that impacted the entrustment decision, capability was ranked as the most important by a majority of raters (56%-67%) in every case. There is a considerable discrepancy between the EPA levels assigned by different raters. These findings emphasise the need to base entrustment decisions on multiple observations, made by a team of supervisors and enriched with factors other than direct medical competence.
Collapse
Affiliation(s)
- Joanne M. de Laat
- Department of Internal Medicine, Division of Endocrinology, Radboud University Medical Center, Nijmegen, The Netherlands
- Utrecht Center for Research and Development of Health Professions Education, University Medical Center Utrecht, Utrecht, The Netherlands
| | | | | | - Peter H. Bisschop
- Department of Endocrinology and Metabolism, Amsterdam UMC, Location Academic Medical Center, Amsterdam, The Netherlands
| | - Koen M.A. Dreijerink
- Department of Internal Medicine, Amsterdam UMC, Location VU University Medical Center, Amsterdam, The Netherlands
| | - Madeleine L. Drent
- Department of Internal Medicine, Amsterdam UMC, Location VU University Medical Center, Amsterdam, The Netherlands
| | - Melanie M. van de Klauw
- Department of Endocrinology, University Medical Center Groningen, Groningen, The Netherlands
| | - Wendela L. de Ranitz
- Department of Endocrinology, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Aline M.E. Stades
- Department of Endocrinology, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Nike M.M.L. Stikkelbroeck
- Department of Internal Medicine, Division of Endocrinology, Radboud University Medical Center, Nijmegen, The Netherlands
| | - Henri J.L.M. Timmers
- Department of Internal Medicine, Division of Endocrinology, Radboud University Medical Center, Nijmegen, The Netherlands
| | - Olle ten Cate
- Utrecht Center for Research and Development of Health Professions Education, University Medical Center Utrecht, Utrecht, The Netherlands
| |
Collapse
|
47
|
Monti M, Pittet V, Frick S, Gachoud D. A multi-method approach to drafting candidate entrustable professional activities for a general internal medicine residency programme. Swiss Med Wkly 2024; 154:3592. [PMID: 38801750 DOI: 10.57187/s.3592] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/29/2024] Open
Abstract
INTRODUCTION Entrustable professional activities (EPAs) are units of concrete daily clinical tasks that trainee physicians should be able to handle with increasing autonomy during their postgraduate training. EPAs are gaining international recognition as an essential component of competency-based medical training programmes. The process of developing EPAs for a nationwide training programme is complex and requires an in-depth understanding of EPAs as a concept and good knowledge of appropriate development processes. This article provides a detailed description of the methodology and results of a multi-step approach for developing a list of candidate EPAs for Switzerland's postgraduate training programme in general internal medicine (GIM). METHODS We took a multi-step approach including a systematic review of international literature, four national focus groups, a national consensus process using a RAND appropriateness method, and a quality check of the selected candidate EPAs using EQual criteria. RESULTS These steps generated a final list of 247 candidate EPAs in general internal medicine that were submitted for the national consensus process. After two rounds of rating, experts agreed on the appropriateness for general internal medicine postgraduate training of 225 candidate EPAs. Twenty-two were deemed inappropriate, and disagreement persisted only for two EPAs. DISCUSSION This multi-step programme is one of the few describing in detail the process of developing a list of EPAs and providing evidence of validity at each step. The clinical breadth of our candidate EPAs, together with the detailed description of our methodology, could serve as a useful starting point from which medical education specialists or clinicians could develop or revise applicable lists of EPAs, particularly for postgraduate training programmes in either general internal medicine or family medicine.
Collapse
Affiliation(s)
- Matteo Monti
- Division of Internal Medicine, Lausanne University Hospital, Lausanne, Switzerland
- Medical Education Unit, School of Medicine, Faculty of Biology and Medicine, University of Lausanne, Lausanne, Switzerland
| | - Valérie Pittet
- Department of Epidemiology and Health Systems, Center for Primary Care and Public Health, University of Lausanne, Lausanne, Switzerland
| | - Sonia Frick
- Postgraduate Education Committee, Swiss Society of General Internal Medicine, Bern, Switzerland
- Swiss Institute for Postgraduate and Continuing Education in Medicine, Bern, Switzerland
| | - David Gachoud
- Division of Internal Medicine, Lausanne University Hospital, Lausanne, Switzerland
- Medical Education Unit, School of Medicine, Faculty of Biology and Medicine, University of Lausanne, Lausanne, Switzerland
| |
Collapse
|
48
|
Andreou V, Peters S, Eggermont J, Schoenmakers B. Co-designing Entrustable Professional Activities in General Practitioner's training: a participatory research study. BMC MEDICAL EDUCATION 2024; 24:549. [PMID: 38760773 PMCID: PMC11100052 DOI: 10.1186/s12909-024-05530-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/25/2023] [Accepted: 05/07/2024] [Indexed: 05/19/2024]
Abstract
BACKGROUND In medical education, Entrustable Professional Activities (EPAs) have been gaining momentum for the last decade. Such novel educational interventions necessitate accommodating competing needs, those of curriculum designers, and those of users in practice, in order to be successfully implemented. METHODS We employed a participatory research design, engaging diverse stakeholders in designing an EPA framework. This iterative approach allowed for continuous refinement, shaping a comprehensive blueprint comprising 60 EPAs. Our approach involved two iterative cycles. In the first cycle, we utilized a modified-Delphi methodology with clinical competence committee (CCC) members, asking them whether each EPA should be included. In the second cycle, we used semi-structured interviews with General Practitioner (GP) trainers and trainees to explore their perceptions about the framework and refine it accordingly. RESULTS During the first cycle, 14 CCC members agreed that all the 60 EPAs should be included in the framework. Regarding the formulation of each EPAs, 20 comments were given and 16 adaptations were made to enhance clarity. In the second cycle, the semi-structured interviews with trainers and trainees echoed the same findings, emphasizing the need of the EPA framework for improving workplace-based assessment, and its relevance to real-world clinical scenarios. However, trainees and trainers expressed concerns regarding implementation challenges, such as the large number of EPAs to be assessed, and perception of EPAs as potentially high-stakes. CONCLUSION Accommodating competing stakeholders' needs during the design process can significantly enhance the EPA implementation. Recognizing users as experts in their own experiences empowers them, enabling a priori identification of implementation barriers and potential pitfalls. By embracing a collaborative approach, wherein diverse stakeholders contribute their unique viewpoints, we can only create effective educational interventions to complex assessment challenges.
Collapse
Affiliation(s)
- Vasiliki Andreou
- Academic Centre for General Practice, Department of Public Health and Primary Care, KU Leuven, Leuven, Belgium.
- Department of Public Health and Primary Care, KU Leuven, Box 7001, Kapucijnenvoer 7, Leuven, 3000, Belgium.
| | - Sanne Peters
- Academic Centre for General Practice, Department of Public Health and Primary Care, KU Leuven, Leuven, Belgium
- School of Health Sciences, Faculty of Medicine, Dentistry and Health Sciences, The University of Melbourne, Melbourne, Australia
| | - Jan Eggermont
- Department of Cellular and Molecular Medicine, KU Leuven, Leuven, Belgium
| | - Birgitte Schoenmakers
- Academic Centre for General Practice, Department of Public Health and Primary Care, KU Leuven, Leuven, Belgium
| |
Collapse
|
49
|
Alkhelaiwi WA, Traynor M, Rogers K, Wilson I. Assessing the Competence of Nursing Students in Clinical Practice: The Clinical Preceptors' Perspective. Healthcare (Basel) 2024; 12:1031. [PMID: 38786441 PMCID: PMC11121458 DOI: 10.3390/healthcare12101031] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2024] [Revised: 05/08/2024] [Accepted: 05/10/2024] [Indexed: 05/25/2024] Open
Abstract
Nursing students' integration of theoretical knowledge and practical abilities is facilitated by their practice of nursing skills in a clinical environment. A key role of preceptors is to assess the learning goals that nursing students must meet while participating in clinical practice. Consequently, the purpose of this study was to explore the current evidence in relation to competency assessment and assessment approaches, and the willingness of preceptors for assessing nursing students' competency in a clinical setting. The scoping review used the five-stage methodological framework that was developed by Arksey and O'Malley, as well as the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews. Relevant studies were searched by applying a comprehensive literature search strategy up to April 2024 across the following databases: CINAHL, OVID MEDLINE, EMBASE, and PUBMED. A total of 11,297 studies published between 2000 and April 2024 were revealed, and 38 were eligible for inclusion, which the research team categorised into three main themes: definitions of competence, tools for assessing competence and preceptors' and mentors' viewpoints in relation to the assessment of nursing students' competence. This review established that there are a multitude of quantitative instruments available to assess clinical competence; however, a lack of consistency among assessment instruments and approaches between countries and higher education institutions is prevalent. Existing research evidence suggests that the preceptors carried out the assessment process clinically and they found difficulties in documenting assessment. The assessing of nursing students' competency and the complexity of assessment is a concern for educators and mentors worldwide. The main concern centers around issues such as the interpretation of competence and complex measurement tools.
Collapse
Affiliation(s)
- Watin Arif Alkhelaiwi
- Nursing Department, Faculty of Applied Medical Science, Jouf University, Sakaka 72388, Aljouf Region, Saudi Arabia
- School of Nursing and Midwifery, Queen’s University Belfast, Belfast BT9 7BL, UK; (M.T.); (K.R.); (I.W.)
| | - Marian Traynor
- School of Nursing and Midwifery, Queen’s University Belfast, Belfast BT9 7BL, UK; (M.T.); (K.R.); (I.W.)
| | - Katherine Rogers
- School of Nursing and Midwifery, Queen’s University Belfast, Belfast BT9 7BL, UK; (M.T.); (K.R.); (I.W.)
| | - Iseult Wilson
- School of Nursing and Midwifery, Queen’s University Belfast, Belfast BT9 7BL, UK; (M.T.); (K.R.); (I.W.)
- College of Nursing and Midwifery, Mohammed Bin Rashid University, Dubai P.O. Box 505055, United Arab Emirates
| |
Collapse
|
50
|
Montgomery KB, Mellinger JD, Lindeman B. Entrustable Professional Activities in Surgery: A Review. JAMA Surg 2024; 159:571-577. [PMID: 38477902 PMCID: PMC11260519 DOI: 10.1001/jamasurg.2023.8107] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/14/2024]
Abstract
Importance Entrustable professional activities (EPAs) compose a competency-based education (CBE) assessment framework that has been increasingly adopted across medical specialties as a workplace-based assessment tool. EPAs focus on directly observed behaviors to determine the level of entrustment a trainee has for a given activity of that specialty. In this narrative review, we highlight the rationale for EPAs in general surgery, describe current evidence supporting their use, and outline some of the practical considerations for EPAs among residency programs, faculty, and trainees. Observations An expanding evidence base for EPAs in general surgery has provided moderate validity evidence for their use as well as practical recommendations for implementation across residency programs. Challenges to EPA use include garnering buy-in from individual faculty and residents to complete EPA microassessments and engage in timely, specific feedback after a case or clinical encounter. When successfully integrated into a program's workflow, EPAs can provide a more accurate picture of residents' competence for a fundamental surgical task or activity compared with other assessment methods. Conclusions and Relevance EPAs represent the next significant shift in the evaluation of general surgery residents as part of the overarching progression toward CBE among all US residency programs. While pragmatic challenges to the implementation of EPAs remain, the best practices from EPA and other CBE assessment literature summarized in this review may assist individuals and programs in implementing EPAs. As EPAs become more widely used in general surgery resident training, further analysis of barriers and facilitators to successful and sustainable EPA implementation will be needed to continue to optimize and advance this new assessment framework.
Collapse
|