Minireviews Open Access
Copyright ©The Author(s) 2022. Published by Baishideng Publishing Group Inc. All rights reserved.
World J Gastrointest Endosc. Sep 16, 2022; 14(9): 512-523
Published online Sep 16, 2022. doi: 10.4253/wjge.v14.i9.512
Simulation-based mastery learning in gastrointestinal endoscopy training
Hasan Maulahela, Ari Fahrial Syam, Roy Soetikno, Department of Internal Medicine, Gastroenterology Division, Faculty of Medicine University of Indonesia-Cipto Mangunkusumo General Central National Hospital, Jakarta 10430, Indonesia
Nagita Gianty Annisa, Tiffany Konstantin, Faculty of Medicine, University of Indonesia, Jakarta 10430, Indonesia
ORCID number: Hasan Maulahela (0000-0002-0396-4433); Nagita Gianty Annisa (0000-0001-9708-0454); Tiffany Konstantin (0000-0003-2086-9531); Ari Fahrial Syam (0000-0003-0041-3553).
Author contributions: Maulahela H conceived the study, and wrote and edited the manuscript; Annisa NG performed the data analysis and drafted the manuscript; Konstantin T edited and finalized the manuscript for submission; Syam AF and Soetikno R reviewed and approved the submitted manuscript.
Conflict-of-interest statement: All authors declares that they have no conflict of interest.
Open-Access: This article is an open-access article that was selected by an in-house editor and fully peer-reviewed by external reviewers. It is distributed in accordance with the Creative Commons Attribution NonCommercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: https://creativecommons.org/Licenses/by-nc/4.0/
Corresponding author: Hasan Maulahela, MD, Assistant Professor, Department of Internal Medicine, Gastroenterology Division, Faculty of Medicine University of Indonesia-Cipto Mangunkusumo General Central National Hospital, Jl. Pangeran Diponegoro No. 71 RW.5, Kenari, Kec. Senen, Jakarta 10430, Indonesia. hasan.maulahela@yahoo.com
Received: June 4, 2022
Peer-review started: June 4, 2022
First decision: June 18, 2022
Revised: July 3, 2022
Accepted: August 16, 2022
Article in press: August 16, 2022
Published online: September 16, 2022

Abstract

Simulation-based mastery learning (SBML) is an emerging form of competency-based training that has been proposed as the next standard method for procedural task training, including that in gastrointestinal endoscopy. Current basic gastrointestinal endoscopy training relies on the number of procedures performed, and it has been criticized for its lack of objective standards that result in variable skills among trainees and its association with patient safety risk. Thus, incorporating simulators into a competency-based curriculum seems ideal for gastrointestinal endoscopy training. The curriculum for SBML in gastrointestinal endoscopy is currently being developed and has promising potential to translate into the clinical performance. Unlike the present apprenticeship model of “see one, do one, teach one,” SBML integrates a competency-based curriculum with specific learning objectives alongside simulation-based training. This allows trainees to practice essential skills repeatedly, receive feedback from experts, and gradually develop their abilities to achieve mastery. Moreover, trainees and trainers need to understand the learning targets of the program so that trainees can focus their learning on the necessary skills and trainers can provide structured feedback based on the expected outcomes. In addition to learning targets, an assessment plan is essential to provide trainees with future directions for their improvement and ensure patient safety by issuing a passing standard. Finally, the SBML program should be planned and managed by a specific team and conducted within a developed and tested curriculum. This review discusses the current state of gastrointestinal endoscopy training and the role of SBML in that field.

Key Words: Simulation training, Education, Endoscopy, Mastery learning, Competency-based education, Curriculum

Core Tip: The traditional apprenticeship model for gastrointestinal training has been widely criticized for its lack of standards and patient safety risks. Thus, the basic gastrointestinal endoscopy training method needs to be revised from the apprenticeship model to a simulation-based mastery learning (SBML) model, which relies on specific learning objectives with the integration of simulators. SBML is a competency-based training method aimed at creating highly competent trainees and reducing differences in skills among them. The present review discusses the current state of gastrointestinal endoscopy training, the role of SBML in that field, and recent experiences and future prospects of SBML.



INTRODUCTION

Endoscopy is the gold standard technique for the diagnosis of various gastrointestinal (GI) tract diseases and also allows examiners to directly provide therapeutic interventions if needed. This procedure is performed by a trained gastroenterologist or endoscopic surgeon. The need for endoscopic procedures is projected to increase every year due to the growing prevalence of GI diseases and technical improvements in GI endoscopy[1]. Most GI endoscopy training still follows the traditional apprenticeship model of “see one, do one, teach one.” This model relies on the number of exposures to procedural caseloads, which causes varying results among trainees[2]. This lack of a standardized curriculum has recently come under intense scrutiny because it is associated with patient safety risks, as trainees cannot safely perform a medical procedure after having observed it only once[3].

A mastery learning model is an approach to competency-based training, in which participants must acquire specific skills before moving on to the next stage of training. The basic principle of mastery learning is that all participants can achieve the highest standard of learning objectives with the minimum possible variation in results. Meta-analyses show that mastery learning significantly leads to skill improvement, has a moderate effect on patient outcomes compared to the traditional apprenticeship method, but might demand more time than other methods. Mastery learning-based training provides consistent positive results and has a beneficial effect on both patient care and the budget spent during the training process[4].

A simulation-based training (SBT) method has been also proposed as an alternative to replace the old teaching method. The use of simulators to acquire psychomotor abilities has been widely studied and recommended by leading educational institutions. With a SBT method, trainees can achieve procedural competence without compromising patient safety, particularly in those procedures that require practical experience and visual-spatial skills[5]. Additionally, skills of the operator can be improved and the length of the procedure reduced by using a simulator. Finally, simulators can also be used to evaluate trainee progress[6].

SBT and mastery learning methods have several benefits over the traditional apprenticeship model. This article reviews the role of simulation-based mastery learning (SBML) in GI endoscopy and describes the planning and management for the implementation of this model, including experiences regarding its application.

DEVELOPMENT OF GI ENDOSCOPY TRAINING

Since 1962, the American Society for Gastrointestinal Endoscopy has held symposiums about teaching methods in GI endoscopy and later formed a formal endoscopy training program. Along with the development of science and advancement in the complexity of endoscopic procedures, gastroenterological education began to be developed independently as part of a subspecialty of internal medicine[4]. The development of specific training in endoscopy and gastroenterology also impacted the education period for this field, which initially consisted of 1 year to 2 years and then was extended to 3 years[4]. Currently, there is no global standardization of the gastroenterology education length. Some countries, such as the Netherlands, are now expanding their gastroenterology curriculum to 3 years to 4 years, starting with 2 years of general internal medicine training[7,8]. In Korea, endoscopy training is conducted for 1 year to 2 years during a gastroenterology fellowship program[9]. Meanwhile, in Japan, a physician must complete 3 years of internal medicine residency and 5 years of gastroenterology fellowship to become a board-certified endoscopist[10]. The World Gastroenterology Organization states that a student must complete 3 years of internal medicine residency before pursuing gastroenterological-specific education and training for the next 3 years[11].

The current state of endoscopy training is defined by the conventional apprenticeship model, with a strong emphasis on case/procedure volume and without a formal curriculum. Trainees are usually assigned the minimum number of cases or procedures they need to achieve competency or practical eligibility. The duration of the training program is commonly fixed, and an assessment is conducted near the end of the program. This training method has potential variability in terms of skill outcomes. As trainees might be overwhelmed at the start of the program, the initial cases they encounter can be ineffective for learning. A European survey showed significant differences in various gastroenterology training among 16 European countries, ranging from the minimum number of procedures required, training period, form of supervision to whether some interventional procedures were performed[12]. Recently, curriculum-based medical education (CBME) has recently been proposed to improve endoscopy training. The CBME model includes The American Society of Gastrointestinal Endoscopy Skills, Training, Assessment, and Reinforcement program with a curriculum that combines hands-on training, formative feedback, and postcourse skills and knowledge assessments[13].

One of the learning methods that has been developed for endoscopy training is a simulated-based approach. Endoscopy simulator models have continued to be developed and advanced in the last decades, ranging from mechanical simulators, animal model simulations, and computer simulators[14]. The evolution of endoscopy simulators is described in Table 1. These developments provide opportunities for trainees to learn various diagnostic and therapeutic techniques. Generally, these simulators use an endoscope that is inserted into a mannequin. Consequently, trainees can be more familiar with endoscopic procedures and be able to practice them on an actual patient. Some advanced computer simulators also provide a realistic picture on the monitor and can simulate a patient’s response. The computer simulator also combines training to learn hand-eye coordination, recognition of pathological features, and immediate feedback output[15]. A systematic review showed that skills acquired from SBT were transferable to the clinical setting, as participants of SBT scored higher global assessment scores and fewer errors[16]. Moreover, forms of simulation that can be considered in endoscopy training include the following[17-24].

Table 1 Development of endoscopy simulators.
Ref.
Developer
Yr
Characteristics
Telleman et al[19], 2009Erlangen-Nuremberg University Clinic1974An anatomical model of the esophagus, stomach, and duodenum used to train for endoscopic maneuvers
Williams et al[20], 2000Imperial College/St Mark’s Hospital1980An anatomical model of the colon to train for angling maneuver in the organ
Constant supervision is needed because trainees could damage the endoscope by excessive maneuvering
The appearance of the colon surface is not realistic in the model
Classen and Ruppin[21], 1974Imperial College/St Mark’s Hospital1980More realistic control compared to previous models as the endoscope can be rotated, and endoscope insertion and withdrawal can be detected
Integrated with a monitor showing live simulation
The length of the endoscope that can be inserted is limited
Williams et al[22], 1990Imperial College/St Mark’s Hospital1985The endoscope can be fully inserted
A sensation of resistance and an audio simulation that mimics patient’s complaints are included
Still unrealistic
Long and Kalloo[15], 2006Immersion Medical2001Provides an opportunity to practice various procedures, including biopsy
Provides immediate feedback
Realistic simulation as a sensation of resistance and contraction is included
Koch et al[23], 2008Simbionix2008Provides realistic simulation
Can be used to practice endoscopic maneuvers
Can distinguish between the ability level of endoscopy experts and intermediate level
Triantafyllou[24], 2014CAE Healthcare2013Can be accompanied by the patient’s history and various clinical parameters that can change during the endoscopy by the participant
Combines endoscopic procedures with virtual backgrounds

Patient simulation: A simulated mannequin that resembles a human with respiration, pulse, and other vital signs is used. This type of simulation can be used for simple physical examination scenarios.

Clinical environment simulation: In this simulation, a room that resembles an actual clinical practice room, for example, an operating room, is prepared. Thus, trainees become more familiar with the actual situation.

Virtual procedure simulation: These simulations have equipment relevant to the procedure, such as esophagogastroduodenoscopy or colonoscopy, and can also present various disease scenarios according to the needs of trainees.

Electronic medical record simulation: This simulation uses artificial data about cases, including disease history and laboratory results, which can be integrated with other systems.

MASTERY LEARNING IN GI ENDOSCOPY

Mastery learning is a form of competency-based training in which trainees have to achieve specific skills or be deemed good enough to perform a procedure before moving on to the next stage of training. Competence is the minimum level of skill, knowledge, or expertise acquired through training necessary to perform a task or procedure and to ensure that safe and technically successful procedures are carried out and that observations and results are accurate[25,26]. Mastery learning focuses on the trainees instead of the patient. The old teaching has resulted in inconsistent teaching, testing, and retention of skills, while mastery learning demands trainees to acquire and maintain specific skills and knowledge through deliberate practice without time limit. Deliberate practice consists of nine elements: highly motivated learners with good concentration, clear learning objectives, an appropriate difficulty level, repetitive practice, rigorous measurements, informative feedback, monitoring and error correction, performance evaluation, and advancement to the next task[27]. Mastery learning effectively develops both therapeutic skill and high self efficacy to utilize the skill[28].

Mastery of basic endoscopic techniques is essential for every endoscopist, because if the procedure is performed incorrectly, it can cause severe complications that might threaten the condition of patients. The essential steps of endoscopy are endoscope insertion, precise observation, and appropriate imaging[29]. Skills developed by each endoscopist may vary and are influenced by differences among supervisors during the procedure. Hence, standardized training is necessary to maintain the competence of trainees[30].

Traditionally, competence in endoscopy is acquired after completing a specific number of recommended procedures based on expert opinions published by medical gastroenterology societies or associations, as described in Table 2. However, according to the aforementioned mastery learning principles, competence cannot be determined only by the number of procedures performed. A defined and detailed assessment tool should be incorporated to objectively assess trainees to deliver high-quality care[31].

Table 2 Minimum number of trainings needed to achieve competence in different procedures according to gastroenterology associations.
Source
EGD
Colonoscopy
ERCP
European Diploma of Gastroenterology[32]300100150
ASGE[33]130140200
SAGES[34]3550-
Korean Society of Gastrointestinal Endoscopy[35]100015030
British Society of Gastroenterology[36]300100150

To ensure competence in mastery learning, two aspects are needed: training and subsequent assessment by endoscopy experts or trainers. Through this training, trainees acquire the necessary technical and cognitive skills[25]. Examples of technical and psychomotor skills associated with endoscopy include scope handling and strategies for scope advancement, loop reduction, recall, and mucosal inspection. Cognitive competence reflects knowledge acquired about endoscopy and its application in clinical practice. Cognitive skills include choosing the most appropriate endoscopy test to assess and treat clinical problems, recognizing the lesion, and managing sedation. Crucial integrative competencies to endoscopy include decision-making, teamwork, communication, leadership, awareness of the situation, professionalism, and patient safety awareness[26].

Based on the psychological aspect, three factors underlie mastery learning: Behavioral development, constructive learning, and social cognition. Behavioral development pursues the acquisition and maintenance of technical and communication skills. Clinical thinking, community approach, ethics, advocacy, and regular self-reflection aim to shape social and cognitive constructs. Social cognition is a prerequisite for professionalism. These three aspects support the formation of SBML, which includes a curriculum design to set learning objectives[32-37].

SIMULATION-BASED TRAINING IN GI ENDOSCOPY

The SBML method uses an instructional approach, meaning that trainees must have a certain level of competence in a simulated environment before performing procedures on actual patients[24]. With this method, trainees progress through different simulations with increasing difficulty. SBML provides opportunities for students to practice as often as possible to improve their performance before operating on patients. This method can optimize clinical outcomes and reduce the risk of complications or other hazards for patients that may occur during the operation period of a novice endoscopist[17,38]. In addition, SBML can minimize variations between trainees upon completion of the program[24,39].

Several studies in other fields of medical procedural training have shown the benefits of SBT and mastery learning over the traditional apprenticeship model. A meta-analysis by Harrison et al[40] included 14 studies involving 633 trainees in cardiology procedures and found that SBT followed by structured training provided superior results than traditional methods. The quality of patient care and patient feedback obtained by this method were better than those obtained by a conventional training approach. A meta-analysis by Cook et al[41] included 82 studies evaluating SBML in procedural settings such as surgeries and airway management. They found that SBML was significantly better at improving procedural skills than traditional methods but might takes more time. A systematic review on patient outcomes in simulation based medical education also reported small to moderate patient benefits in comparison with no intervention[38]. A study published in 2014 revealed the effectiveness of colonoscopy training with virtual simulation in the early learning curve of novices. Performance improvements were also found later during patient-based colonoscopy[42]. Another multicenter study found higher objective competency rates during the early phase of colonoscopy training[43].

A prospective randomized study that evaluated the diagnostic abilities of trainees using upper GI endoscopy concluded that structured SBT was superior to SBT or clinical training alone. This study also found that the use of the simulator was valuable as the first step in developing diagnostic skills to perform upper GI endoscopy, but it was not sufficient to ensure the overall competencies[30]. Several reports on SBT for GI endoscopy are described in Table 3.

Table 3 Studies on simulation-based endoscopy training.
Ref.
Study design
Methods
Conclusion
Ferlitsch et al[39], 2002Prospective randomized trial13 endoscopy trainees were divided into two groups: simulator training and no simulator trainingSimulator-trained group had better skills, shorter scope insertion time, and fewer adverse events
Giulio et al[44], 2004Prospective randomized trial22 fellows with no experience in endoscopy were divided into two groups: preclinical training with computer-based simulator and no preclinical trainingThe first group performed a more complete procedure, required less assistance, and was assessed as better by the instructor
Cohen et al[43], 2006Prospective randomized trial45 1st-yr GI fellows were divided into two groups: unsupervised simulator training using GI mentor and no simulatorFellows in the simulator group had significantly higher objective competency rates during the first 100 cases. Fellows who underwent GI mentor training performed significantly better during the early phase of real colonoscopy training
Shirai et al[45], 2008Prospective randomized trial10 trainees were divided into two groups: simulator and non-simulator5 h of simulator training improved EGD performance
Ferlitsch et al[46], 2010Prospective randomized trial28 internal medicine residents were divided into two groups: simulator-trained before conventional training and conventional training onlyVirtual simulator training improved technical accuracy during the early and mid-term phase of training, thus reducing the time needed to reach technical competency. However, the clinical effect is limited
Haycock et al[47], 2010Prospective randomized trial36 novice colonoscopists were divided into two groups: simulator training and patient-based trainingSimulator-trained group performance matched the patient-based group performance, and showed superior technical skills on simulated cases
Ende et al[30], 2012Prospective randomized trialResidents with no previous experience in endoscopy were divided into three groups: clinical and simulator training, clinical training only, and simulator training onlyFirst group showed better results than the other groups. Third group showed a shorter procedure duration
Qiao et al[48], 2014Systematic reviewFifteen studies comparing virtual colonoscopy or gastroscopy training with other intervention were analyzedVirtual endoscopy simulator training might be effective for gastroscopy, but no data are available for colonoscopy
Singh et al[49], 2014Systematic review and meta-analysisThirty-nine articles, including twenty-one randomized trials on simulation-based training in gastrointestinal endoscopy were analyzedSimulation-based training significantly enhanced the skills of trainees, reduced the time needed to finish a procedure, and improved patient outcomes
Ekkelenkamp et al[50], 2016Systematic reviewTwenty-three studies on simulator training and learning curves, including seventeen randomized controlled trials, were analyzedValidated VR simulator training in the early phase accelerated the learning of practical skills. Assessment of performance level on GI endoscopy procedures should be done continuously with validated assessment tool, rather than threshold number
Mahmood et al[5], 2018Systematic reviewTwenty-one randomized controlled trials on VR simulation in endoscopy training were analyzedVR simulation showed improved skills in all areas at the beginning of learning; nonetheless it was not effective as a replacement for conventional training
Khan et al[51], 2018Systematic reviewEighteen trials on endoscopic procedures were analyzedVR-based training in combination with conventional training showed superior result over VR training alone. Evidence was inconclusive regarding whether VR-based training can replace conventional training
Smith et al[52], 2021Systematic review and meta-analysisTwenty-four studies on simulation of EGD, colonoscopy, ERCP, flexible sigmoidoscopy, or hemostasis procedures were analyzedLikely positive impact of simulation training on patient comfort, cecal and biliary intubation. However, studies on the effect of simulation training are small and have a short follow-up time
Zhang et al[53], 2021Systematic reviewTwenty-two studies on endoscopy VR simulation training were analyzedVR simulation training resulted in comparable or significantly better performance than clinical training, no training, other types of simulation, and another form of VR

Generally, studies on SBT in GI endoscopy training have shown favorable results, especially in the early phase of training, as it reduces the time required to reach technical competence and the number of endoscopic procedures needed to perform it independently. With SBT, trainees can perform the procedures and exercises repeatedly using a simulator. This repetition improves the cognitive and practical skills of students and allows them to become more acquainted with endoscopic features and settings. A meta-analysis showed that simulation can increase patient safety and decrease the risk of adverse events, as trainees are more skilled and familiarized with the clinical settings at the moment of performing the endoscopy[44-49]. It also provides an opportunity for trainees to learn at their own pace[50-54].

However, some systematic reviews have reported inconclusive evidence supporting SBT as a replacement for conventional training. SBT might be more beneficial as a supplement to conventional training, especially in the early phase. Nevertheless, reducing patient-based training in favor of SBT is not recommended as it cannot replace conventional patient-based training[48,51,52]. Hence, simulation must be accompanied by direct clinical experience with patients in order to understand the actual clinical setting[39]. A study conducted in 2004 found that simulation without feedback from experts did not improve the skills of trainees. Providing trainees access to a simulator cannot guarantee appropriate learning by itself. Therefore, SBT should be delivered purposefully within a developed curriculum to allow trainees to practice essential skills, receive feedback from experts, and develop skills gradually and appropriately to achieve mastery[55]. Feedback and debriefing are essential in SBT to allow trainees identify their weakness and improve their performance accordingly[56]. Simulation with a proper environment or scenario is also beneficial to the improvement of endoscopic non-technical skills such as communication and teamwork, situation awareness, leadership, judgment, and decision making[57]. A previous study showed that integrating endoscopic non-technical skills training improved novice trainees’ performance and competency, which might benefit patients[58].

EXPERIENCES IN SIMULATION-BASED MASTERY LEARNING FOR ENDOSCOPY TRAINING

Several studies have shown endoscopy mastery learning experiences. Nguyen-Vu et al[59] reported a 2-wk course for gastroenterology fellows at the University of California with no prior experience in endoscopy. They divided the learning period into two phases: the 1st week for learning the basics of endoscopy and the 2nd week for learning various therapies in endoscopy. These phases were further divided into specific endoscopic skills such as endoscopic tip control, image documentation, biopsy, and clip administration. Trainees were assigned readings and underwent online assessments before attending hands-on training with a simulator. They had to pass the competency assessment for a specific skill before moving to the next topic. This study showed that the SBML program could rapidly help trainees acquire endoscopic skills through a comprehensive curriculum. Online reading and assessments enabled trainees to learn at their own pace, and using a simulator provided them with a chance to engage in repetitive practice. Dividing endoscopic skills also allowed trainees to focus on the specific skills they needed to refine.

Ritter et al[60] reported an endoscopy training system (ETS) using an SBML curriculum implemented with general surgery residents to pass the Fundamentals of Endoscopic Surgery (FES) skills examination. They divided ETS into five tasks which were organized in two tabletop units. The first unit included scope manipulation, tool targeting, and retroflexion tasks using a simple endoscopic tool. The second unit consisted of loop management and mucosal inspection tasks using a stylized body form. Most participants completed this simulation-based curriculum in less than 1 wk with more than 90 min of practice per day. This study suggested that the application of the SBML curriculum to flexible endoscopes provides significantly improved results on posttraining assessments compared with pretraining assessments. This study also found that after five sessions of SBT, participants could produce posttest scores equivalent to those of doctors who had performed 150-300 endoscopy procedures. This result implies that vast clinical experience is not needed to participate in the SBML program. The ETS was further developed by setting the training standards for the SBML curriculum, resulting in attainable standards that improved FES scores in the skills exam[61]. Another subsequent study published in 2021 evaluated the effect of SBML curriculum implementation early in residency. It revealed that early implementation of SBML curriculum for flexible endoscopy training resulted in comparable performance to those with high level of clinical endoscopic experience[62].

Soetikno et al[61] developed a 6-wk SBML program for 1st-year gastroenterology fellows of the Philippine Society of Digestive Endoscopy. SBML involved learning fine-tip control, structured upper endoscopy examination, and endoscopic therapies. Basic knowledge and interpretation of endoscopy findings were learned simultaneously. Interestingly, the first 5 wk of the program were conducted remotely using virtual coaching. Trainees used simulators and recorded their own performance, number of attempts, and completion time for each attempt, and then supervisors provided feedback based on these attempts. During the last week, trainees underwent in-person endoscopic therapy training after having passed the standard for fine-tip control and structured upper endoscopy examination. This study found that the adoption rates for basic endoscopic techniques such as image documentation and biopsy were 93% and 100%, respectively, after 2 mo of training. Meanwhile, the adoption rates of endoscopic therapies such as clipping, band ligation, and injection were more variable (7%-79%)[63]. Soetikno et al[64] also conducted an SBML course in GI bleeding endoscopic therapy and found that SBML quickly disseminated technical knowledge and skills. They proposed SBML as an additional method for teaching before trainees performed the procedure on patients.

PLANNING AND MANAGEMENT OF SIMULATION-BASED MASTERY LEARNING IN GI ENDOSCOPY

As stated above, the SBML program requires a developed and tested curriculum to ensure that all trainees can achieve competence in endoscopy. Kern et al[65] constructed a six-step approach to build an SBML curriculum. The steps are problem identification and general need assessment, specific need assessment, targets and objectives, educational strategies, implementation, and evaluation and feedback. Hospitals and medical institutions should delegate a specific team to plan the SBML curriculum. After planning, a pilot study should be conducted to evaluate satisfaction of trainees with the program and patient outcomes. Once SBML has been implemented, continuous monitoring and evaluation should be performed to maintain the quality of the program[37].

SBML begins with an initial assessment of the knowledge and abilities of trainees. After training, students will be tested again, and training will continue until they meet the minimum passing standards. Once trainees meet the minimum passing standards, they can advance to the next stage of training (Figure 1). Periodic examinations will be conducted along with planned practices to ensure that expected competencies are maintained[37]. Some training centers might provide materials for self learning before the simulation starts to improve the initial knowledge of trainees. A study by Cheung et al[66] showed that preparation before SBML is substantial to improve the effectiveness of SBML. They found that web-based observational practice is superior to reading materials alone, as it increases learner engagement with instructional materials.

Figure 1
Figure 1 Stages in simulation-based mastery learning. Simulation-based mastery learning begins with a pretest to assess trainees’ initial knowledge and abilities. Subsequently, trainees will undergo simulation based-training with formative assessment to direct their training. Lastly, trainees will be evaluated for competency through summative assessment (posttest) according to the minimum passing standards. Trainees who pass the test can advance to the next stage of training, while those who do not pass must receive additional training and practice until they meet the minimum passing standards.

Learning targets should be determined from the beginning of the SBML program and arranged according to the SMART acronym: specific, measurable, attainable, relevant, and time-bound[59,60]. Trainees, trainers, and supervisors have to understand learning targets before starting the program. This understanding is beneficial because trainees can focus their learning on the important and necessary skills, and trainers and supervisors can provide structured feedback. Feedback is important in SBML and should be delivered in a specific manner: with only one or two important points at a time and preferably immediately after the procedure or simulation to be properly understood by trainees[67,68]. Feedback should also be constructive and not vague, allowing trainees to self-reflect and come up with potential solutions[31].

In addition to training or lesson planning, an assessment plan is needed to create a training environment with maximum results. Assessment is vital to provide trainees with future directions for improvement and to ensure patient safety by issuing a passing standard[69]. At the beginning of mastery learning, a pretest has to be conducted to evaluate the initial knowledge of trainees[67]. Within the program, assessments are classified as formative or summative assessments. Formative assessment aims to direct training and support the self reflection and intrinsic motivation of trainees[70]. Meanwhile, summative assessment seeks to evaluate competency and practice eligibility[71]. There are five criteria to indicate the quality of an assessment: reliability, which shows the accuracy and reproducibility of a test: validity, which shows whether the test can be performed to evaluate the intended focused parameter; future impact of the assessment; acceptability by trainees and supervisors; and reasonable cost. Assessments can be conducted through written examinations, direct evaluations by clinical supervisors, direct observations, clinical simulations, or portfolios[69].

THE FUTURE OF SIMULATION-BASED MASTERY LEARNING IN GI ENDOSCOPY

It is reasonable and expected that novice endoscopists do not perform endoscopic procedures on human patients unless they have shown satisfactory skills on a simulator. Endoscopy training should move from the traditional apprenticeship model to objective competency-based mastery learning, integrating simulators, deliberate practice, and prompt feedback from supervisors. The SBML curriculum is acknowledged as a method to boost the efficiency and efficacy of endoscopy training through repetitive practice and expert feedback, which allow trainees to learn the basic structure of endoscopic techniques. One of the limitations of the traditional apprenticeship model is the reduced time for questions, feedback, and adequate skill assessment during a procedure on an actual patient, which results in self learning; thus, not all trainees might develop a proper form and technique. Incorporating simulators can reduce this limitation of the conventional apprenticeship model by allowing trainees to practice basic endoscopic maneuvers repeatedly, as each trainee has a different absorption rate. In fact, acquiring proper techniques is essential for trainees, as they can progress to the next stage of training which is more complex. Simulators also limit the possibility of patient discomfort and injury, thereby allowing trainees to improve their skills. Additionally, the standardization of simulator-based instruction methods is essential to maximize the positive impact of the training method[8]. The integration of simulator in endoscopy training should be within a structured curriculum that combines constructive feedback and complementary knowledge[72]. A previous randomized trial compared the outcome of structured comprehensive curriculum to progressive learning-based curriculum, and revealed that those who received SBT that progressed in complexity and difficulty had superior technical and communication skills and global performance in the simulated setting[73].

A proper SBML curriculum for GI endoscopy should subsequently consist of cognitive, technical, and integrative skill training. The coronavirus disease 2019 pandemic has accelerated the acceptance of online video/web-based learning, video mentoring, and video proctoring. Web-based learning in the form of online modules is now expected for cognitive skill training, which allows trainees to review learning modules at their own pace and to avoid cognitive overload due to a stressful environment[59]. The main drawbacks of simulation-based learning are model realism and less real-world experience for new endoscopists. Hence, hybrid learning that combines simulator-based and one-on-one training is ideal for building the learning curves of trainees and identifying their deficiencies[74]. Improved performance in simulator training has been shown to translate into the clinical area[60].

CONCLUSION

The traditional apprenticeship model in GI endoscopy training must be revised to ensure competency and practical eligibility of novice endoscopists. By moving the focus from a case volume-based to a competency-based training, mastery learning can help lower the variability between skills of trainees and provide optimal results. Previous experiences with the SBML program in endoscopy training showed promising results and positioned that method as an additional course to be incorporated before the apprenticeship is started and also as a complementary course to one-on-one training. The use of a simulator in SBML can help trainees become acquainted with the endoscopic equipment, settings, and situations that might arise during their direct practice on patients. The SBML program should be planned and managed by a specific team and conducted within a developed and tested curriculum.

Footnotes

Provenance and peer review: Unsolicited article; Externally peer reviewed.

Peer-review model: Single blind

Corresponding Author's Membership in Professional Societies: World Endoscopy Organization; American College of Gastroenterology; American Society for Gastrointestinal Endoscopy; The Indonesian Society of Digestive Endoscopy; The Indonesian Society of Gastroenterology.

Specialty type: Gastroenterology and hepatology

Country/Territory of origin: Indonesia

Peer-review report’s scientific quality classification

Grade A (Excellent): 0

Grade B (Very good): B, B, B

Grade C (Good): C, C

Grade D (Fair): 0

Grade E (Poor): 0

P-Reviewer: Al-Ani RM, Iraq; Toyoshima O, Japan; Isac S, Romania S-Editor: Wang LL L-Editor: A P-Editor: Wang LL

References
1.  Seward E, Lumley S. Endoscopy provision: meeting the challenges. Frontline Gastroenterol. 2017;8:90-93.  [PubMed]  [DOI]  [Cited in This Article: ]
2.  Huang C, Hopkins R, Huang K, Demers L, Wasan S. Standardizing Endoscopy Training: A Workshop for Endoscopy Educators. MedEdPORTAL. 2020;16:11015.  [PubMed]  [DOI]  [Cited in This Article: ]
3.  Matharoo M, Haycock A, Sevdalis N, Thomas-Gibson S. A prospective study of patient safety incidents in gastrointestinal endoscopy. Endosc Int Open. 2017;5:E83-E89.  [PubMed]  [DOI]  [Cited in This Article: ]
4.  McGaghie WC. Mastery learning: it is time for medical education to join the 21st century. Acad Med. 2015;90:1438-1441.  [PubMed]  [DOI]  [Cited in This Article: ]
5.  Mahmood T, Scaffidi MA, Khan R, Grover SC. Virtual reality simulation in endoscopy training: Current evidence and future directions. World J Gastroenterol. 2018;24:5439-5445.  [PubMed]  [DOI]  [Cited in This Article: ]
6.  Finocchiaro M, Cortegoso Valdivia P, Hernansanz A, Marino N, Amram D, Casals A, Menciassi A, Marlicz W, Ciuti G, Koulaouzidis A. Training Simulators for Gastrointestinal Endoscopy: Current and Future Perspectives. Cancers (Basel). 2021;13.  [PubMed]  [DOI]  [Cited in This Article: ]
7.  Caspritz T, Arnold M, White C, Schultz M.   A Critical Analysis of the gastroenterology specialist workforce in New Zealand. Wellington: New Zealand Society of Gastroenterology, 2018. [cited 20 April 2022]. Available from: https://www.nzdoctor.co.nz/article/undoctored/critical-analysis-gastroenterology-specialist-workforce-new-zealand.  [PubMed]  [DOI]  [Cited in This Article: ]
8.  Greenwald DA, Freeman ML.   The Endoscopic Management of Immediate Complications of Therapeutic Endoscopy. In: Cohen J. Successful Training in Gastrointestinal Endoscopy. Second Edition. Oxford: Wiley-Blackwell, 2022: 351-356.  [PubMed]  [DOI]  [Cited in This Article: ]
9.  Kim JS, Kim BW. Endoscopy training in Korea. Korean J Intern Med. 2019;34:237-241.  [PubMed]  [DOI]  [Cited in This Article: ]
10.  Hatanaka H, Yamamoto H, Lefor AK, Sugano K. Gastroenterology Training in Japan. Dig Dis Sci. 2016;61:1448-1450.  [PubMed]  [DOI]  [Cited in This Article: ]
11.  World Gastroenterology Organisation Education & Training Committee  Standards in gastroenterology training: a comprehensive guide to basic standards in gastroenterology. Munich: World Gastroenterology Organisation, 2007.  [PubMed]  [DOI]  [Cited in This Article: ]
12.  Maida M, Alrubaiy L, Bokun T, Bruns T, Castro V, China L, Conroy G, Trabulo D, Van Steenkiste C, Voermans RP, Burisch J, Ianiro G. Current challenges and future needs of clinical and endoscopic training in gastroenterology: a European survey. Endosc Int Open. 2020;8:E525-E533.  [PubMed]  [DOI]  [Cited in This Article: ]
13.  Waschke KA, Coyle W. Advances and Challenges in Endoscopic Training. Gastroenterology. 2018;154:1985-1992.  [PubMed]  [DOI]  [Cited in This Article: ]
14.  Chin MW, Forbes GM. Should simulator use become mandatory in endoscopy training? J Gastroenterol Hepatol. 2008;23:996-997.  [PubMed]  [DOI]  [Cited in This Article: ]
15.  Long V, Kalloo AN. AccuTouch Endoscopy Simulator: development, applications and early experience. Gastrointest Endosc Clin N Am. 2006;16:479-487.  [PubMed]  [DOI]  [Cited in This Article: ]
16.  Dawe SR, Windsor JA, Broeders JA, Cregan PC, Hewett PJ, Maddern GJ. A systematic review of surgical skills transfer after simulation-based training: laparoscopic cholecystectomy and endoscopy. Ann Surg. 2014;259:236-248.  [PubMed]  [DOI]  [Cited in This Article: ]
17.  Park KS. Introduction to Starting Upper Gastrointestinal Endoscopy: Proper Insertion, Complete Observation, and Appropriate Photographing. Clin Endosc. 2015;48:279-284.  [PubMed]  [DOI]  [Cited in This Article: ]
18.  Lateef F. Simulation-based learning: Just like the real thing. J Emerg Trauma Shock. 2010;3:348-352.  [PubMed]  [DOI]  [Cited in This Article: ]
19.  Telleman H, Burger TF, Mulder CJ. Evolution of gastroenterology training. World J Gastroenterol. 2009;15:1793-1798.  [PubMed]  [DOI]  [Cited in This Article: ]
20.  Williams CB, Saunders BP, Bladen JS. Development of colonoscopy teaching simulation. Endoscopy. 2000;32:901-905.  [PubMed]  [DOI]  [Cited in This Article: ]
21.  Classen M, Ruppin H. Practical Endoscopy Training Using a New Gastrointestinal Phantom. Endoscopy. Endoscopy. 1974;6:127-131.  [PubMed]  [DOI]  [Cited in This Article: ]
22.  Williams CB, Baillie J, Gillies DF, Borislow D, Cotton PB. Teaching gastrointestinal endoscopy by computer simulation: a prototype for colonoscopy and ERCP. Gastrointest Endosc. 1990;36:49-54.  [PubMed]  [DOI]  [Cited in This Article: ]
23.  Koch AD, Buzink SN, Heemskerk J, Botden SM, Veenendaal R, Jakimowicz JJ, Schoon EJ. Expert and construct validity of the Simbionix GI Mentor II endoscopy simulator for colonoscopy. Surg Endosc. 2008;22:158-162.  [PubMed]  [DOI]  [Cited in This Article: ]
24.  Triantafyllou K, Lazaridis LD, Dimitriadis GD. Virtual reality simulators for gastrointestinal endoscopy training. World J Gastrointest Endosc. 2014;6:6-12.  [PubMed]  [DOI]  [Cited in This Article: ]
25.  Faigel DO, Baron TH, Lewis B, Petersen B, Petrini J, Popp JW, Jack PS, Dipalma A, Pike IM, Flax IL.   Ensuring Competence in Endoscopy. AGSE Taskforce and American College of Gastroenterology Executive and Practice Management Committees. [cited 20 April 2022]. Available from: https://www.asge.org/docs/default-source/education/practice_guidelines/doc-competence.pdf?sfvrsn=6.  [PubMed]  [DOI]  [Cited in This Article: ]
26.  Walsh CM. In-training gastrointestinal endoscopy competency assessment tools: Types of tools, validation and impact. Best Pract Res Clin Gastroenterol. 2016;30:357-374.  [PubMed]  [DOI]  [Cited in This Article: ]
27.  McGaghie WC, Issenberg SB, Cohen ER, Barsuk JH, Wayne DB. Medical education featuring mastery learning with deliberate practice can lead to better health for individuals and populations. Acad Med. 2011;86:e8-e9.  [PubMed]  [DOI]  [Cited in This Article: ]
28.  Mann DD, Eland DC. Self-efficacy in mastery learning to apply a therapeutic psychomotor skill. Percept Mot Skills. 2005;100:77-84.  [PubMed]  [DOI]  [Cited in This Article: ]
29.  ASGE Training Committee; Adler DG, Bakis G, Coyle WJ, DeGregorio B, Dua KS, Lee LS, McHenry L Jr, Pais SA, Rajan E, Sedlack RE, Shami VM, Faulx AL. Principles of training in GI endoscopy. Gastrointest Endosc. 2012;75:231-235.  [PubMed]  [DOI]  [Cited in This Article: ]
30.  Ende A, Zopf Y, Konturek P, Naegel A, Hahn EG, Matthes K, Maiss J. Strategies for training in diagnostic upper endoscopy: a prospective, randomized trial. Gastrointest Endosc. 2012;75:254-260.  [PubMed]  [DOI]  [Cited in This Article: ]
31.  Han S. Achieving Competence in Endoscopy. ACG Case Rep J. 2019;6:e00155.  [PubMed]  [DOI]  [Cited in This Article: ]
32.  Beattie AD, Greff M, Lamy V, Mallinson CN. The European Diploma of Gastroenterology: progress towards harmonization of standards. Eur J Gastroenterol Hepatol. 1996;8:403-406.  [PubMed]  [DOI]  [Cited in This Article: ]
33.  Eisen GM, Baron TH, Dominitz JA, Faigel DO, Goldstein JL, Johanson JF, Mallery JS, Raddawi HM, Vargo JJ 2nd, Waring JP, Fanelli RD, Wheeler-Harbough J; American Society for Gastrointestinal Endoscopy. Methods of granting hospital privileges to perform gastrointestinal endoscopy. Gastrointest Endosc. 2002;55:780-783.  [PubMed]  [DOI]  [Cited in This Article: ]
34.  Pearl J, Dunkin B, Pauli E, Trus T, Jeffrey M, Fanelli R, Meara M, Stefanidis D, Richardson W.   Guidelines for Privileging and Credentialing Physicians in Gastrointestinal Endoscopy. Los Angeles: Society of American Gastrointestinal and Endoscopic Surgeons, 2016. [cited 20 April 2022]. Available from: https://www.sages.org/publications/guidelines/guidelines-privileging-credentialing-physicians-gastrointestinal-endoscopy/.  [PubMed]  [DOI]  [Cited in This Article: ]
35.  Kim JS, Kim BW. Training in Endoscopy: Esophagogastroduodenoscopy. Clin Endosc. 2017;50:318-321.  [PubMed]  [DOI]  [Cited in This Article: ]
36.  Farthing MJ, Walt RP, Allan RN, Swan CH, Gilmore IT, Mallinson CN, Bennett JR, Hawkey CJ, Burnham WR, Morris AI, Tibbs CJ, Bowling TE, Cobb C, Catnach S, Farrell C, Towle A. A national training programme for gastroenterology and hepatology. Gut. 1996;38:459-470.  [PubMed]  [DOI]  [Cited in This Article: ]
37.  McGaghie WC  Mastery Learning: Origins, Features, and Evidence from the Health Professions. In: McGaghie WC, Barsuk JH, Wayne DB. Comprehensive Healthcare Simulation: Mastery Learning in Health Professions Education. Cham, Switzerland: Springer, 2020: 27-46.  [PubMed]  [DOI]  [Cited in This Article: ]
38.  Zendejas B, Brydges R, Wang AT, Cook DA. Patient outcomes in simulation-based medical education: a systematic review. J Gen Intern Med. 2013;28:1078-1089.  [PubMed]  [DOI]  [Cited in This Article: ]
39.  Ferlitsch A, Glauninger P, Gupper A, Schillinger M, Haefner M, Gangl A, Schoefl R. Evaluation of a virtual endoscopy simulator for training in gastrointestinal endoscopy. Endoscopy. 2002;34:698-702.  [PubMed]  [DOI]  [Cited in This Article: ]
40.  Harrison CM, Gosai JN. Simulation-based training for cardiology procedures: Are we any further forward in evidencing real-world benefits? Trends Cardiovasc Med. 2017;27:163-170.  [PubMed]  [DOI]  [Cited in This Article: ]
41.  Cook DA, Brydges R, Zendejas B, Hamstra SJ, Hatala R. Mastery learning for health professionals using technology-enhanced simulation: a systematic review and meta-analysis. Acad Med. 2013;88:1178-1186.  [PubMed]  [DOI]  [Cited in This Article: ]
42.  Koch AD, Ekkelenkamp VE, Haringsma J, Schoon EJ, de Man RA, Kuipers EJ. Simulated colonoscopy training leads to improved performance during patient-based assessment. Gastrointest Endosc. 2015;81:630-636.  [PubMed]  [DOI]  [Cited in This Article: ]
43.  Cohen J, Cohen SA, Vora KC, Xue X, Burdick JS, Bank S, Bini EJ, Bodenheimer H, Cerulli M, Gerdes H, Greenwald D, Gress F, Grosman I, Hawes R, Mullin G, Schnoll-Sussman F, Starpoli A, Stevens P, Tenner S, Villanueva G. Multicenter, randomized, controlled trial of virtual-reality simulator training in acquisition of competency in colonoscopy. Gastrointest Endosc. 2006;64:361-368.  [PubMed]  [DOI]  [Cited in This Article: ]
44.  Di Giulio E, Fregonese D, Casetti T, Cestari R, Chilovi F, D'Ambra G, Di Matteo G, Ficano L, Delle Fave G. Training with a computer-based simulator achieves basic manual skills required for upper endoscopy: a randomized controlled trial. Gastrointest Endosc. 2004;60:196-200.  [PubMed]  [DOI]  [Cited in This Article: ]
45.  Shirai Y, Yoshida T, Shiraishi R, Okamoto T, Nakamura H, Harada T, Nishikawa J, Sakaida I. Prospective randomized study on the use of a computer-based endoscopic simulator for training in esophagogastroduodenoscopy. J Gastroenterol Hepatol. 2008;23:1046-1050.  [PubMed]  [DOI]  [Cited in This Article: ]
46.  Ferlitsch A, Schoefl R, Puespoek A, Miehsler W, Schoeniger-Hekele M, Hofer H, Gangl A, Homoncik M. Effect of virtual endoscopy simulator training on performance of upper gastrointestinal endoscopy in patients: a randomized controlled trial. Endoscopy. 2010;42:1049-1056.  [PubMed]  [DOI]  [Cited in This Article: ]
47.  Haycock A, Koch AD, Familiari P, van Delft F, Dekker E, Petruzziello L, Haringsma J, Thomas-Gibson S. Training and transfer of colonoscopy skills: a multinational, randomized, blinded, controlled trial of simulator versus bedside training. Gastrointest Endosc. 2010;71:298-307.  [PubMed]  [DOI]  [Cited in This Article: ]
48.  Qiao W, Bai Y, Lv R, Zhang W, Chen Y, Lei S, Zhi F. The effect of virtual endoscopy simulator training on novices: a systematic review. PLoS One. 2014;9:e89224.  [PubMed]  [DOI]  [Cited in This Article: ]
49.  Singh S, Sedlack RE, Cook DA. Effects of simulation-based training in gastrointestinal endoscopy: a systematic review and meta-analysis. Clin Gastroenterol Hepatol. 2014;12:1611-23.e4.  [PubMed]  [DOI]  [Cited in This Article: ]
50.  Ekkelenkamp VE, Koch AD, de Man RA, Kuipers EJ. Training and competence assessment in GI endoscopy: a systematic review. Gut. 2016;65:607-615.  [PubMed]  [DOI]  [Cited in This Article: ]
51.  Khan R, Plahouras J, Johnston BC, Scaffidi MA, Grover SC, Walsh CM. Virtual reality simulation training for health professions trainees in gastrointestinal endoscopy. Cochrane Database Syst Rev. 2018;8:CD008237.  [PubMed]  [DOI]  [Cited in This Article: ]
52.  Smith R, Zhao M. P74 Simulation in endoscopy training: a systematic review and meta-analysis. Gut. 2021;70:A78.  [PubMed]  [DOI]  [Cited in This Article: ]
53.  Zhang W, Liu X, Zheng B. Virtual reality simulation in training endoscopic skills: A systematic review. Laparoscopic, Endoscopic and Robotic Surgery. 2021;4:97-104.  [PubMed]  [DOI]  [Cited in This Article: ]
54.  ASGE Training Committee; Sedlack RE, Coyle WJ, Obstein KL, Al-Haddad MA, Bakis G, Christie JA, Davila RE, DeGregorio B, DiMaio CJ, Enestvedt BK, Jorgensen J, Mullady DK, Rajan L. ASGE's assessment of competency in endoscopy evaluation tools for colonoscopy and EGD. Gastrointest Endosc. 2014;79:1-7.  [PubMed]  [DOI]  [Cited in This Article: ]
55.  Mahmood T, Darzi A. The learning curve for a colonoscopy simulator in the absence of any feedback: no feedback, no learning. Surg Endosc. 2004;18:1224-1230.  [PubMed]  [DOI]  [Cited in This Article: ]
56.  Khan R, Scaffidi MA, Grover SC, Gimpaya N, Walsh CM. Simulation in endoscopy: Practical educational strategies to improve learning. World J Gastrointest Endosc. 2019;11:209-218.  [PubMed]  [DOI]  [Cited in This Article: ]
57.  Ravindran S, Thomas-Gibson S, Murray S, Wood E. Improving safety and reducing error in endoscopy: simulation training in human factors. Frontline Gastroenterol. 2019;10:160-166.  [PubMed]  [DOI]  [Cited in This Article: ]
58.  Walsh CM, Scaffidi MA, Khan R, Arora A, Gimpaya N, Lin P, Satchwell J, Al-Mazroui A, Zarghom O, Sharma S, Kamani A, Genis S, Kalaichandran R, Grover SC. Non-technical skills curriculum incorporating simulation-based training improves performance in colonoscopy among novice endoscopists: Randomized controlled trial. Dig Endosc. 2020;32:940-948.  [PubMed]  [DOI]  [Cited in This Article: ]
59.  Nguyen-Vu T, Malvar C, Chin YK, Kaltenbach T, Liu A, Myint T, Asokkumar R, Shergill A, Soetikno R. Simulation-based mastery learning (SBML) for rapid acquisition of upper endoscopy knowledge and skills-initial observation. VideoGIE. 2020;5:222-225.  [PubMed]  [DOI]  [Cited in This Article: ]
60.  Ritter EM, Taylor ZA, Wolf KR, Franklin BR, Placek SB, Korndorffer JR Jr, Gardner AK. Simulation-based mastery learning for endoscopy using the endoscopy training system: a strategy to improve endoscopic skills and prepare for the fundamentals of endoscopic surgery (FES) manual skills exam. Surg Endosc. 2018;32:413-420.  [PubMed]  [DOI]  [Cited in This Article: ]
61.  Franklin BR, Placek SB, Gardner AK, Korndorffer JR Jr, Wagner MD, Pearl JP, Ritter EM. Preparing for the American Board of Surgery Flexible Endoscopy Curriculum: Development of multi-institutional proficiency-based training standards and pilot testing of a simulation-based mastery learning curriculum for the Endoscopy Training System. Am J Surg. 2018;216:167-173.  [PubMed]  [DOI]  [Cited in This Article: ]
62.  Dyke C, Franklin BR, Sweeney WB, Ritter EM. Early implementation of Fundamentals of Endoscopic Surgery training using a simulation-based mastery learning curriculum. Surgery. 2021;169:1228-1233.  [PubMed]  [DOI]  [Cited in This Article: ]
63.  Soetikno R, Cabral-Prodigalidad PA, Kaltenbach T; AOE Investigators. Simulation-Based Mastery Learning With Virtual Coaching: Experience in Training Standardized Upper Endoscopy to Novice Endoscopists. Gastroenterology. 2020;159:1632-1636.  [PubMed]  [DOI]  [Cited in This Article: ]
64.  Soetikno R, Asokkumar R, McGill SK, Kaltenbach T. Simulation-Based Mastery Learning for Practicing Gastroenterologists-Renewed Importance in the Era of COVID-19. Am J Gastroenterol. 2020;115:1380-1383.  [PubMed]  [DOI]  [Cited in This Article: ]
65.  Sawaya RD, Mrad S, Rajha E, Saleh R, Rice J. Simulation-based curriculum development: lessons learnt in Global Health education. BMC Med Educ. 2021;21:33.  [PubMed]  [DOI]  [Cited in This Article: ]
66.  Cheung JJ, Koh J, Brett C, Bägli DJ, Kapralos B, Dubrowski A. Preparation With Web-Based Observational Practice Improves Efficiency of Simulation-Based Mastery Learning. Simul Healthc. 2016;11:316-322.  [PubMed]  [DOI]  [Cited in This Article: ]
67.  Adams NE. Bloom's taxonomy of cognitive learning objectives. J Med Libr Assoc. 2015;103:152-153.  [PubMed]  [DOI]  [Cited in This Article: ]
68.  Ben-David MF. The role of assessment in expanding professional horizons. Med Teach. 2000;22:472-477.  [PubMed]  [DOI]  [Cited in This Article: ]
69.  Austin Z. How to design and use learning objective in clinical teaching. Pharm J+. 2016;296: 46-48.  [PubMed]  [DOI]  [Cited in This Article: ]
70.  Anderson L, Krathwohl D, Bloom B.   A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom’s Taxonomy of Educational Objectives. New York: Addison Wesley Longman, 2001.  [PubMed]  [DOI]  [Cited in This Article: ]
71.  Epstein RM. Assessment in medical education. N Engl J Med. 2007;356:387-396.  [PubMed]  [DOI]  [Cited in This Article: ]
72.  Grover SC, Garg A, Scaffidi MA, Yu JJ, Plener IS, Yong E, Cino M, Grantcharov TP, Walsh CM. Impact of a simulation training curriculum on technical and nontechnical skills in colonoscopy: a randomized trial. Gastrointest Endosc. 2015;82:1072-1079.  [PubMed]  [DOI]  [Cited in This Article: ]
73.  Grover SC, Scaffidi MA, Khan R, Garg A, Al-Mazroui A, Alomani T, Yu JJ, Plener IS, Al-Awamy M, Yong EL, Cino M, Ravindran NC, Zasowski M, Grantcharov TP, Walsh CM. Progressive learning in endoscopy simulation training improves clinical performance: a blinded randomized trial. Gastrointest Endosc. 2017;86:881-889.  [PubMed]  [DOI]  [Cited in This Article: ]
74.  Koo CS, Siah KTH, Koh CJ. Endoscopy training in COVID-19: Challenges and hope for a better age. J Gastroenterol Hepatol. 2021;36:2715-2719.  [PubMed]  [DOI]  [Cited in This Article: ]