Minireviews Open Access
Copyright ©2014 Baishideng Publishing Group Inc. All rights reserved.
World J Gastrointest Endosc. Jun 16, 2014; 6(6): 234-239
Published online Jun 16, 2014. doi: 10.4253/wjge.v6.i6.234
Role of simulation in training the next generation of endoscopists
Simon C Blackburn, Department of Paediatric Surgery, St George’s Hospital NHS Trust, London, SW17 0QT, United Kingdom
Stephen J Griffin, University Hospital Southampton NHS Foundation Trust, Southampton, SO16 6YD, United Kingdom
Author contributions: Blackburn SC and Griffin SJ co-authored the manuscript and had approved the final version.
Correspondence to: Simon C Blackburn, BSc(Hons), MBBS, Med, FRCS, Department of Paediatric Surgery, St George’s Hospital NHS Trust, Blackshaw Road, London, SW17 0QT, United Kingdom. sblackburn@doctors.org.uk
Telephone: +44-20-86721255 Fax: +44-20-86729711
Received: December 18, 2013
Revised: April 7, 2014
Accepted: May 15, 2014
Published online: June 16, 2014

Abstract

The use of simulation based training in endoscopy has been increasingly described, simulation has the potential reduce the harm caused to patients by novices performing procedures, increase efficiency by reducing the time needed to train in the clinical environment and increase the opportunity to repeatedly practice rare procedures as well as allowing the assessment of performance. Simulators can consist of mechanical devices, employ cadaveric animal tissue or use virtual reality technology. Simulators have been used to teach upper and lower gastrointestinal endoscopy as well as interventional procedures. This review reviews the currently available endoscopic simulators, and the evidence for their efficacy, demonstrating that the ability of simulators to differentiate between novice and expert endoscopists is well established. There is limited evidence for improved patient outcome as a result of simulation training. We also consider how the environment within which a simulation is placed can be manipulated to alter the learning achieved, broadening the scope of simulation to develop communication as well as technical skills. Finally the implications for future practice are considered; technology is likely improve the fidelity of simulators, increasing the potential for simulation to improve patient outcomes. The impact of the simulation environment, and the correct place of simulation within the training curriculum are both issues which need addressing.

Key Words: Gastroenterology, Endoscopy, Simulation, Simulation environment, Interventional endoscopy

Core tip: Evidence is increasing that simulation is an effective means of teaching interventional procedures. We review the current use of simulators and the evidence for their efficacy, before considering the impact of the simulation environment on the learning that can be achieved. We argue that the use of the simulation environment as a tool to broaden the educational scope of simulation to teach skills other than the technical, is important to maximum utilisation of simulation.



INTRODUCTION

Simulation has been increasingly described in endoscopy since the late 1970s. As a method of teaching it has a number of potential advantages. These include reducing the harm caused to patients by novices performing procedures[1-4], an increase in efficiency by reducing the time needed to train in the clinical environment[5], the opportunity to repeatedly practice rare procedures and assessment of performance. The use of simulation moves the focus of an encounter firmly onto the learner, so education becomes the sole object of the exercise, which distinguishes it from clinical training, where the interests of the patient must always be placed ahead of education. In simulation, mistakes that would be unacceptable in clinical practice can be allowed to occur, providing opportunities for learning[6]. There has also been increasing interest in the use of simulation for assessment and credentialing purposes[7].

In order to further describe the use of simulation in endoscopy and its potential future role in training endoscopists, some definitions are needed. McGaghie defines simulation as: “a person, device, or set of conditions which attempts to present (education and) problems authentically. The student or trainee is required to respond to the problems as he or she would under natural circumstances[8]”.

The importance of this definition is that it sees simulation as a process. A simulator, by contrast, can be seen as the device used to represent the problem itself, performing an endoscopic procedure.

The simulation environment is, importantly, distinct from the simulator. For the purposes of this review we define the simulation environment as “the context in which the simulation is placed”. This definition is deliberately rather loose. The majority of the following discussion will focus on the physical space in which the simulator is placed, as well as its contents, but this environment can be seen in broader terms. How a simulation is placed within the broader curriculum of training, for example, may have a profound effect on its usefulness.

This review will discuss the various endoscopic simulators available, before considering the evidence for their efficacy. The role of the simulation environment will then be considered, before we speculate on the role of simulation in training the next generation of endoscopists.

ENDOSCOPIC SIMULATORS

Broadly, simulators currently available are able to simulate upper gastrointestinal (GI) endoscopy, lower GI endoscopy and interventional procedures. The devices available can be divided into mechanical simulators, those involving animal tissue, whether living or cadaveric and virtual reality tools.

Mechanical simulators

Mechanical simulators have been available for some time. The Erlangen plastic mannequin was described in 1974, and allowed upper GI endoscopy to be simulated[9]. These models are typically limited by a lack of fidelity (the subjective sense of how “real” a simulation is) and by a lack of variation, as the simulator is the same for every simulation.

Animal models

The use of animal tissue for endoscopic simulation has the advantage of producing a higher degree of fidelity, as animal tissue behaves more like that of a human than a mechanical model. The use of live animals in simulation has been limited by expense, the need for expensive infrastructure and ethical concerns. The use of live animals for simulating medical procedures is currently banned in the United Kingdom.

Cadaveric animal tissue has been used rather more extensively, particularly in composite simulators, where animal tissue and mechanical models are combined. This is perhaps of most use in simulators seeking to replicate interventional procedures. The Erlangen active simulator for interventional endoscopy (EASIE) (ECE-Training GmbH, Erlangen, Germany), for example, uses specially prepared cadaveric porcine organs with arteries sewn into their linings, and an electric pump to produce spurting blood[10,11]. Similar, more portable composite simulators have subsequently been developed to allow the diagnostic endoscopy, polypectomy, percutaneous endoscopic gastrostomy (PEG) gastrostomy and endoscopic retrograde cholangio-pancreatography (ERCP) to be practiced[12-14]. With the exception of anatomical variation, the placement of the porcine duodenal papilla being more proximal than the human for example, these models offer a high degree of fidelity but at the cost of the time required for preparation, requiring deep frozen animal tissue to be thawed and placed within the simulator on a baseplate[9].

Virtual reality

The introduction of virtual reality (VR) technology to simulators has had a large impact on the possibilities offered. Two commonly used examples are the GI bronch mentor (Sim-bionix, Cleveland, Ohio) and the CAE accutouch (CAE Healthcare, Montreal, Quebec, Canada; previously marketed by Immersion Medical, San Jose, California). Both simulators consist of a plastic mannequin on a trolley and possess both a mouth and an anus, allowing upper and lower GI procedures to be performed. The instruments used are standard endoscopes and the operating end and are attached to the simulator at the other. Sensors in the mannequin deliver haptic feedback to the user as well as guiding the simulation. Haptic feedback produces forces on the endoscopic which resemble those experienced in real endoscopy, thus allowing tactile as well as visual feedback to be gained by the learner. Both simulators have supplemental modules, which allow more complex procedures to be simulated. The GI bronch mentor can simulate haemostasis, flexible sigmoidsoscopy, ECRP and diagnostic EUS. The CAE accutouch has supplemental modules, which allow polypectomy, biopsy and haemostasis to be practiced.

VR simulators have a variety of potential advantages. They require very little set up time and can be used repeatedly by learners for practice. The addition of anatomical variation and varying degrees of difficulty to the simulator means that repeated procedures can be simulated with different pathologies and anatomical variations.

One of the most important features of VR simulators is the ease with which performance feedback can be produced. Both the VR simulators described provide a feedback to the leaner with performance parameters including the total time of the examination, pathological findings recognised, degree of air insufflation, patient degree of discomfort, percentage of mucosa visualized and time spent in “red out” (in contact with the bowel wall)[9].

The provision of performance feedback has been recognised as an important feature of successful simulation based education[15]. The provision of feedback by the simulator itself has the potential to allow sustained practice by trainees without the need for the continuous presence of a trainer.

EVIDENCE FOR EFFICACY

Having described the simulators available, it can be seen that the potential exists to reproduce clinical scenarios outside a clinical environment. The use of simulators in training endoscopists is however, only of use if it translates into a benefit which is observable when procedures are performed on real patients, either in terms of improved performance by the trainee or, ideally, in measurable improvement in patient outcomes. The literature on simulation has, in general adopted two approaches to demonstrating the efficacy of simulators. The first is validation studies, where the end point used is performance on the simulator[16]. The two main means of validation reported are the ability of a simulator to demonstrate difference in performance between novices and experts (construct validity)[17] and the ability for practice on a simulator to produce a measurable improvement in performance[18]. The second approach is to compare the performance of simulation and non simulation trained learners in the clinical environment. As we shall see, few studies have investigated the relationship between patient outcome and simulation training.

The performance metrics produced by VR simulators make construct validity easy to demonstrate, as performance is assessed by the simulator and not by an external observer[19]. Construct validity for upper GI endoscopy was been demonstrated some time ago[20,21]. A series of studies have also demonstrated that VR simulators can distinguish novice from expert endoscopists in lower GI endoscopy (Macdonald)[22-26]. The GI mentor has also been shown to have construct validity when simulating ECRP[27]. A recent systematic review by Ansell et al demonstrated that the most valid metrics for training and assessment across VR simulators for colonoscopy are total procedure time, caecal intubation time, efficiency and the percentage of muscosa visualised[28]. This review also highlighted the fact that the majority of validity evidence pertains to the construct validity of VR simulators, with only one study reporting validation of a bovine model[9].

What is more difficult to demonstrate, however, is the ability of simulators to distinguish the intermediate level endoscopist from the expert[17,22,29], leading to the speculation that the role of VR simulators is limited to the teaching of basic navigational skills rather than more complex interventional procedures[5].

There is also increasing evidence from clinical studies. The overall efficacy of skills transfer into the operating room was the subject of a recent systematic review by Dawe et al[30], which included 10 studies looking at the effect of simulation based training on clinical performance. This concluded that the current evidence demonstrates that simulation-based training, as part of a training program and incorporating the achievement of reaching predetermined proficiency levels, results in skills that are transferable to the operative setting for laparoscopic cholecystectomy and endoscopy. Di Giulio et al[31] demonstrated in 2004 that simulation trained fellows performed more complete procedures and had their performance assessed as “positive” more frequently.

Looking at colonoscopy specifically, Cohen et al[32] randomised GI fellows to 10 h of unsupervised practice on the GI mentor or no training. Simulator trained fellows had higher competency rates during the 1st 100 cases than non-simulator trained fellows, but this effect was reduced with time. Both groups required 160 cases to achieve 90% competence. The simulation training in this study was distinguished by the absence of feedback from faculty, and by being limited to the early part of training, rather than being sustained throughout it.

The majority of the literature on training in interventional techniques has described the use of composite ex vivo simulators, which, have been shown to improve performance in several randomised trials[33-35]. These studies, however are mostly limited by the fact that assessment of skills was performed on the simulator rather than in the clinical setting, although one also demonstrated that procedure times were reduced in clinical practice in simulation trained residents and that a non significant reduction in complications occurred in their patients[35]. One randomised study has demonstrated that ERCP skills learned by novices can be shown to lead to improved performance when procedures are performed in patients[36].

In the end, one of the ultimate goals of procedural training is improved outcomes for patients. If demonstrable improvements in patient outcome can be delivered by simulation based training, then the case for its use is made. There is some evidence emerging in the laparoscopic and anaesthetic literature that the use of simulation reduces complication rates[37]. Within endoscopy, there is limited evidence. Although reduced complication rates have been hinted at in interventional procedures as described above, and one study has demonstrated improved patient comfort during conscious procedures performed by novices trained using simulation[38].

In summary, the current evidence demonstrates construct validity for VR simulation. There is evidence for improved performance in the clinical environment but this may not be maintained in later endoscopies as competence is not reached any sooner by simulation trained learners[5,39]. There is a little evidence for better patient outcome but this has only been demonstrated by one study looking at patient comfort[38].

SIMULATION ENVIRONMENT

As we have seen, the majority of the evidence for the use of simulation to teach endoscopy and endoscopic procedures focuses on the efficacy of the use of simulators to teach practical skills. This, of course is an extremely important component of learning to perform endoscopy in the clinical environment. Adverse clinical events, which lead to the potential for harm to patients, however, are more often related to failures of communication, clinical judgement and teamwork than to technical error[40-42].

The role of simulation can be extended to allow the potential for teaching skills beyond the technical if the simulation environment is modified. The simulation environment can place the practice of technical skills in a range of contexts, from the use of portable trainer at home[43] to a completely simulated operating theatre containing a theatre team[44]. What is being taught and assessed during the simulation is, therefore, highly dependent on the simulation environment.

One means of broadening the scope of endoscopic simulation is to place an actor within the simulation environment, producing a “simulated patient”. This simulation demands more of the learner than the simple performance of a technical task, as the interaction with the simulated patient must occur alongside the simulated endoscopic procedure[45-47]. Kneebone et al[48] describe a course for novice nurse endoscopists in which a component is the use of “hybrid simulation” in which an actor and a VR simulator are combined. These authors achieved this by setting up the room with the actor leaning on their left side next to the simulator, with a blanket covering both, producing the illusion that the procedure was being carried out on a real patient. This course led to an improvement in simulator metrics from the VR simulator, and extremely positive qualitative feedback about the improvement in communication skills facilitated by the use of simulated patients.

Another example of using the simulation environment to broaden the scope of simulation is the placement of a simulator within the normal clinical environment, achieving a degree of fidelity that is not usually achievable, unlocking the potential of simulation to reveal interactions within clinical teams as well as between clinicians and patients.

Finally, the use of a portable space for simulation as a simulation environment has the potential to avoid both the problem of simulation being inaccessible to trainees located away from central clinical skills centres and simulation sessions disturbing the normal function of the clinical environment. This has been described by a group from Imperial College London using an inflatable environment in which a large number of simulations can be produced[49]. This space can then be filled with equipment that allows a clinical area to be simulated with enough realism to produce a high degree of fidelity, whilst being portable enough to be placed in a car.

CONCLUSION

The use of simulation to train the next generation of endoscopists needs to be supported by an increasing amount and quality of evidence, particularly for the clinical transferability of simulation training, but it is arguable that the evidence available already supports the use of simulation to train novice endoscopists.

The technology available for simulators is likely to lead to an increase in fidelity and to an increase in the complexity of metrics available, and validity studies supporting the use of each new generation of simulators is important both to support their use for training and also, in particular, to support their use for assessment.

We would argue that further thought also needs to be given to the simulation environment. Increasing the sophistication of simulation by manipulating the simulation environment, as we have seen, contains the potential to address the teaching of skills beyond the technical.

Further work is needed to place simulation within a broader curriculum of training. The majority of studies looking at simulation in endoscopy have looked at the effect of short periods of simulation training before clinical experience. It may be that integration of simulation alongside developing clinical practice might increase its efficacy and lead to a more sustained benefit than those demonstrated by studies to date.

ACKNOWLEDGEMENTS

The authors would like to acknowledge Dr. Eleanor Bond’s helpful comments on this manuscript.

Footnotes

P- Reviewers: Afzal M, Lykke J, Skok P, Sirin G S- Editor: Ji FF L- Editor: A E- Editor: Zhang DN

References
1.  Ziv A, Wolpe PR, Small SD, Glick S. Simulation-based medical education: an ethical imperative. Simul Healthc. 2006;1:252-256.  [PubMed]  [DOI]  [Cited in This Article: ]
2.  Grantcharov TP, Kristiansen VB, Bendix J, Bardram L, Rosenberg J, Funch-Jensen P. Randomized clinical trial of virtual reality simulation for laparoscopic skills training. Br J Surg. 2004;91:146-150.  [PubMed]  [DOI]  [Cited in This Article: ]
3.  Zendejas B, Cook DA, Bingener J, Huebner M, Dunn WF, Sarr MG, Farley DR. Simulation-based mastery learning improves patient outcomes in laparoscopic inguinal hernia repair: a randomized controlled trial. Ann Surg. 2011;254:502-509; discussion 502-509.  [PubMed]  [DOI]  [Cited in This Article: ]
4.  Seymour NE, Gallagher AG, Roman SA, O’Brien MK, Bansal VK, Andersen DK, Satava RM. Virtual reality training improves operating room performance: results of a randomized, double-blinded study. Ann Surg. 2002;236:458-463; discussion 463-464.  [PubMed]  [DOI]  [Cited in This Article: ]
5.  Sedlack RE. The state of simulation in endoscopy education: continuing to advance toward our goals. Gastroenterology. 2013;144:9-12.  [PubMed]  [DOI]  [Cited in This Article: ]
6.  Arora S, Sevdalis N. HOSPEX and concepts of simulation. J R Army Med Corps. 2008;154:202-205.  [PubMed]  [DOI]  [Cited in This Article: ]
7.  Sedlack RE, Baron TH, Downing SM, Schwartz AJ. Validation of a colonoscopy simulation model for skills assessment. Am J Gastroenterol. 2007;102:64-74.  [PubMed]  [DOI]  [Cited in This Article: ]
8.  McGaghie WC, Issenberg SB, Petrusa ER, Scalese RJ. A critical review of simulation-based medical education research: 2003-2009. Med Educ. 2010;44:50-63.  [PubMed]  [DOI]  [Cited in This Article: ]
9.  Desilets DJ, Banerjee S, Barth BA, Kaul V, Kethu SR, Pedrosa MC, Pfau PR, Tokar JL, Varadarajulu S, Wang A. Endoscopic simulators. Gastrointest Endosc. 2011;73:861-867.  [PubMed]  [DOI]  [Cited in This Article: ]
10.  Hochberger J, Neumann M, Maiss J. Erlanger Ausbildungssimulator für die interventionelle Endoskopie (EASIE): Eine neue Perspektive für die qualitdtsorientierte praktische Ausbildung (German). Endosk heute. 1998;4:23-25.  [PubMed]  [DOI]  [Cited in This Article: ]
11.  Hochberger J, Neumann M, Hohenberger W. Neuer Endoskopie- Trainer für die therapeutische flexible Endoskopie (German). Z Gastroenterol. 1997;35:722-733.  [PubMed]  [DOI]  [Cited in This Article: ]
12.  Sedlack R. Simulation in gastrointestinal endoscopy. Practical Healthcare Simulations. Philadelphia: Elsevier Mosby 2004; 459-474.  [PubMed]  [DOI]  [Cited in This Article: ]
13.  Neumann M, Mayer G, Ell C, Felzmann T, Reingruber B, Horbach T, Hohenberger W. The Erlangen Endo-Trainer: life-like simulation for diagnostic and interventional endoscopic retrograde cholangiography. Endoscopy. 2000;32:906-910.  [PubMed]  [DOI]  [Cited in This Article: ]
14.  May A, Nachbar L, Schneider M, Neumann M, Ell C. Push-and-pull enteroscopy using the double-balloon technique: method of assessing depth of insertion and training of the enteroscopy technique using the Erlangen Endo-Trainer. Endoscopy. 2005;37:66-70.  [PubMed]  [DOI]  [Cited in This Article: ]
15.  Issenberg SB, McGaghie WC, Petrusa ER, Lee Gordon D, Scalese RJ. Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic review. Med Teach. 2005;27:10-28.  [PubMed]  [DOI]  [Cited in This Article: ]
16.  Van Nortwick SS, Lendvay TS, Jensen AR, Wright AS, Horvath KD, Kim S. Methodologies for establishing validity in surgical simulation studies. Surgery. 2010;147:622-630.  [PubMed]  [DOI]  [Cited in This Article: ]
17.  Haycock AV, Bassett P, Bladen J, Thomas-Gibson S. Validation of the second-generation Olympus colonoscopy simulator for skills assessment. Endoscopy. 2009;41:952-958.  [PubMed]  [DOI]  [Cited in This Article: ]
18.  Carter FJ, Schijven MP, Aggarwal R, Grantcharov T, Francis NK, Hanna GB, Jakimowicz JJ. Consensus guidelines for validation of virtual reality surgical simulators. Surg Endosc. 2005;19:1523-1532.  [PubMed]  [DOI]  [Cited in This Article: ]
19.  Kneebone R. Simulation in surgical training: educational issues and practical implications. Med Educ. 2003;37:267-277.  [PubMed]  [DOI]  [Cited in This Article: ]
20.  Moorthy K, Munz Y, Jiwanji M, Bann S, Chang A, Darzi A. Validity and reliability of a virtual reality upper gastrointestinal simulator and cross validation using structured assessment of individual performance with video playback. Surg Endosc. 2004;18:328-333.  [PubMed]  [DOI]  [Cited in This Article: ]
21.  Ferlitsch A, Glauninger P, Gupper A, Schillinger M, Haefner M, Gangl A, Schoefl R. Evaluation of a virtual endoscopy simulator for training in gastrointestinal endoscopy. Endoscopy. 2002;34:698-702.  [PubMed]  [DOI]  [Cited in This Article: ]
22.  MacDonald J, Ketchum J, Williams RG, Rogers LQ. A lay person versus a trained endoscopist: can the preop endoscopy simulator detect a difference? Surg Endosc. 2003;17:896-898.  [PubMed]  [DOI]  [Cited in This Article: ]
23.  Sedlack RE, Kolars JC. Colonoscopy curriculum development and performance-based assessment criteria on a computer-based endoscopy simulator. Acad Med. 2002;77:750-751.  [PubMed]  [DOI]  [Cited in This Article: ]
24.  Grantcharov TP, Carstensen L, Schulze S. Objective assessment of gastrointestinal endoscopy skills using a virtual reality simulator. JSLS. 2005;9:130-133.  [PubMed]  [DOI]  [Cited in This Article: ]
25.  Mahmood T, Darzi A. A study to validate the colonoscopy simulator. Surg Endosc. 2003;17:1583-1589.  [PubMed]  [DOI]  [Cited in This Article: ]
26.  Sedlack RE, Kolars JC. Validation of a computer-based colonoscopy simulator. Gastrointest Endosc. 2003;57:214-218.  [PubMed]  [DOI]  [Cited in This Article: ]
27.  Bittner JG, Mellinger JD, Imam T, Schade RR, Macfadyen BV. Face and construct validity of a computer-based virtual reality simulator for ERCP. Gastrointest Endosc. 2010;71:357-364.  [PubMed]  [DOI]  [Cited in This Article: ]
28.  Ansell J, Mason J, Warren N, Donnelly P, Hawkes N, Dolwani S, Torkington J. Systematic review of validity testing in colonoscopy simulation. Surg Endosc. 2012;26:3040-3052.  [PubMed]  [DOI]  [Cited in This Article: ]
29.  Koch AD, Buzink SN, Heemskerk J, Botden SM, Veenendaal R, Jakimowicz JJ, Schoon EJ. Expert and construct validity of the Simbionix GI Mentor II endoscopy simulator for colonoscopy. Surg Endosc. 2008;22:158-162.  [PubMed]  [DOI]  [Cited in This Article: ]
30.  Dawe SR, Windsor JA, Broeders JA, Cregan PC, Hewett PJ, Maddern GJ. A systematic review of surgical skills transfer after simulation-based training: laparoscopic cholecystectomy and endoscopy. Ann Surg. 2014;259:236-248.  [PubMed]  [DOI]  [Cited in This Article: ]
31.  Di Giulio E, Fregonese D, Casetti T, Cestari R, Chilovi F, D’Ambra G, Di Matteo G, Ficano L, Delle Fave G. Training with a computer-based simulator achieves basic manual skills required for upper endoscopy: a randomized controlled trial. Gastrointest Endosc. 2004;60:196-200.  [PubMed]  [DOI]  [Cited in This Article: ]
32.  Cohen J, Cohen SA, Vora KC, Xue X, Burdick JS, Bank S, Bini EJ, Bodenheimer H, Cerulli M, Gerdes H. Multicenter, randomized, controlled trial of virtual-reality simulator training in acquisition of competency in colonoscopy. Gastrointest Endosc. 2006;64:361-368.  [PubMed]  [DOI]  [Cited in This Article: ]
33.  Hochberger J, Matthes K, Maiss J, Koebnick C, Hahn EG, Cohen J. Training with the compactEASIE biologic endoscopy simulator significantly improves hemostatic technical skill of gastroenterology fellows: a randomized controlled comparison with clinical endoscopy training alone. Gastrointest Endosc. 2005;61:204-215.  [PubMed]  [DOI]  [Cited in This Article: ]
34.  Maiss J, Wiesnet J, Proeschel A, Matthes K, Prat F, Cohen J, Chaussade S, Sautereau D, Naegel A, Krauss N. Objective benefit of a 1-day training course in endoscopic hemostasis using the “compactEASIE” endoscopy simulator. Endoscopy. 2005;37:552-558.  [PubMed]  [DOI]  [Cited in This Article: ]
35.  Haycock AV, Youd P, Bassett P, Saunders BP, Tekkis P, Thomas-Gibson S. Simulator training improves practical skills in therapeutic GI endoscopy: results from a randomized, blinded, controlled study. Gastrointest Endosc. 2009;70:835-845.  [PubMed]  [DOI]  [Cited in This Article: ]
36.  Lim BS, Leung JW, Lee J, Yen D, Beckett L, Tancredi D, Leung FW. Effect of ERCP mechanical simulator (EMS) practice on trainees’ ERCP performance in the early learning period: US multicenter randomized controlled trial. Am J Gastroenterol. 2011;106:300-306.  [PubMed]  [DOI]  [Cited in This Article: ]
37.  Barsuk JH, McGaghie WC, Cohen ER, O’Leary KJ, Wayne DB. Simulation-based mastery learning reduces complications during central venous catheter insertion in a medical intensive care unit. Crit Care Med. 2009;37:2697-2701.  [PubMed]  [DOI]  [Cited in This Article: ]
38.  Sedlack RE, Kolars JC, Alexander JA. Computer simulation training enhances patient comfort during endoscopy. Clin Gastroenterol Hepatol. 2004;2:348-352.  [PubMed]  [DOI]  [Cited in This Article: ]
39.  Gerson LB. Evidence-based assessment of endoscopic simulators for training. Gastrointest Endosc Clin N Am. 2006;16:489-509, vii-viii.  [PubMed]  [DOI]  [Cited in This Article: ]
40.  Calland JF, Guerlain S, Adams RB, Tribble CG, Foley E, Chekan EG. A systems approach to surgical safety. Surg Endosc. 2002;16:1005-1014; discussion 1015.  [PubMed]  [DOI]  [Cited in This Article: ]
41.  Vincent C, Neale G, Woloshynowych M. Adverse events in British hospitals: preliminary retrospective record review. BMJ. 2001;322:517-519.  [PubMed]  [DOI]  [Cited in This Article: ]
42.  Undre S, Arora S, Sevdalis N. Surgical performance, human error and patient safety in urological surgery. Br J Med Surg Urol. 2009;2:2-10.  [PubMed]  [DOI]  [Cited in This Article: ]
43.  Griffin S, Kumar A, Burgess N, Donaldson P. Development of laparoscopic suturing skills: a prospective trial. J Endourol. 2006;20:144-148.  [PubMed]  [DOI]  [Cited in This Article: ]
44.  Aggarwal R, Undre S, Moorthy K, Vincent C, Darzi A. The simulated operating theatre: comprehensive training for surgical teams. Qual Saf Health Care. 2004;13 Suppl 1:i27-i32.  [PubMed]  [DOI]  [Cited in This Article: ]
45.  Kneebone R, Kidd J, Nestel D, Asvall S, Paraskeva P, Darzi A. An innovative model for teaching and learning clinical procedures. Med Educ. 2002;36:628-634.  [PubMed]  [DOI]  [Cited in This Article: ]
46.  Kneebone R, Nestel D, Wetzel C, Black S, Jacklin R, Aggarwal R, Yadollahi F, Wolfe J, Vincent C, Darzi A. The human face of simulation: patient-focused simulation training. Acad Med. 2006;81:919-924.  [PubMed]  [DOI]  [Cited in This Article: ]
47.  Donaldson L 150 years of the Annual Report of the Chief Medical Officer: On the state of public health 2008. London: Dep Heal 2009; .  [PubMed]  [DOI]  [Cited in This Article: ]
48.  Kneebone RL, Nestel D, Moorthy K, Taylor P, Bann S, Munz Y, Darzi A. Learning the skills of flexible sigmoidoscopy - the wider perspective. Med Educ. 2003;37 Suppl 1:50-58.  [PubMed]  [DOI]  [Cited in This Article: ]
49.  Kneebone R, Arora S, King D, Bello F, Sevdalis N, Kassab E, Aggarwal R, Darzi A, Nestel D. Distributed simulation--accessible immersive training. Med Teach. 2010;32:65-70.  [PubMed]  [DOI]  [Cited in This Article: ]