Minimally Invasive Surgery
Volume 2020 (2020), Article ID 5879485, 10 pages
https://doi.org/10.1155/2020/5879485

Review Article

Transferability of Simulation-Based Training in Laparoscopic Surgeries: A Systematic Review

Antonios E. Spiliotis,¹ Panagiotis M. Spiliotis,² and Ifaistion M. Palios³

¹Department of General, Visceral, Vascular and Pediatric Surgery, Saarland University, Saarland University Medical Center, Homburg, Germany
²Department of Surgery, University Hospital Knappschaftskrankenhaus Bochum, Ruhr-University Bochum, Bochum, Germany
³Department of Surgery, Laiko General Hospital, National and Kapodistrian University of Athens, Athens, Greece

Correspondence should be addressed to Antonios E. Spiliotis; antonispilio@hotmail.gr

Received 16 April 2020; Revised 1 August 2020; Accepted 7 August 2020; Published 25 August 2020

Academic Editor: Peng Hui Wang

Copyright © 2020 Antonios E. Spiliotis et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract.

Objective. The implementation of simulation-based training in residency programs has been increased, but the transferability of surgical skills in the real operating room is not well documented. In our survey, the role of simulation in surgical training will be evaluated. Study Design. In this systemic review, randomized control trials, which assessed the transferability of acquired skills through simulation in the real operating setting, were included. A systematic search strategy was undertaken using a predetermined protocol. Results. Eighteen randomized clinical trials were included in this survey. Two studies investigated inguinal hernia repair, six laparoscopic cholecystectomy, five gynecologic procedures, two laparoscopic suturing, and two camera navigation during laparoscopic procedures. Simulation-trained participants showed superiority in surgical performance in comparison with untrained surgeons. The operation time, accuracy, incidence of intraoperative errors, and postoperative complications were statistically better in the simulation-trained group in comparison with the conventional-trained group. Conclusion. Simulation provides a safe, effective, and ethical way for residents to acquire surgical skills before entering the operating room.

1. Introduction

Many factors affect the postgraduate surgical training including changes in working hours. Since 2009, the European Working Time Directive has reduced the maximum amount of hours spent working to an average of 48 hours per week [1]. Consequently, trainees should reach the same level of competency as their predecessors, when working hours are reduced [2]. Furthermore, it has been calculated that teaching surgical residents in the operating room costs $53 million per annum in the USA, which in turn causes further financial pressures in training procedure [3].

According to recent epidemiological studies, medical errors are considered as common causes of death in the USA [4]. The fact that patients are exposed to inexperienced healthcare practitioners has led the educational system to reevaluate medical training [5].

Simulation is a new developed educational procedure, in which trainees are able to improve their medical skills. This educational approach provides opportunities for repeated and safe medical training in a simulated environment [6]. Virtual reality, animal models, simulated patients, and static or interactive manikins are utilized effectively in simulation programs [7, 8].

Simulation has been supported by the Food and Drug Administration (FDA) as a fundamental part of surgical training in carotid artery stenting [9]. Similarly, the Residency Review Committee and the American College of Surgeons (ACS) have emphasized the importance of its role [10]. According to the American Board of Surgery, individuals are required to complete successfully an educational program entitled “The Fundamentals of Laparoscopic Surgery” (FLS) developed by the Society of American Gastrointestinal and Endoscopic Surgeons (SAGES), to be board certified in general surgery [11, 12].

More than 20 types of computer-based trainers have been developed for a wide spectrum of surgical interventions [13–15]. Simulation techniques can be applied in many health care domains such as surgery, obstetrics, invasive cardiology, anesthesia, critical care, and emergency medicine [16]. The use of simulation has been increased in the last few years, but it has not reached a widespread adoption in healthcare education and training. Although results are positive and encouraging, integration of simulation-based training into residents’ curricula remains compromised [17], and simulation laboratories continue to be underutilized [18].

The aim of this systematic review is to determine whether surgical skills acquired through simulation-based training are transferable to the operating room.

2. Material and Methods

This review focused on published literature, which evaluates the transferability of simulation-based training into the real operating room. The literature search was carried out in the following databases: Embase, PubMed, the Cochrane Library and Current Contents, Clinical Trials Database (US), NHS Centre for Research and Dissemination Databases (UK), and National Research Register (UK). Articles published in English or German were included in our survey. The search strategy included the following keywords: “Simulation Training”[Mesh] AND “Surgical Procedures, Operative”[Mesh] AND “Laparoscopy”[Mesh]. Figure 1 demonstrates the elimination of articles that came up during the search process.

Figure 1: Trial flow. Flow chart showing selection of articles for review.

2.1. Inclusion and Exclusion Criteria

Randomized clinical trials (RCTs), which investigated the transferability of surgical skills in the real operating environment, were included in this review. Included studies compared the use of technology-enhanced simulation at any year of residency with conventional training activity. In all surveys, simulation was used as the educational procedure for teaching laparoscopic skills. Simulators included in this review were virtual reality, box trainers, task trainers, and cadaveric or live porcine models. The transferability of surgical skills was assessed in the real operating theater. Studies that evaluated performance in a simulation environment (virtual reality or box trainers) or animals (live, cadaveric, or anesthetized pig or porcine model) were excluded. We did not make exclusions based on the outcome or year of publication. Studies dealing with other minimally invasive techniques such as arthroscopy and gastrointestinal, airway, or urogenital endoscopy were excluded. Single-group pretest-posttest studies, nonrandomized studies, reviews, or meta-analyses were excluded.

2.2. Data Extraction and Analysis

An adopted coding framework based on PRISMA [19] and Cochrane handbook [20] was used to review the literature. Study quality was assessed according to the methods given in §6 of the Cochrane Reviewers’ Handbook on a number of parameters, including quality of the reporting study methodology, methods of randomization and allocation concealment, blinding of trainers and outcomes assessors, and sample sizes. After identifying all potentially relevant studies of simulation-based training for health professions, two reviewers have screened all titles and abstracts (or full text) for inclusion.

2.3. Objectives and Outcome Measures

Objective of the study is to evaluate the effectiveness of simulation training and comparing this training modality with traditional education. Laparoscopic skills, surgical performance, and types of intraoperative errors will be compared between the two groups.

The following parameters will be assessed between participants in both modalities:

(i)Operative time,(ii)Intraoperative and postoperative complications,(iii)Laparoscopic skills,(iv)Camera navigation,(v)Percentage of errors and economy of movements,(vi)Visuospatial ability,(vii)And technical proficiency.

3. Results

A total of 18 studies met our inclusion criteria. All after training assessments were conducted in the real operating theater, and all studies were RCTs (Table 1).

Table 1: Included randomized clinical trials which have evaluated the transferability of simulation-based training in a real operating room.

Study
Simulation method
Number of participants
Groups
Assessment
Results

Zendejas et al. [21]
Guildford MATTU TEP hernia task trainer (Limbs and Things, Ltd. Bristol, UK)
50 surgical surgeons
(i) Simulation-based mastery learning (ML) curriculum
(ii) Standard practice (self-learning and intraoperative learning)
Totally extraperitoneal (TEP) inguinal hernia repair
Operative time was shorter, and operative performance (GOALS scale) was better in the simulation group (). Intraoperative and postoperative complications were statistically decreased for simulation-trained residents ().

Nilsson et al. [22]
LapSim virtual reality simulator (software version 2015, Surgical Science, Gothenburg, Sweden)
36 surgical novices without prior laparoscopic experience
(i) Camera group
(ii) Simulation-based cholecystectomy (procedure group)
(iii) Control group
Camera assessment during a laparoscopic cholecystectomy
No statistically significant differences in camera navigation skills were found during a laparoscopic cholecystectomy between the groups. On the simulation-based test (LASTT model), technical skills were significantly better for the camera and the procedure group compared with the control group.

Franzeck et al. [23]
LAP MentorTM (Simbionix USA, Cleveland, OH). ProMISTM surgical hybrid simulator (Haptica Ltd., Dublin, Ireland)
24 pregraduation medical students
(i) Simulation group
(ii) Training in the operating room
Camera assessment test in the operating room
Both groups improved their navigation skills significantly. The simulation group showed a trend towards better performance.

Seymour et al.[24]
Minimally invasive surgical trainer-virtual reality (MIST-VR) system (Mentice AB, Gothenburg, Sweden)
16 surgical residents
(i) Virtual reality
(ii) Control group
Laparoscopic cholecystectomy
Simulation group performed the procedure 29% faster. Intraoperative complications (gallbladder injury or burn of nontarget tissue) occurred more commonly in the control group ().

Grantcharov et al. [25]
MIST-VR system (Mentice AB, Gothenburg, Sweden)
16 surgical trainees
(i) Virtual reality
(ii) Control group
Laparoscopic cholecystectomy
Participants in the simulation group conducted the surgery statistically faster (). Percentage of errors and economy of movements were significantly improved after virtual reality training ().

Palter et al. [26]
LapSim virtual reality simulator
20 general surgery residents(PGY 1-2)
(i) Structured training and assessment curriculum (STAC) group
(ii) Conventional residency training
Laparoscopic cholecystectomy
Residents performed five sequential laparoscopic cholecystectomies in the operating room. The STAC group conducted the first four operations statistically better than the control group (OSAT global rating scale). In the fifth procedure, there was no significant difference. Participants in the STAC group showed improved nontechnical skills compared with the control group ().

Palter and Grantcharov [27]
LapSim VR simulator (Gothenburg, Sweden, 2008 version)
16 surgery residents(PGY 1-2)
(i) Virtual reality group
(ii) Conventional residency training group
Laparoscopic cholecystectomy
Individualized deliberate practice on simulator results in a statistically superior performance in the operating theater for the simulation group compared with the control group ().

Ahlberg et al. [28]
LapSim
13 surgical residents
(i) Training group
(ii) Control group
Laparoscopic cholecystectomy
Virtual reality group outperformed the control group in terms of operative time and number of errors intraoperatively.

Bansal et al. [29]
Box trainer, the Tubingen MIC-Trainer (Richard Wolf GmbH, Germany)
17 surgery residents
(i) Laparoscopic training group
(ii) Standard training group
Laparoscopic cholecystectomy
The laparoscopic training group showed statistically better results in the operative time (), plane of dissection (), and GOALS criteria. The rate of gallbladder perforation was higher for untrained surgeons, but a statistically significant difference was not found.

Banks et al. [30]
Laparoscopy simulator (Limbs and Things, Bristol, UK) and an operative laparoscopy tower
20 residents(PGY 1)
(i) Simulation-based training and surgical training in the operating room
(ii) Surgical training in the operating room
Laparoscopic bilateral tubal ligation
Simulation group performed the intervention statistically better than the control group. Surgical skills in simulation-trained residents were improved compared with the control group ().

Gala et al. [31]
Psychomotor board testing with a peg board test
44 lower-level residents (PGY 1-2) and 66 upper-level (PGY 3-4)
(i) Traditional training
Laparoscopic Pomeroy bilateral tubal ligation
Simulation-trained surgeons showed significantly higher normalized simulation scores () and higher levels of competence on the simulated tasks (). Simulation group had improved surgical skills (Likert scale) in the operating theater compared with the control group ().

Larsen et al. [32]
LapSim Gyn v 3.0.1 (Surgical Science, Gothenburg, Sweden)
32 trainees in gynecological specialty(PGY 1 and 2)
(i) Intervention group
(ii) Control group
Laparoscopic salpingectomy
Intervention group performed the surgery with statistically significant superiority compared with the control group (). Operative time was significantly shorter in the simulation group ().

Patel et al. [33]
Porcine cadaver
22 residents
(i) Simulation group
(ii) Control group
Laparoscopic salpingectomy
Simulation can improve significantly surgical skills (OSAT scores) in laparoscopic salpingectomy. Combination of simulation and traditional training is recommended.

Ahlborg et al. [34]
LapSim Gyn VR simulator (Surgical Science, Gothenburg, Sweden)
28 trainees
(i) Simulator training
(ii) Simulator training with mentorship
(iii) Control group
Laparoscopic tubal occlusion
Visuospatial ability, flow score, and self-efficacy were significantly higher for both the simulator-training groups compared with the control group. Duration of surgery was significantly shorter in the training groups. Differences in surgical performance between the two simulation groups were not detected.

Palter et al. [35]
LapSim (Surgical Science, Gothenburg, Sweden)
25 surgical residents(PGY 2-4)
(i) Curriculum training group
(ii) Conventional residency training
Laparoscopic right colectomy
Curriculum group showed statistically significant superiority in technical proficiency compared with the conventional group (OSATS score, ). Curriculum-trained participants performed more operative steps than residents in the conventional group.

Orzech et al. [36]
LapSim
24 surgical residents(PGY 2 or above)
(i) Virtual reality
(ii) Box trainer
(iii) Conventional training
(iv) Experienced surgeons
Laparoscopic suturing
No statistically significant differences were found between virtual reality and box trainer in time and technical proficiency. Box training is thought as a cost-effective training program, whereas virtual reality provides a time-efficient education. Simulation-trained surgeons conducted the procedure better compared to conventionally trained surgeons.

Van Sickle et al. [37]
Virtual reality and box trainer
22 surgery residents (PGY level 3, 5, or 6)
(i) Curriculum training group
(ii) Standard training group
Laparoscopic intracorporeal suturing and knot tying during a laparoscopic Nissen fundoplication
Laparoscopic suturing training group performed the suturing task statistically faster with a reduced rate of errors and fewer needle manipulations than the control group ( and , respectively).

Two RCTs evaluated the role of simulation in inguinal hernia repair. Zendejas et al. [21] concluded that simulation-based education is associated with decreased operative time and improved surgical performance compared with the control group. Furthermore, reduced frequency of intraoperative and postoperative complications as well as shorter length of hospital stay were reported. Similarly, Kurashima and colleagues [38] reported statistically improved technical skills in the simulation group.

Camera navigation was assessed in two RCTs. Nilsson et al. compared simulation training with traditional training during a laparoscopic cholecystectomy [22]. Simulation-trained novice surgeons showed improved technical skills in simulation environment where the laparoscopic tasks were conducted faster than in the control group. However, in the operative theater, statistically significant differences regarding camera navigation were not detected between the groups. In accordance with these results, Franzeck et al. found no significant difference in camera navigation skills between simulation-trained participants and novice surgeons trained in an operating theater [23].

Six studies evaluated the transferability of simulation training during a laparoscopic cholecystectomy. In a RCT by Seymour et al. [24], participants were divided into a virtual reality group and a control group. In a real operating theater, gallbladder dissection was 29% faster in the simulation group, whereas increased risk of gallbladder injury or nontarget tissue burns were reported in the control group. These findings were confirmed in a study by Grantcharov et al. [25] where the laparoscopic-trained group performed the cholecystectomy significantly faster than the control group. Furthermore, percentage of errors and economy of movements were significantly improved after virtual reality training.

Palter et al. [26] demonstrated a curriculum to improve laparoscopic skills in a simulation environment, which includes case-based learning, virtual reality, box training simulation, and participation in operations. Participants following this curriculum showed statistically enhanced surgical skills in laparoscopic cholecystectomy compared with traditional-trained surgeons. In accordance, a RCT reported a statistically superior performance in the operating theater for participants following virtual reality simulation compared to the control group [27].

In a study by Ahlberg et al. [28], participants were trained in a virtual reality simulator until reaching a proficiency level. Then, surgeons in the simulation group and control group conducted their first ten laparoscopic cholecystectomies in real environment. Similarly to other studies, the performance of the control group was associated with an increasing number of errors. The surgical time in the control group was longer in comparison with the simulation group. Furthermore, the simulation group demonstrated a homogeneous surgical performance, whereas untrained surgeons showed considerable heterogeneity in the conducted procedure.

Box trainer was utilized in a survey conducted by Bansal et al. [29]. The laparoscopic training group showed statistically better results in the operative time (), plane of dissection (), and surgical performance according to the GOALS criteria.

Simulation was utilized for laparoscopic bilateral tubal ligation in two RCTs [30, 31]. Simulation-based education was found to be superior to traditional apprenticeship training regarding the performance of the procedure in the clinical setting. In both surveys, surgical skills were statistically more exceptional in the simulation group compared with the control group.

Two other RCTs described the role of simulation in performing laparoscopic salpingectomy [32, 33]. In both studies, transferability of surgical skills in the operating room was observed, whereas operative time was shorter for simulation-trained participants compared with conventionally trained surgeons. Furthermore, the simulation-trained group reached a level of operational performance, which was equivalent to an intermediately experienced gynecologist. In a survey conducted by Ahlborg et al. [34], residents followed virtual reality simulation training. Assessment was conducted during laparoscopic tubal occlusion. Visuospatial ability, flow score, and self-efficacy were significantly higher with the simulator-training groups in comparison with the control group. Duration of surgery was significantly shorter in the training groups.

Palter and Grantcharov [35] conducted a survey to compare traditional residency training with a comprehensive curriculum consisting of simulation-based and cognitive training. The transferability of surgical skills in the operating room was assessed during a laparoscopic colectomy. The curriculum group conducted this procedure with a statistically higher technical proficiency in comparison with the conventional group. Furthermore, simulation-trained residents performed more surgical steps of the procedure than the control group.

Orzech et al. [36] confirmed the transferability of simulation suturing skills in the operating room. Both virtual reality simulation and box trainer were effective. Simulation-trained surgeons conducted the procedure better compared to conventionally trained surgeons. In the control group, participants required six attempts intraoperatively to reach an acceptable result. This translates into increased operative time, hospital costs, and intraoperative complications. A survey by Van Sickle et al. [37] has demonstrated that a structured curriculum for laparoscopic suturing and knot tying is related to improved surgical skills in an operating room. Time, errors, and needle manipulation were found to be significantly fewer for the simulation-trained participants compared with the control group.

Table 1 describes the method of simulation used in the included surveys, number of participants, groups, type of after training assessment, and results.

4. Discussion

Utilization of simulation in residency programs has been increased in the last decade. Many surveys have been conducted to evaluate the transferability of surgical skills into the operating room. Our systematic review included RCTs, in which the assessment of different simulation methods occurred in the real operating theater. This review suggests that simulation-based training improves the operating performance among novice surgeons. Included studies evaluated the results of simulation during laparoscopic cholecystectomy, inguinal hernia repair, bilateral tubal ligation or occlusion, salpingectomy, colectomy, and laparoscopic suturing. There were significant variations in assessment methods, and studies have assessed different surgical skills and parameters. Despite these variations in assessments, all studies have reported the effectiveness of simulation training in clinical practice. Trained surgeons have performed the operations faster, with increased accuracy and low percentage of intraoperative errors or postoperative complications.

None of the studies have reported poorer performance in the simulation-trained group in comparison with the conventional-trained group. Simulation was associated with significantly fewer intraoperative errors and shorter operative time [21, 24, 25, 28, 29, 32, 37]. Three studies have evaluated the role of comprehensive curriculum in surgical training, reporting statistically better performance in this group [21, 26, 35]. The curricula consisted of cognitive training, simulation training, and participation in real operations. These results make the integration of simulation training into comprehensive curricula, a major challenge in residency education.

Transferability of laparoscopic skills was evaluated in a wide range of surgical procedures, and different methods of assessment were utilized. This heterogeneity confirms the beneficial role of simulation in many surgical specializations, such as general surgery, bariatric surgery, and gynecology. Most studies used virtual reality as the simulation method when a minority of them used box trainer, and only one study used porcine cadaver. The aim of our survey was not to compare different simulation methods. A RCT found no statistically significant differences between virtual reality simulators or box trainers [39]. According to this study, both procedures are equally effective educational simulators for novice surgeons.

To the best of our knowledge, this is the first systematic review that includes only RCTs. Other conducted reviews included randomized and nonrandomized trials, whereas the after training assessment occurred in a simulation environment, in porcine models or in an operating room [40–43]. The after training assessment in a simulation environment cannot be evaluated with high accuracy and the transferability of surgical skills in a real operating theater. Including only studies in which assessment was undergone during real operations, we have limited factors that could influence our results.

Our review and results are limited by the data provided in the included studies. A weakness of this review is that studies varied in terms of sample size, type of simulator, type of simulation-based training, assessment methods, and operative procedure. Different training curricula were used, and a considerable variability between studies in the length of training was documented. The duration of simulation-based training has been different among studies, making it difficult to recommend a specific standard training period before entering the operating room. Furthermore, the majority of studies have the potential for increased type I errors, since only simple statistical analyses were used.

5. Conclusion

This systemic review evaluated the transferability of surgical skills acquired through simulation-based training into the operating room. The included studies were RCTs and showed that simulation-based training leads to superior performance in the operative setting compared to conventional training. Therefore, simulation provides a safe, effective, and ethical way for residents to acquire surgical skills before entering the operating room.

Abbreviation

RCT:
Randomized clinical trial.

Data Availability

The data used to support this study can be accessed in PubMed. The data and published articles that support the conclusions are reported in references.

Conflicts of Interest

The authors declare that they have no conflicts of interest or personal relationships that could have appeared to influence the work reported in this paper.

References

P. K. Inaparthy, M. K. Sayana, and N. Maffulli, “Evolving trauma and orthopedics training in the UK,” Journal of Surgical Education, vol. 70, no. 1, pp. 104–108, 2013.

J. Chikwe, A. C. de Souza, and J. R. Pepper, “No time to train the surgeons,” BMJ, vol. 328, no. 7437, pp. 418-419, 2004.

M. Bridges and D. L. Diamond, “The financial impact of teaching surgical residents in the operating room,” The American Journal of Surgery, vol. 177, no. 1, pp. 28–32, 1999.

J. T. James, “A new, evidence-based estimate of patient harms associated with hospital care,” Journal of Patient Safety, vol. 9, no. 3, pp. 122–128, 2013.

K. S. N. Akhtar, A. Chen, N. J. Standfield, and C. M. Gupte, “The role of simulation in developing surgical skills,” Current Reviews in Musculoskeletal Medicine, vol. 7, no. 2, pp. 155–160, 2014.

A. W. Sajid, M. S. Gordon, J. W. Mayer et al., “Symposium: A multi-institutional research study on the use of simulation for teaching and evaluating patient examination skills,” Annual Conference on Research in Medical Education, vol. 19, pp. 349–358, 1980.

B. Chan, G. Martel, E. C. Poulin, J. Mamazza, and R. P. Boushey, “Resident training in minimally invasive surgery: A survey of Canadian department and division chairs,” Surgical Endoscopy, vol. 24, no. 3, pp. 499–503, 2010.

V. N. Palter, N. Orzech, R. Aggarwal, A. Okrainec, and T. P. Grantcharov, “Resident perceptions of advanced laparoscopic skills training,” Surgical Endoscopy, vol. 24, no. 11, pp. 2830–2834, 2010.

D. J. Scott, J. C. Cendan, C. M. Pugh, R. M. Minter, G. L. Dunnington, and R. A. Kozar, “The changing face of surgical education: Simulation as the new paradigm,” Journal of Surgical Research, vol. 147, no. 2, pp. 189–193, 2008.

D. J. Scott and G. L. Dunnington, “The new ACS/APDS Skills Curriculum: Moving the learning curve out of the operating room,” Journal of Gastrointestinal Surgery, vol. 12, no. 2, pp. 213–221, 2008.

D. M. Rooney, B. F. Santos, and E. S. Hungness, “Fundamentals of laparoscopic surgery (FLS) manual skills assessment: Surgeon vs nonsurgeon raters,” Journal of Surgical Education, vol. 69, no. 5, pp. 588–592, 2012.

D. W. Overby and R. A. Watson, “Hand motion patterns of fundamentals of laparoscopic surgery certified and noncertified surgeons,” The American Journal of Surgery, vol. 207, no. 2, pp. 226–230, 2014.

J. Beullens, J. J. Rethans, J. Goedhuys, and F. Buntinx, “The use of standardized patients in research in general practice,” Family Practice, vol. 14, no. 1, pp. 58–62, 1997.

P. L. Stillman and D. Swanson, “Ensuring the clinical competence of medical school graduates through standardized patients,” Archives of Internal Medicine, vol. 147, no. 6, pp. 1049–1052, 1987.

A. Jha, B. Duncan, and D. Bates, Simulator Based Training and Patient Safety in Making Health Care Safer: A Critical Analysis of Patient Safety Practices, Agency for Healthcare Research and Quality, US Dept of Health and Human Services, Rockville, MD, USA, 2001.

D. M. Gaba, “The future vision of simulation in health care,” BMJ Quality & Safety, vol. 13, pp. 2–10, 2004.

J. R. Korndorffer, D. Scott, R. Sierra et al., “Developing and testing competency levels for laparoscopic skills training,” Archives of Surgery, vol. 140, no. 1, pp. 80–84, 2005.

D. Stefanidis and B. T. Heniford, “The formula for a successful laparoscopic skills curriculum,” Archives of Surgery, vol. 144, no. 1, pp. 77–82, 2009.

A. Liberati, D. G. Altman, J. Tetzlaff et al., “The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration,” BMJ, vol. 339, no. 1, p. b2700, 2009.

J. P. T. Higgins, Green S. Cochrane Hand for Systematic Reviews of Interventions, The Cochrane Collaboration, London, UK, 2012.

B. Zendejas, D. A. Cook, J. Bingener et al., “Simulation-based mastery learning improves patient outcomes in laparoscopic inguinal hernia repair,” Annals of Surgery, vol. 254, no. 3, pp. 502–511, 2011.

C. Nilsson, J. L. Sorensen, L. Konge et al., “Simulation-based camera navigation training in laparoscopy-a randomized trial,” Surgical Endoscopy, vol. 31, no. 5, pp. 2131–2139, 2016.

F. M. Franzeck, R. Rosenthal, M. K. Muller et al., “Prospective randomized controlled trial of simulator-based versus traditional in-surgery laparoscopic camera navigation training,” Surgical Endoscopy, vol. 26, no. 1, pp. 235–241, 2012.

N. E. Seymour, A. G. Gallagher, S. A. Roman et al., “Virtual reality training improves operating room performance,” Annals of Surgery, vol. 236, no. 4, pp. 458–464, 2002.

T. P. Grantcharov, V. B. Kristiansen, J. Bendix, L. Bardram, J. Rosenberg, and P. Funch-Jensen, “Randomized clinical trial of virtual reality simulation for laparoscopic skills training,” British Journal of Surgery, vol. 91, no. 2, pp. 146–150, 2004.

V. N. Palter, N. Orzech, R. K. Reznick, and T. P. Grantcharov, “Validation of a structured training and assessment curriculum for technical skill acquisition in minimally invasive surgery,” Annals of Surgery, vol. 257, no. 2, pp. 224–230, 2013.

V. N. Palter and T. P. Grantcharov, “Individualized deliberate practice on a virtual reality simulator improves technical performance of surgical novices in the operating room,” Annals of Surgery, vol. 259, no. 3, pp. 443–448, 2014.

G. Ahlberg, L. Enochsson, A. G. Gallagher et al., “Proficiency-based virtual reality training significantly reduces the error rate for residents during their first 10 laparoscopic cholecystectomies,” The American Journal of Surgery, vol. 193, no. 6, pp. 797–804, 2007.

V. K. Bansal, R. Raveendran, M. C. Misra et al., “A prospective randomized controlled blinded study to evaluate the effect of short-term focused training program in laparoscopy on operating room performance of surgery residents (CTRI/2012/11/003113),” Journal of Surgical Education, vol. 71, no. 1, pp. 52–60, 2014.

E. Banks, S. Chudnoff, I. Karmin et al., “Does a surgical simulator improve resident operative performance of laparoscopic tubal ligation?” American Journal of Obstetrics and Gynecology, vol. 197, pp. 541.e1–541.e5, 2007.

R. Gala, F. Orejuela, K. Gerten et al., “Effect of validated skills simulation on operating room performance in obstetrics and gynecology residents,” Obstetrics & Gynecology, vol. 121, no. 3, pp. 578–584, 2013.

C. R. Larsen, J. L. Soerensen, T. P. Grantcharov et al., “Effect of virtual reality training on laparoscopic surgery: randomised controlled trial,” BMJ, vol. 338, no. 2, p. b1802, 2009.

N. R. Patel, G. E. Makai, N. L. Sloan, and C. R. Della Badia, “Traditional versus simulation resident surgical laparoscopic salpingectomy training: A randomized controlled trial,” Journal of Minimally Invasive Gynecology, vol. 23, no. 3, pp. 372–377, 2016.

L. Ahlborg, L. Hedman, H. Nisell, L. Felländer-Tsai, and L. Enochsson, “Simulator training and non-technical factors improve laparoscopic performance among OBGYN trainees,” Acta Obstetricia et Gynecologica Scandinavica, vol. 92, no. 10, pp. 1194–1201, 2013.

V. N. Palter and T. P. Grantcharov, “Development and validation of a comprehensive curriculum to teach an advanced minimally invasive procedure,” Annals of Surgery, vol. 256, no. 1, pp. 25–32, 2012.

N. Orzech, V. N. Palter, R. K. Reznick, R. Aggarwal, and T. P. Grantcharov, “A comparison of 2 ex vivo training curricula for advanced laparoscopic skills,” Annals of Surgery, vol. 255, no. 5, pp. 833–839, 2012.

K. R. Van Sickle, E. M. Ritter, M. Baghai et al., “Prospective, randomized, double-blind trial of curriculum-based training for intracorporeal suturing and knot tying,” Journal of the American College of Surgeons, vol. 207, no. 4, pp. 560–568, 2008.

Y. Kurashima, L. S. Feldman, P. A. Kaneva et al., “Simulation-based training improves the operative performance of totally extraperitoneal (TEP) laparoscopic inguinal hernia repair: A prospective randomized controlled trial,” Surgical Endoscopy, vol. 28, no. 3, pp. 783–788, 2014.

D. L. Diesen, L. Erhunmwunsee, K. M. Bennett et al., “Effectiveness of laparoscopic computer simulator versus usage of box trainer for endoscopic surgery training of novices,” Journal of Surgical Education, vol. 68, no. 4, pp. 282–289, 2011.

B. Zendejas, R. Brydges, S. J. Hamstra, and D. A. Cook, “State of the evidence on simulation-based training for laparoscopic surgery,” Annals of Surgery, vol. 257, no. 4, pp. 586–593, 2013.

S. R. Dawe, J. A. Windsor, J. A. J. L. Broeders, P. C. Cregan, P. J. Hewett, and G. J. Maddern, “A systematic review of surgical skills transfer after simulation-based training,” Annals of Surgery, vol. 259, no. 2, pp. 236–248, 2014.

S. R. Dawe, G. N. Pena, J. A. Windsor et al., “Systematic review of skills transfer after surgical simulation-based training,” British Journal of Surgery, vol. 101, no. 9, pp. 1063–1076, 2014.

A. Vanderbilt, A. Grover, N. Pastis et al., “Randomized controlled trials: a systematic review of laparoscopic surgery and simulation-based training,” Global Journal of Health Science, vol. 7, no. 2, pp. 310–327, 2015.