University of California Irvine Irvine, California
Frances Dang, MD, MSc1, Anoushka Dua, MD2, David Cheung, MD3, Amirali Tavangar, MD2, Jay Doshi, BS3, Shannen Guarina, BS3, Peter Nguyen, MD3, Robert Fearn, MD4, Nikko Gimpaya, MEd5, William Tran, MSc5, Samir Grover, MD5, Jason Samarasena, MD, MBA, FACG3 1University of California Irvine, Irvine, CA; 2University of California Irvine Digestive Health Institute, Orange, CA; 3University of California Irvine, Orange, CA; 4University of California Irvine Health, Orange, CA; 5Scarborough Health Network, Scarborough, ON, Canada Introduction: Simulation-based training and assessment has the potential to reduce risks to patient safety and discomfort. Previous studies demonstrated construct validity in both virtual and physical colonoscopy simulators by being able to distinguish between subjects based on their level of endoscopic experience. We aim to assess the internal structure validity of a novel colonoscopy simulator in being able to differentiate expertise levels and to assess how well the simulator’s tasks measure different aspects of colonoscopy skills.
Methods: This is a multi-center study involving 1 US tertiary academic hospital and 1 Canadian community teaching hospital. Novices (< 50 colonoscopies), intermediates (50-500 colonoscopies), and experts ( >500 colonoscopies or attending physicians) were recruited. Participants completed one easy and one advanced level on the colonoscopy simulator model. Metrics recorded on the simulator include elongation of sigmoid colon, compression of colon, reaching sigmoid junction, reaching appendix, and time to completion. Video recordings of participants were de-identified and rated by expert endoscopists using a modified version of the Joint Advisory Group Direct Observation of Procedural Skills (JAG DOPS) criteria. The primary outcome was comparison of colonoscopy simulator-generated metrics and modified JAGDOPS scores between participant groups.
Results: 11 novices, 9 intermediates and 11 experts were recruited for the study. Procedure times and metrics of the colonoscopy simulator between all groups are shown in Table 1. There was a statistically significant difference in all colonoscopy simulator metrics between intermediates and experts when compared to novices (p< 0.001) (Figure 1). Expert and intermediates had significantly higher mean modified JAGDOPS scores compared to novices (p< 0.001) at both easy and advanced level (Table 1). Mean insertion time was significantly lower and withdrawal time was longer in intermediate and expert groups compared to novices (p< 0.001).
Discussion: This next generation colonoscopy simulator model has construct validity in that it distinguishes the performance level of novices from intermediates and experts. This may suggest a benefit to implementing simulation-based education in the early stages of gastroenterology training. Moreover, simulation-based training with this colonoscopy model prior to initiating real-world practice has the potential to improve patient safety and training outcomes.
Figure: Figure 1: Colonoscopy simulator metrics of (A) Easy and (B) Advanced level. (*) indicates p<0.001 when compared to novices using the Tukey post-hoc test for one-way ANOVA
Figure: Table 1: Descriptive statistics and mean JAGDOPS scores of novice, intermediates and experts at easy and advanced level. (*) indicates p<0.001 when compared to novices using Tukey post-hoc test for one-way ANOVA.
Disclosures: Frances Dang: Cook Medical – Speaker. Anoushka Dua indicated no relevant financial relationships. David Cheung indicated no relevant financial relationships. Amirali Tavangar indicated no relevant financial relationships. Jay Doshi indicated no relevant financial relationships. Shannen Guarina indicated no relevant financial relationships. Peter Nguyen indicated no relevant financial relationships. Robert Fearn indicated no relevant financial relationships. Nikko Gimpaya indicated no relevant financial relationships. William Tran indicated no relevant financial relationships. Samir Grover: Abbvie – Education and personal payments. BioJAMP – Education payments. Fresenius Kabi – Education payments. Sanofi – Personal payments. Volo Healthcare – Owner/Ownership Interest. Jason Samarasena: Applied Medical – Consultant. Boston Scientific – Consultant. Cook Medical – Consultant. Neptune Medical – Consultant. Olympus – Consultant.
Frances Dang, MD, MSc1, Anoushka Dua, MD2, David Cheung, MD3, Amirali Tavangar, MD2, Jay Doshi, BS3, Shannen Guarina, BS3, Peter Nguyen, MD3, Robert Fearn, MD4, Nikko Gimpaya, MEd5, William Tran, MSc5, Samir Grover, MD5, Jason Samarasena, MD, MBA, FACG3. P0863 - Validation of a Novel Colonoscopy Simulator for Distinguishing Novice, Intermediate, and Expert Endoscopists, ACG 2025 Annual Scientific Meeting Abstracts. Phoenix, AZ: American College of Gastroenterology.
