Capital Health Regional Medical Center Trenton, NJ
Anastasiia Polianovskaia, MD1, Douglas Weinstein, MD2 1Capital Health Regional Medical Center, Trenton, NJ; 2Hackensack Meridian Medical GroupJersey Shore University Medical Center, Neptune, NJ Introduction: Gastroparesis is a chronic gastrointestinal motility disorder characterized by delayed gastric emptying in the absence of mechanical obstruction. As patients increasingly rely on generative artificial intelligence (AI) tools for health information, it is essential to evaluate the accuracy of such platforms. ChatGPT, a publicly accessible text-generating AI (TGAI), is among the most widely used models for patient-centered inquiries. This study assessed the reliability and consistency of ChatGPT’s responses to commonly asked questions about gastroparesis. Methods: Fifty frequently asked patient questions were developed by internal medicine physicians based on clinical experience and literature review. Each question was submitted to ChatGPT (GPT-4, OpenAI, April 2025 version) in three independent sessions. Ten evaluators—seven internal medicine residents and three faculty physicians—reviewed the responses and rated them as Appropriate (accurate and complete), Inappropriate (partially accurate or incomplete), or Unreliable (factually incorrect or misleading). Discrepancies were resolved through group consensus. Results: Among a total of 150 responses (50 questions submitted in three separate ChatGPT sessions), 138 (92%) were rated as Appropriate, 9 (6%) as Inappropriate, and 3 (2%) as Unreliable. ChatGPT demonstrated high accuracy in addressing topics related to disease pathophysiology, diagnostic strategies, and pharmacologic management. The most frequent limitations were seen in responses involving dietary guidance and psychosocial considerations, which often lacked individualization or depth. Discussion: ChatGPT delivered a high proportion of clinically accurate responses to common patient questions about gastroparesis, highlighting its potential as a supplementary tool for patient education. However, occasional inaccuracies—particularly in nuanced or individualized topics—underscore the necessity of physician oversight. These findings support the cautious integration of AI technologies into clinical communication, with emphasis on clinician validation to ensure information is guideline-concordant, safe, and tailored to each patient's needs.
Disclosures: Anastasiia Polianovskaia indicated no relevant financial relationships. Douglas Weinstein indicated no relevant financial relationships.
Anastasiia Polianovskaia, MD1, Douglas Weinstein, MD2. P0806 - Artificial Intelligence in GI Education: ChatGPT’s Role in Gastroparesis Awareness, ACG 2025 Annual Scientific Meeting Abstracts. Phoenix, AZ: American College of Gastroenterology.
