A recent study published in the American Journal of Gastroenterology found that the natural language processing model Chat Generative Pretrained Transformer (ChatGPT) was unable to pass the American College of Gastroenterology (ACG) Self-Assessment Tests. ChatGPT-3 and ChatGPT-4 received scores of 65.1 and 62.4 percent respectively on 455 included questions across the 2022 and 2021 tests, with a 70 percent score or above required to pass the assessment.
The lead author of the study, Kelly Suchman, M.D, is from the Zucker School of Medicine at Hofstra/Northwell and the Long Island Jewish Medical Center in New Hyde Park, New York. The researchers concluded that ChatGPT is not ready to be implemented into the healthcare field and has “a ways to go before it should be implemented into the health care field.”
The American College of Gastroenterology is a professional, non-profit organization devoted to the research and & treatment of digestive system diseases. Founded in 1932, it focuses its efforts on providing its members with research, advocacy, continuing education, and global awareness of gastroenterology. The College also seeks to raise public awareness of digestive diseases & prevention through various public activities and disseminating patient education materials.
Kelly Suchman, M.D., is a board-certified gastroenterologist at the Zucker School of Medicine at Hofstra/Northwell Healthin New Hyde Park, New York. She specializes in Gastroenterology, Endoscopy and Internal Medicine. Her research focuses on the evaluation of healthcare-related technologies such as digital health, machine learning and artificial intelligence as well as common digestive diseases such as gastroesophageal reflux disease, ulcerative colitis, irritable bowel syndrome and celiac disease. In addition to her role at Hofstra/Northwell, Dr. Suchman is a fellow of the American College of Gastroenterology, a member of the American Gastroenterological Association and the American Society for Gastrointestinal Endoscopy, and a trustee on the board of the New York State Gastroenterological Association.
