ChatGPT, an artificial intelligence chatbot, was recently put to the test when researchers administered the American College of Gastroenterology Self-Assessment Test. The exam proved to be a challenge for ChatGPT and its GPT-3 version, scoring a 65.1 percent, while the GPT-4 update yielded a lower result of 62.4 percent. The threshold to pass is 70 percent or higher for this particular exam. As a result, the study’s authors suggested against using ChatGPT as a form of GI education in its current form.
Northwell Health, based in New Hyde Park, N.Y., and Arkansas Gastroenterology in North Little Rock, both contributed to the study, demonstrating their commitment to advancing artificial intelligence technology.
One of the study’s key participants was Qiang Chen, MD, a professor of medicine at Northwell Health’s Zucker School of Medicine and director of Northwell Health’s Division of Gastroenterology and Hepatology. Chen has achieved numerous awards for his research and dedication to the medical field. With the help of Chen and other researchers, ChatGPT is sure to make progress to potentially become a viable form of GI education in the future.
