ChatGPT Fails American College of Gastroenterology Medication Tests

Date:

A recent study published in the American Journal of Gastroenterology found that the natural language processing model Chat Generative Pretrained Transformer (ChatGPT) was unable to pass the American College of Gastroenterology (ACG) Self-Assessment Tests. ChatGPT-3 and ChatGPT-4 received scores of 65.1 and 62.4 percent respectively on 455 included questions across the 2022 and 2021 tests, with a 70 percent score or above required to pass the assessment.

The lead author of the study, Kelly Suchman, M.D, is from the Zucker School of Medicine at Hofstra/Northwell and the Long Island Jewish Medical Center in New Hyde Park, New York. The researchers concluded that ChatGPT is not ready to be implemented into the healthcare field and has “a ways to go before it should be implemented into the health care field.”

The American College of Gastroenterology is a professional, non-profit organization devoted to the research and & treatment of digestive system diseases. Founded in 1932, it focuses its efforts on providing its members with research, advocacy, continuing education, and global awareness of gastroenterology. The College also seeks to raise public awareness of digestive diseases & prevention through various public activities and disseminating patient education materials.

Kelly Suchman, M.D., is a board-certified gastroenterologist at the Zucker School of Medicine at Hofstra/Northwell Healthin New Hyde Park, New York. She specializes in Gastroenterology, Endoscopy and Internal Medicine. Her research focuses on the evaluation of healthcare-related technologies such as digital health, machine learning and artificial intelligence as well as common digestive diseases such as gastroesophageal reflux disease, ulcerative colitis, irritable bowel syndrome and celiac disease. In addition to her role at Hofstra/Northwell, Dr. Suchman is a fellow of the American College of Gastroenterology, a member of the American Gastroenterological Association and the American Society for Gastrointestinal Endoscopy, and a trustee on the board of the New York State Gastroenterological Association.

See also  Lawyer who used ChatGPT in court faces even more trouble

Frequently Asked Questions (FAQs) Related to the Above News

Please note that the FAQs provided on this page are based on the news article published. While we strive to provide accurate and up-to-date information, it is always recommended to consult relevant authorities or professionals before making any decisions or taking action based on the FAQs or the news article.

Share post:

Subscribe

Popular

More like this
Related

Chongqing Brands Go Global: Insights from 2024 Land-Sea Economic Forum

Discover the insights from the 2024 Land-Sea Economic Forum as Chongqing brands make a global impact. Learn more here.

Microsoft Build 2024 Unveils Future of AI: What to Expect – Day 1 Highlights & Keynotes

Discover the future of AI at Microsoft Build 2024 - Day 1 highlights, keynotes, and exciting updates await! Tune in online.

Elon Musk Praises Apple Headphones, Sparks Talk of Tesla Headphones

Elon Musk's praise for Apple headphones sparks talk of potential Tesla collaboration, driving curiosity in the tech community.

Breakthrough Study Finds Machine Learning Can Efficiently Diagnose Glioma Mutations

Discover how machine learning can efficiently diagnose glioma mutations, paving the way for personalized treatment options. Reduce uncertainty with AI.