A new study, published online March 21 in Clinical and Molecular Hepatology, looks at the accuracy and reliability of ChatGPT in answering questions related to cirrhosis and hepatocellular carcinoma (HCC). Researchers from Cedars-Sinai Medical Center in Los Angeles performed an analysis on the ChatGPT responses to 164 questions, which were independently graded by two transplant hepatologists.
The results revealed that ChatGPT provided extensive and accurate knowledge about cirrhosis (79.1%) and HCC (74%). However, responses that were deemed comprehensive were only around 47.3% for cirrhosis and 41.1% for HCC. Additionally, in terms of quality measurement questions, ChatGPT answered 76.9% of them correctly, but was not able to give accurate response with regard to cut-offs and durations for treatment. Additionally, the technology did not have knowledge of regional guideline variations like HCC screening criteria.
Yee Hui Yeo, M.D., a co-author of the study, commented on the findings: “Patients with cirrhosis and/or liver cancer and their caregivers often have unmet needs and insufficient knowledge about managing and preventing complications of their disease. We found ChatGPT—while it had its limitations—could help empower patients, improving their health literacy.”
ChatGPT is developed by Drugs.com MedNews, which specializes in providing accurate and accessible information about medications, diseases, and treatments. The company also offers helpful tips and advice for taking charge of one’s own healthcare and staying informed. In an era of fast-paced technology and information, Drugs.com MedNews strives to make reliable medical information conveniently available to people across the world, ensuring that patients take informed decisions with the help of medical professionals.
