ChatGPT, a chat generative pretrained transformer, has undergone a recent study to evaluate its potential in providing nutritional guidance. Published in the journal Nutrients, the study aimed to determine ChatGPT’s effectiveness compared to international guidelines for non-communicable diseases (NCDs). While the chatbot showed promise in offering accurate advice, experts remain irreplaceable in complex cases.
NCDs have become a leading cause of global mortality, with diseases like type 2 diabetes (T2D), non-alcoholic fatty liver disease (NAFLD), and hypertension on the rise. Lifestyle and dietary factors have been consistently linked to the onset and progression of such diseases. As people increasingly turn to the internet for health information, ChatGPT has emerged as an accessible and efficient resource for medical advice seekers.
In the study, researchers used the default ChatGPT model to compare its nutritional advice with recommendations from international guidelines. The team focused on medical conditions like arterial hypertension, T2D, dyslipidemia, obesity, NAFLD, sarcopenia, and chronic kidney disease (CKD) that require specific dietary treatments. ChatGPT’s responses were evaluated by two dieticians who independently categorized them as appropriate, inappropriate, unsupported, not fully matched, or general advice.
Overall, ChatGPT provided accurate advice with appropriateness rates ranging from 55.5% for sarcopenia to 73.3% for NAFLD. However, there were instances where ChatGPT’s responses contradicted or were not fully in line with the guidelines. For example, the chatbot suggested regular meals and snacks for stabilizing blood sugar levels in obesity, whereas the guidelines emphasize avoiding snacks between meals. Additionally, ChatGPT recommended supplements like antioxidants and omega-3 fatty acids for NAFLD, which are not endorsed by existing guidelines.
In cases involving multiple coexisting conditions, ChatGPT’s guidance was inadequate. For a patient with obesity, CKD, and T2D, some of ChatGPT’s suggestions were inappropriate or conflicting, highlighting the limitations of the chatbot in complex scenarios. While ChatGPT can be a useful tool for dietary advice regarding NCDs, it cannot replace the expertise of human experts.
The findings of this study emphasize the agreement and divergences between ChatGPT’s responses and dietary guidelines. The chatbot provided practical examples of foods to include or exclude from the diet, but some recommendations were incomplete or not fully aligned with the guidelines. Overall, ChatGPT showed potential utility but fell short in handling more complex cases.
In conclusion, while ChatGPT’s nutritional guidance for NCDs is generally accurate, it is crucial to recognize the limitations of relying solely on a chatbot. Experts in the field remain essential for managing complex cases and ensuring the best outcomes for patients. ChatGPT can serve as a helpful resource but should not replace the advice and guidance provided by human professionals.
Reference:
Ponzo V, Goitre I, Favaro E, et al. Is ChatGPT an Effective Tool for Providing Dietary Advice? Nutrients, 2024, DOI: 10.3390/nu16040469.
