AI Language Models Surpass Doctors in Responding to Health Queries, Study Finds
New research published in JAMA Internal Medicine has revealed that language models such as OpenAI’s ChatGPT outperform human physicians in answering health-related questions. While it doesn’t mean AI assistants will replace doctors, integrating them into healthcare systems has the potential to revolutionize medicine.
The study involved randomly selecting 195 exchanges from the subreddit r/AskDocs, where verified physicians responded to public health inquiries. The original question was provided to ChatGPT, which was then asked to generate a response. A panel of three licensed healthcare professionals assessed each question and response, unaware of whether it came from a physician or ChatGPT.
The results were remarkable: the panel preferred ChatGPT’s responses to physician responses a staggering 79% of the time. ChatGPT’s answers were also rated significantly higher in quality and were considered more empathetic. The study found that ChatGPT’s responses were 3.6 times more likely to be rated as good or very good quality compared to physician responses. Additionally, responses deemed empathetic or very empathetic were 9.8 times higher for ChatGPT.
Dr. Eric Ayers, one of the study’s authors, expressed optimism about the potential of AI in healthcare, stating, The opportunities for improving healthcare with AI are massive. AI-augmented care is the future of medicine. By integrating AI assistants like ChatGPT into healthcare systems, doctors can receive faster and more accurate responses, while patients benefit from more personalized and empathetic care.
Recognizing the promising implications of AI in reducing the burden on physicians, venture capital has been heavily investing in this field. OpenAI recently secured a $10 billion deal with Microsoft Corp., and several other companies focused on artificial intelligence have attracted significant funding. Retail investors are also getting involved, with platforms like Bioverge allowing anyone to invest in healthcare technology-based venture funds.
While the study demonstrates the potential of AI assistants, its aim is not to replace doctors entirely. Dr. Adam Poliak, co-author of the study, emphasized that physicians are still needed to make clinical decisions and manage patient care. However, AI assistants like ChatGPT can offer support and enhance the quality of care patients receive.
The transformative power of AI assistants extends beyond just replacing doctors; they have the capability to work alongside physicians, optimizing patient care. Dr. Aaron Goodman, another co-author of the study, referred to ChatGPT as a valuable tool, stating, ChatGPT is a prescription I’d like to give to my inbox. The tool will transform the way I support my patients.
The study emphasizes the potential benefits of incorporating AI assistants into the healthcare landscape, particularly in terms of providing faster, more accurate responses and managing the workload of physicians. While maintaining the importance of clinical decision-making by doctors, the integration of AI can significantly enhance patient care.
In an era where technology continues to advance rapidly, AI assistants like ChatGPT offer an avenue for improving the healthcare experience. By striking a balance between human expertise and AI support, the future of medicine holds exciting prospects for better patient care and outcomes.
