As millions increasingly turn to artificial intelligence for information and guidance, tech companies are rolling out specialized chatbots designed to address health-related questions. These programs, including OpenAI’s ChatGPT Health – currently available via a waiting list – and similar features within Anthropic’s Claude chatbot, promise to analyze personal health data from medical records, wellness apps, and wearable devices. However, experts caution that while these tools offer potential benefits, they are not substitutes for professional medical care and require a cautious approach.
The emergence of AI health chatbots represents a significant shift in how individuals access and interpret health information. Instead of sifting through general search results, users can potentially receive personalized insights based on their own data. But this convenience comes with caveats. These large language models, while sophisticated, are still under development and prone to inaccuracies. Understanding the limitations and potential risks is crucial before entrusting them with your health inquiries.
One key advantage of these newer chatbots is their ability to contextualize responses with a user’s medical history, including prescriptions, age, and doctor’s notes. Even without providing access to medical records, experts like Dr. Robert Wachter, a medical technology expert at University of California, San Francisco, recommend providing as much detail as possible to improve the accuracy of the chatbot’s responses. “The alternative often is nothing, or the patient winging it,” Wachter stated, suggesting that responsible use of these tools can provide useful information.
When to Skip the Chatbot and Seek Immediate Care
Despite the potential benefits, healthcare professionals emphasize that AI chatbots are not appropriate for all situations. Symptoms like shortness of breath, chest pain, or a severe headache require immediate medical attention and should not be assessed by an AI. Even in less urgent cases, a degree of healthy skepticism is advised. Dr. Lloyd Minor of Stanford University, the dean of Stanford’s medical school, cautions, “If you’re talking about a major medical decision, or even a smaller decision about your health, you should never be relying just on what you’re getting out of a large language model.”
Privacy Concerns and Data Security
Sharing personal health information with AI chatbots raises significant privacy concerns. Unlike traditional healthcare providers, AI companies are not currently bound by the Health Insurance Portability and Accountability Act (HIPAA), the federal law that protects sensitive medical information. This means that data shared with these companies may not have the same level of protection as information shared with a doctor or hospital. Both OpenAI and Anthropic state that user health information is kept separate from other data and is subject to additional privacy protections, and that they do not use health data to train their models, requiring users to opt-in and allowing them to disconnect at any time. However, consumers should be aware of these differing privacy standards.
The Current State of AI Chatbot Accuracy
Independent testing of AI chatbots in healthcare is still in its early stages. A 2024 study by Oxford University, involving 1,300 participants, found that individuals using AI chatbots to research hypothetical health conditions did not make better decisions than those using traditional online searches or relying on their own judgment. The study, led by Adam Mahdi of the Oxford Internet Institute, revealed that while chatbots could accurately identify underlying conditions in comprehensive, written scenarios 95% of the time, communication issues arose during interactions with real participants. People often failed to provide sufficient information, and the AI systems sometimes presented a mix of accurate and inaccurate information, making it tricky for users to discern the truth.
However, Dr. Wachter suggests that the ability of chatbots to inquire follow-up questions and gather more detailed information could significantly improve their performance. He likewise recommends consulting multiple chatbots to gain a more comprehensive perspective, similar to seeking a second opinion from another doctor. “I will sometimes put information into ChatGPT and information into Gemini,” Wachter said, “And when they both agree, I feel a little bit more secure that that’s the right answer.”
As AI technology continues to evolve, its role in healthcare is likely to expand. Ongoing research and development, coupled with a focus on data privacy and accuracy, will be crucial to ensuring that these tools are used responsibly and effectively to improve patient care. The future of AI in healthcare hinges on a balanced approach that leverages its potential while mitigating its risks.
Disclaimer: The information provided in this article is intended for general knowledge and informational purposes only, and does not constitute medical advice. It’s essential to consult with a qualified healthcare professional for any health concerns or before making any decisions related to your health or treatment.
What are your thoughts on the use of AI chatbots in healthcare? Share your opinions and experiences in the comments below.
