India Pharma Outlook Team | Thursday, 16 April 2026
A new study has raised concerns about how reliable AI chatbots are when it comes to providing medical information. The research found that many of their responses can be inaccurate medical advice or incomplete, which could mislead users seeking health guidance.
The study, published in BMJ Open, examined five popular artificial intelligence tools developed by major technology companies. Researchers tested how well these tools could answer common health-related queries on topics like cancer, vaccines, and nutrition. In total, around 250 responses were analysed.
The results showed that nearly half of the answers had some form of issue. About 30% of responses were found to be partly inaccurate or lacking important details, while close to 20% were considered seriously misleading. These findings highlight the risks of relying on AI in healthcare without proper verification.
Experts say the problem becomes more serious as more people begin to depend on chatbots instead of consulting doctors. While these tools are easy to access and quick to respond, they often lack the depth needed for accurate digital health advice. In some cases, they may not fully understand the context or may provide general answers that are not suitable for everyone.
Also Read: India Chairs BRICS Health Meet, Pushes Preventive Care Agenda
Another concern is that chatbots often present information very confidently, even when it is incorrect or not supported by evidence. This makes it difficult for users to judge health information accuracy. Researchers also noted that some systems mix correct and incorrect details, increasing the risk of medical misinformation.
As generative AI in healthcare continues to grow, it is being used for sharing information, engaging patients, and offering basic guidance. However, experts stress that it should not replace professional consultation.
The study calls for stronger AI regulation in healthcare, better system training, and greater public awareness of chatbot limitations. While chatbots can support general understanding, doctors remain the most reliable source for patient safety and care.