A number of artificial intelligence-generated health summaries have been deleted by Google after an international investigation found these could potentially harm readers because of misleading medical information.
The Mercury reports that the AI-powered feature – Google AI Overviews – is positioned at the top of search results with digestible “snapshots” of key information when people ask questions, including about health and medical issues.
But an investigation by The Guardian found that in several instances, the summaries were inaccurate and could be dangerous, giving users false reassurance about serious health matters.
In one example, the AI provided incorrect “normal ranges” for liver blood tests without accounting for crucial factors like age, sex, ethnicity, or nationality. This is especially worth noting because these variables may affect clinical interpretations, including for South African patients who often come from diverse genetic and environmental backgrounds.
Experts described the situation as “dangerous” and “alarming”, with concerns that such AI summaries could be misleading.
Google confirmed it has removed AI Overviews for specific queries such as “what is the normal range for liver blood tests” and “what is the normal range for liver function tests”, adding that it routinely makes improvements to its systems where context is missing.
International health communication experts say that while improved access to information online is valuable, AI systems must clearly signpost evidence-based and reputable health sources rather than present summaries that could be mistaken for professional medical advice.
Despite the specific removals, AI Overviews continue to appear for other health-related searches, including conditions like cancer and mental health.
It has been recommended that South Africans cross-reference AI answers with trusted local health authorities, like the National Department of Health, Health Professions Council of South Africa, and reputable hospital networks, before acting on medical information found online.
See more from MedicalBrief archives:
Potential of medical liability pitfalls with increasing AI use
The challenges of rapidly evolving AI in healthcare
AI algorithms in diagnosis could harm patients – Dutch study