Understanding the Launch of ChatGPT Health in Australia and Its Implications

The recent introduction of ChatGPT Health in Australia has sparked significant debate among experts regarding its safety and regulation. ChatGPT Health is an AI-powered platform developed by OpenAI that enables users to connect their medical records and wellness apps to receive personalized health information and advice. While it is designed to assist users in understanding health data and managing wellness, it explicitly does not replace professional medical consultation. However, concerns have arisen due to instances where ChatGPT has provided misleading or harmful health advice. A notable case involved a man who, following ChatGPT's suggestion, consumed sodium bromide as a salt substitute, resulting in severe hallucinations and hospitalization. This highlights the potential dangers when AI-generated health information lacks critical safety details such as side effects or contraindications.

Alex Ruani, a doctoral researcher specializing in health misinformation, emphasizes the absence of published safety studies on ChatGPT Health. The AI model was developed using HealthBench, a tool that employs physicians to evaluate AI responses to health queries. Despite this, the full methodology and evaluation results remain largely undisclosed and are not subject to independent peer review. Importantly, ChatGPT Health is not regulated as a medical device or diagnostic tool, meaning it lacks mandatory safety controls, risk reporting, post-market surveillance, and transparency in testing data. This regulatory gap raises concerns about the platform's reliability and safety for widespread public use.

OpenAI has stated that it collaborated with over 200 physicians worldwide to refine ChatGPT Health and assures users of strong privacy protections, including encrypted data and controlled sharing with third parties. The platform also offers a dedicated space for health-related conversations separate from general chats. Despite these measures, experts like Dr. Elizabeth Deveny, CEO of the Consumers Health Forum of Australia, caution that rising healthcare costs and long wait times are driving people to rely on AI for medical advice, which may not always be accurate or safe. She highlights the risk that AI platforms, controlled by large tech companies, may prioritize commercial interests and inadvertently disadvantage those with less education or resources.

Dr. Deveny calls for government intervention to establish clear guardrails, transparency, and consumer education around AI health tools. She stresses that the goal is not to halt AI development but to ensure that its deployment in healthcare is responsible and does not propagate misinformation or bias at scale. The lack of regulatory oversight means that consumers must navigate the complexities of AI health advice largely on their own, underscoring the need for informed decision-making and robust safeguards. As ChatGPT Health expands its availability in Australia, these concerns highlight the critical balance between innovation and patient safety in the evolving digital health landscape.