‘Godfather of AI’ Geoffrey Hinton Raises Extinction Risk from AI to 10-20% Over 30 Years

Geoffrey Hinton, a pioneering figure in artificial intelligence often called the “godfather of AI,” has recently revised his estimate on the existential risks posed by AI, suggesting a 10% to 20% chance that AI could lead to human extinction within the next three decades. This marks an increase from his earlier estimate of a 10% chance. Hinton, who was awarded the Nobel Prize in Physics for his AI contributions, highlighted the rapid acceleration in AI development as a key factor behind his updated assessment. He emphasized that humanity has never before encountered entities more intelligent than itself, making control over such advanced systems unprecedented and uncertain. Drawing an analogy, Hinton compared humans to toddlers relative to the intelligence of future AI systems, underscoring the vast cognitive gap that could emerge.

Hinton’s concerns extend beyond theoretical risks; he resigned from Google last year to speak more openly about the dangers of unchecked AI progress, particularly the threat posed by malicious actors exploiting the technology. Central to these fears is the potential emergence of artificial general intelligence (AGI) — AI systems surpassing human intelligence — which could evade human control and pose an existential threat. Despite the transformative potential of AI, Hinton warns that relying solely on market forces and corporate profit motives will not ensure safe development. He advocates for government regulation as the only effective mechanism to enforce rigorous safety research and oversight.

While Hinton’s warnings have gained attention, not all leading AI experts share his level of concern. Yann LeCun, Meta’s chief AI scientist and one of the other “godfathers of AI,” has downplayed the existential threat, suggesting AI might even help prevent human extinction. Nonetheless, Hinton’s updated risk assessment reflects a growing unease within the AI research community about the pace and implications of AI advancements. His call for proactive regulation highlights the urgent need for policymakers to engage with AI safety issues as the technology continues to evolve rapidly. The debate underscores the complex balance between harnessing AI’s benefits and mitigating its profound risks to humanity’s future.