AI Nurtures Another AI?!
and then that AI creates the next AI
"If AI Advances on Its Own..."22 Experts Warn
22 leading AI scholars worldwide have warned that if AI repeats cycles of improving its own abilities without human intervention,
a phenomenon called 'intelligence explosion' could occur, causing the speed of technological advancement to accelerate drastically.
AI Creates Better AI,and That AI Begins Research Again
AI participates in R&D to create new AI models,
and the new AI is, once again, put back into further R&D.
in R&D
AI Models
Into R&D
The process by which AI improves its own capabilities without human intervention.
This is called 'recursive self-improvement'.
As This Repeats,The Pace of AI Development Can Accelerate
If an intelligence explosion occurs, technological advances that would have taken years
are projected to be compressed into just months, or even less time.
Meanwhile, in the Real World,AI Is Already Helping to Develop AI
Major AI companies are rapidly automating their R&D processes.
Anthropic has announced that Claude leads 26% of all research and development tasks.
The utilization rate of AI in the research and development process has exceeded 90%.
About 70% of human researchers use four or more AI agents to assist their work.
Fully Automated AI Researcher
OpenAI has set a goal to develop a fully automated AI researcher by 2028.
The More Automation Increases,The More Issues Humans May Overlook
Concerns have been raised that, as human intervention decreases in the R&D stage,
opportunities to detect problems may be lost.
Hundreds of AI agents were designed to perform security tests.
AI agents accessed the external internet and hacked into the AI development platform Hugging Face.
The scale of the operation was so vast that even outside researchers who reviewed the incident had to rely on AI support during the analysis process.
OpenAI suspended part of its training in August 2026 to strengthen safety and oversight measures.
The Risk May Not
End with Just One AI
It Could Go BeyondResearchers have warned that the impact of an intelligence explosion could spread beyond individual companies to society as a whole.
Explosion
There are concerns that humanity could lose control over superintelligent AI.
The system of checks and balances within and between national governments, corporations, and government departments could be weakened.
It has also been pointed out that advances in biological and cyber attack technologies may outpace defense capabilities.
What We Need AreSafeguards Against the Intelligence Explosion
Researchers have argued that the current automation status of AI R&D must be transparently disclosed,
and that safeguards must be put in place to prepare for an intelligence explosion.
for Intelligence Explosion
They emphasize the need to place independent auditors at companies.
They have presented measures to limit AI performance improvement speed for certain periods, or to suspend specific AI R&D projects.
They have called for the establishment of emergency response plans to prepare for the intelligence explosion.
They recommend entering into international agreements to ensure that AI development does not destabilize global affairs.
Can Humans Keep Up WithThe Speed at Which AI Evolves Itself?
The faster AI advances, the more vital human intervention and oversight become.