THE PEOPLE BUILDING THE WORLD’S MOST POWERFUL AI ARE ASKING US TO SLOW DOWN
When the engineers building the accelerator start asking for brakes, perhaps we should understand what they have seen.
For years, warnings about artificial intelligence followed a predictable pattern.
Researchers warned.
Philosophers speculated.
Politicians promised regulation.
Technology companies told us that innovation would solve the problems created by innovation.
Investors kept writing checks.
And the models kept getting better.
Now something has changed.
The warning is increasingly coming from inside the laboratories themselves.
Dario Amodei, co-founder and CEO of Anthropic — one of the companies operating at the frontier of artificial intelligence — has made an unusually direct appeal:
the industry should slow the rate at which it increases the capabilities of its most powerful AI models.
Not stop AI.
Not abandon it.
Not destroy the data centres.
Slow the frontier.
His argument is uncomfortable precisely because Anthropic is not an anti-technology organisation.
It is one of the organisations building the technology.
Amodei believes AI could accelerate scientific discovery, dramatically increase economic growth and potentially help cure major diseases.
Yet he now argues that capability development is moving sufficiently quickly that safety, security and governance need time to catch up.
And this week something even more remarkable happened.
Sam Altman of OpenAI and Elon Musk also backed the broad idea that the frontier may need to be paced. Reuters reports that Amodei’s proposal has received support from major competitors, even as the precise mechanism remains unresolved.
Think about how unusual this is.
The people competing to build the most powerful technology on Earth are beginning to tell us that the competition itself may be becoming dangerous.
That deserves considerably more attention than another debate about whether AI will eliminate junior accountants.