AI leaders want to hit the brakes after years of reckless speed
Mirrored from Ars Technica — AI for archival readability. Support the source by reading on the original site.
For years now, the major frontier AI labs have all been acting as if they're in an all-out, winner-take-all race with control of world-changing machine superintelligence (or at least market-changing artificial general intelligence) at the finish line. This weekend, the industry as a whole rapidly started turning away from that posture, urging coordination on slowing down the development of frontier AI that they say could soon be too dangerous and unknowable to control.
Anthropic's Dario Amodei was at the forefront of this change in tone, arguing in a nearly 4,000 word essay this weekend that "we must slow the pace at which we improve the capabilities of AI models" to avoid "a race to the bottom, spurred by commercial incentives, [that] can make [catastrophic] risks more acute."
Within hours, other AI leaders were echoing the same call. OpenAI co-founder and CEO Sam Altman posted his agreement on social media and said similar pacing discussions had been taking place at OpenAI. Alphabet Chief Scientist and Google DeepMind Co-Founder and Chair Demis Hassabis said that Amodei's essay "points towards the right path forward," and renewed his own recent call for an industry-wide standards body. Microsoft CEO Satya Nadella posted that the company "welcome[s] the research, focus, and deliberate pacing needed to get alignment right as the design goal," ahead of the release of a lengthy "humanist AI" code of conduct for its models.
More from Ars Technica — AI
-
Microsoft goes quiet after church groups ask for 1% of data center costs
Sep 28
-
Court rules Trump can blacklist Anthropic for refusing to enable Claude features
Sep 25
-
Tesla workers balk at training Optimus humanoid robots as replacements
Sep 25
-
AI was supposed to hit new grads hard. So far, unemployment data says otherwise.
Sep 25
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.