Anthropic, the U.S. artificial intelligence company behind the Claude chatbot, has called for a global pause in the development of advanced AI systems, citing risks of losing human control over self-optimizing technologies. The proposal, outlined in a blog post, demands coordinated action from major AI firms worldwide to slow progress while societies adapt. However, the company’s simultaneous plans to go public and its own reliance on AI-generated code highlight tensions in the debate.
The Global Pause Proposal
Anthropic’s call for a moratorium centers on the accelerating ability of AI systems to self-optimize. The company reported that 80% of the code it integrates into its systems now comes from its own AI model, Claude, a sharp increase from single-digit percentages in early 2025. “We believe it would be good for the world to have the option to slow or temporarily halt the development of frontier AI,” the company wrote, emphasizing the need for “societal structures” to keep pace with technological advances.
The proposal requires “globally verifiable rules” to ensure all major AI firms participate. Without such coordination, Anthropic warned, “less prudent actors could use the moratorium to catch up technologically.” This aligns with earlier warnings from researchers about “recursive self-optimization,” where AI systems could one day design their own successors without human oversight. “Once the quality of AI-generated code matches human output, humans may no longer write code at all,” the company noted, predicting a future where human review becomes a bottleneck.
Market Reactions and Contradictions
Anthropic’s warning came as KI-Aktien (AI-related stocks) faced a correction. Broadcom’s earnings, which failed to meet investor expectations, triggered a sell-off in tech stocks, with NVIDIA and Micron Technology dropping 6.2% and 12.8%, respectively. German semiconductor giant Infineon fell 9.1%, while SK hynix in South Korea lost over 7% of its value. “Investor enthusiasm for AI stocks is waning after Broadcom’s results failed to boost forecasts,” said Anna Macdonald of Hargreaves Lansdown, citing a broader cooling in the sector.
For more on this story, see Pope Leon XIV Warns AI Threatens Human Dignity, Calls for Global Ethical Oversight.
Anthropic’s own stock market ambitions complicate its message. The company, valued at nearly $1 trillion in a recent funding round, filed a confidential registration with the U.S. SEC for its initial public offering (IPO). This move has drawn scrutiny, with critics questioning how a firm advocating for a pause in AI development can simultaneously seek to capitalize on its growth. “It’s a paradox,” one analyst noted. “They’re asking the world to slow down while they race to the stock market.”
Historical Context and Precedents
Anthropic’s call for a moratorium echoes past warnings from the AI community. In 2023, over 1,000 researchers and industry leaders signed an open letter urging a six-month pause in advanced AI development, a plea that went largely unheeded. Elon Musk, who co-founded X.AI (now part of SpaceX), was among the signatories. However, Musk’s own ventures continue to push AI boundaries, illustrating the tension between caution and innovation.
The company’s stance also reflects growing concerns about AI’s societal impact. German security officials have warned that Anthropic’s Mythos AI, designed to detect cybersecurity vulnerabilities, could be exploited by malicious actors. Meanwhile, the U.S. Department of Defense has classified Anthropic as a “supply chain security risk” after the company refused to allow its technology to be used for “domestic mass surveillance” or autonomous weapons.
What Comes Next?
Anthropic plans to engage with policymakers, researchers, and the public to refine its proposal. However, the feasibility of a global moratorium remains uncertain. “The challenge is aligning the interests of companies that prioritize speed with the need for caution,” said one industry observer. The EU has expressed openness to testing Anthropic’s ideas, but regulatory hurdles and geopolitical rivalries may delay progress.
For now, the AI sector remains in a high-stakes balancing act. As Anthropic’s stock market ambitions and safety concerns collide, the debate over who controls the future of artificial intelligence shows no signs of resolution. “This is a moment of reckoning,” said a researcher quoted in a recent FAZ analysis. “The question isn’t just whether we can slow down—but whether we should.”
