King Charles Calls AI Leaders to the Table as Safety Concerns Escalate

Britain’s King Charles III will meet with leaders from major artificial intelligence companies in Scotland this week as concerns grow over the pace of development and the potential risks posed by increasingly capable AI systems.

The gathering is scheduled for Sept. 17 at Dumfries House in Ayrshire, southwestern Scotland, and is being organized by the British nonprofit Ditchley Foundation.

The meeting comes days after Anthropic CEO Dario Amodei called for the AI industry to slow the pace of frontier-model development, saying safety measures need more time to keep pace with advances in capability. His proposal has received public support from OpenAI CEO Sam Altman and xAI founder Elon Musk.

The gathering will bring together senior figures from the AI industry and government to discuss how increasingly powerful systems should be developed and deployed.

Nvidia CEO Jensen Huang, Google DeepMind chief Demis Hassabis and Vatican AI adviser Paolo Benanti are expected to participate, although not every attendee has publicly confirmed participation.

AI Safety Concerns Intensify

The summit comes as debate over the speed of AI development has intensified among technology executives, researchers and policymakers.

Amodei published a 3,800-word essay Saturday calling for a deliberate slowdown in the development of increasingly capable AI models. He argued that the industry should create more time for safety measures and independent evaluation as AI capabilities advance.

Amodei wrote, “We must slow the pace at which we improve the capabilities of AI models. Progress will still seem fast, and we must make wise use of the time we gain.”

He said the proposal would not mean stopping AI research or model training. Instead, he argued companies should give safety processes and independent testing more time to develop alongside increasingly capable systems.

Amodei proposed allowing independent evaluators permanent, employee-level access to frontier AI companies so they can assess safety measures, report incidents and evaluate model alignment. Anthropic has said it will adopt that measure.

His position has received support from Altman and Musk. Musk wrote on X, “Dario is right.”

The calls for caution reflect a broader debate about whether AI companies can maintain adequate safeguards while competing to build increasingly capable models. Amodei’s concerns include potential misuse of AI systems and the difficulty of ensuring safety as capabilities advance.

Researcher’s Resignation Adds to Debate

Jacob Coxon, a researcher who previously worked at OpenAI and Anthropic, resigned from Anthropic in September after raising concerns about the direction and pace of AI development.

In a statement posted on X, Coxon wrote, “Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives.”

Coxon’s resignation post had received more than 115 million views by Sept. 9. Coxon also told the publication that he left before his Anthropic equity was due to vest.

Coxon’s warning has added to wider concerns among AI researchers about the possibility that increasingly autonomous systems could become harder to monitor or control.

Experts disagree over the likelihood and timing of extreme AI risks, while there is broader agreement that advanced systems create challenges involving cybersecurity, misuse, safety testing and governance.

Charles to Act as Convenor

Charles is expected to take a neutral role at the meeting rather than present his own policy position on AI.

The Dumfries House meeting gives the King an opportunity to bring technology executives, policymakers and other stakeholders into the same discussion without making the gathering a formal government negotiating forum.

The meeting is intended to encourage participants to exchange views and debate how AI should develop. The event is being organized by the Ditchley Foundation, which specializes in high-level discussions on international issues.

It’s also expected to include Britain’s minister for AI, Kanishka Narayan, along with representatives linked to the King’s Trust and the Sustainable Markets Initiative.

Political Divisions Could Complicate Consensus

The United States has generally prioritized maintaining its lead in artificial intelligence, while China and the European Union have pursued different approaches to technology governance. The European Union’s AI Act provides a comprehensive regulatory framework, while Britain has largely favored a more principles-based and sector-specific approach.

The debate over slowing AI development also comes amid growing geopolitical competition. Companies developing frontier models face pressure to move quickly, while governments are concerned that excessive restrictions could weaken their technological position.

While Altman and Musk backed the broader idea of greater caution, U.S. President Donald Trump has rejected calls to slow American AI development, arguing that the United States needs to maintain its lead.

OpenAI CEO Sam Altman told Fortune that an IPO in 2026 was off the table, saying, “We got a lot of stuff to do, like meeting this moment of what is going to be required for safety and alignment, and how the industry and governments can work together.”

Britain’s Position in the AI Debate

Britain has sought to position itself between the technology industry’s emphasis on innovation and growing demands for stronger AI safeguards.

The country hosted the first major international AI Safety Summit at Bletchley Park in 2023, bringing governments and technology companies together to discuss the risks associated with advanced AI.

Britain has continued to promote international cooperation while maintaining a relatively light-touch regulatory approach compared with the European Union.

The country’s AI Safety Institute, created following the Bletchley summit, has worked with leading AI developers to evaluate advanced models before deployment. Its role reflects Britain’s attempt to build technical safeguards without adopting the broader regulatory framework used by the EU.

The following meeting comes at a significant point in the international AI debate. Industry leaders are increasingly acknowledging the need for stronger safety measures, but there is still no global agreement on how quickly frontier AI should advance or what safeguards should be mandatory.