King Charles urges AI leaders to curb development pace

King Charles III urged senior leaders from OpenAI, Anthropic, Google DeepMind and Nvidia to ensure artificial intelligence remains under control and in the service of people and the planet. The gathering in Scotland was convened to discuss how AI can benefit society, coming at a pivotal moment as debate swirls around whether rapid advances will soon put it beyond the ability of humans to rein it in. The king said AI development is "intriguing and deeply concerning in equal measure," cautioning about "existential dangers" if the technology falls into wrong hands.

King Charles III met with senior representatives from major AI firms-OpenAI (represented by CFO Sarah Friar), Anthropic, Google DeepMind (represented by Chair Demis Hassabis), and Nvidia (represented by CEO Jensen Huang)-at Dumfries House in Scotland on September 17. Opening remarks centered on the dual nature of AI advancement, with the king emphasizing that while development is "intriguing," the "existential dangers" must be urgently considered, asking: "Surely, then, we need sufficient means of control before it is all too late?"

The summit addressed how AI can benefit society while grappling with whether rapid advances will soon exceed humanity's ability to manage the technology. The king asked attendees to consider the "fundamental principles" that should guide AI development. The gathering comes as global attention focuses on AI's breakneck progress and warnings that it could race out of control, threatening humanity.

The summit was prompted in part by Anthropic researcher Jacob Coxon's viral resignation, after which Anthropic CEO Dario Amodei published an essay arguing that the industry might need to slow the pace of its work. This week, billionaires Sam Altman and Elon Musk echoed calls from Amodei who said firms need to deliberately slow frontier model development and warned that unchecked growth could enable autonomous AI swarms to hijack global internet infrastructure within the next year. Tech chiefs including OpenAI's Sam Altman, Anthropic's Dario Amodei, Google DeepMind founder Demis Hassabis and Elon Musk have shown rare agreement in calling for a slowdown in developing the technology and regulatory oversight.