US could set up ‘standards body’ to regulate frontier AI models, says Google DeepMind CEO

Public TV English
5 Min Read

NEW DELHI: The United States could establish a new ‘Standards Body’ modelled on a federally overseen public-private partnership or self-regulatory organisation with a board that includes independent leading technical experts and open-source representatives.

According to Demis Hassabis, Co-Founder & CEO, Google DeepMind, the US is well positioned to take the first step in developing such a framework given its economic and technical standing.

“The rapid progress we’re seeing in AI requires a new approach to testing frontier AI model capabilities…The US is well positioned, given its economic and technical standing, to take the first step in developing such a framework. It could establish a new Standards Body modelled on a federally overseen public-private partnership or self-regulatory organisation…,” Hassabis said on X.

The proposal aims to create a dynamic, adaptable, and rigorous framework to test frontier AI model capabilities amid rapid technological progress.

Hassabis mentioned that the proposed entity, similar to the Financial Industry Regulatory Authority (FINRA), would require substantial funding coming mostly from the industry to attract world-class technical talent and provide necessary compute resources for large-scale testing.

The Standards Body would develop assessment protocols and collaborate with federal agencies and the US National Labs to conduct testing in areas relevant to national security. A model would qualify as “Frontier-class” by meeting specific benchmarks determined by the body, which would be regularly updated to match evolving capabilities.

Hassabis explained that organisations with these models would be deemed “Frontier Labs” and encouraged to adopt best practices, including publishing model cards, maintaining strong internal cybersecurity, vetting personnel, and resourcing safety research.

Initially, Frontier Labs would voluntarily share models with the Standards Body for review up to 30 days before release. Once the assessment protocol proves effective and robust, formalisation could follow, requiring Frontier Models to pass the review to be deployed in the US market. Labs would also work with the body to address critical post-release vulnerabilities.

“The strength of this approach is it would be technically focused, while at the same time supporting innovation and incentivising responsible behaviour,” Hassabis said.

“It is designed to keep up with the field’s acceleration and adapt to the biggest risks as they are identified, and could be ratcheted up if the seriousness of the situation demands, including coordinating a slowdown in development among the Frontier Labs if deemed necessary,” he added.

Model assessments would include rigorous scientific evaluations of capabilities in cybersecurity, biological threats, and high-risk domains. Specific agentic AI tests would look for attempts to bypass safety guardrails or signs of deception, ensuring practices like digital watermarking and generating human-readable output tokens.

Hassabis noted that the evaluations would be updated quarterly at the start, with outdated benchmarks deprecated. The body would eventually build technical capacity to create independent held-out tests to prevent overfitting, promoting an ecosystem of third-party auditors with the US government.

“AGI has the potential to be the ultimate tool for advancing science and medicine, and to drive enormous productivity gains and economic growth,” Hassabis stated. “But in order to achieve this, we need to get the technical foundations right by coordinating around a shared global framework, using the most rigorous scientific methods, and bringing the best minds together to work on the challenges we face,” he noted.

The framework would apply to Frontier-class models regardless of their country of origin or open-source status, while non-frontier models from startups or academia would remain exempt. The initiative seeks to provide a starting point for international standards to manage serious risks while ensuring global access to AI benefits. (ANI)

Share This Article
Leave a Comment

Leave a Reply

Your email address will not be published. Required fields are marked *