The head of the U.S. AI safety agency has resigned amid growing concerns over the management of artificial intelligence technologies. This departure comes as the Trump administration shifts from a previously hands-off approach to actively monitoring AI developments, in light of the potential risks associated with their misuse, including applications in weapons development. The agency collaborates with leading AI developers to identify vulnerabilities in unreleased models, highlighting the increasing emphasis on safety and regulation in the sector.

US AI Safety Agency: The U.S. Center for AI Standards and Innovation is a federal AI testing institute housed within the Department of Commerce. It develops standards and evaluates risks from advanced AI models in collaboration with major labs. Its director Chris Fall recently resigned after a short tenure, underscoring shifts in federal AI oversight under the Trump administration.

Model Testing: The institute works with leading AI developers to test unreleased models for vulnerabilities and risks including potential misuse for weapons development.
Policy Direction: The Trump administration has moved from an initial hands-off stance on AI to more active monitoring of the technology.