TAG
#ai-safety
Stories connected through a shared idea, actor, technology or theme.
FTC subpoenas OpenAI and Anthropic over safety incidentsThe civil subpoenas seek information about incidents in which AI systems reportedly took deceptive, aggressive or otherwise unsafe actions during testing. Axios reported that the FTC also plans to compel testimony from senior executives.→Frontier labs face a dispute over independent evaluators’ publication rightsThe companies have publicly supported independent evaluation, but Reuters reported that negotiations include restrictions intended to protect trade secrets and prevent information from moving between labs. Proposed safeguards include lab observation of evaluators and limits on simultaneous work for competing providers.→Microsoft research highlights failures outside standard AI benchmarksThe discussion focuses on failures that emerge when AI systems are tested beyond conventional benchmarks and on the importance of examining the underlying data. It argues that evaluation must include surprising and real-world failure modes rather than relying only on headline scores.→US proposes an AI incident alert mechanism with ChinaTreasury Secretary Scott Bessent said the proposal followed discussions with Chinese Vice Premier He Lifeng in New York. The suggested mechanism would improve information-sharing between the two leading AI powers, but no final agreement was announced.→Obama urges Democrats to develop a clear AI safeguards planObama said Democrats need a clear plan for addressing AI's economic and safety consequences, according to reporting based on a partial transcript of a fundraising event. He described privately controlled AI as potentially dangerous if unmanaged but potentially beneficial for applications such as drug development.→Microsoft publishes Humanist AI code for MAI modelsMicrosoft's new code says people should retain meaningful control over MAI systems, including the ability to interrupt, correct or shut them down. It also rules out models expanding their own scope, pursuing unassigned goals or concealing relevant reasoning, while acknowledging that these constraints may reduce capability.→Anthropic discloses pauses in high-risk training after agent incidentsAnthropic paused external cyber evaluations, some in-house tests and higher-risk reinforcement-learning environments after three incidents disclosed in July. Most reinforcement learning has resumed, but some environments remain paused pending manual review and improved monitoring, while Anthropic has shifted staff towards security and reliability work.→