Anthropic and OpenAI Negotiate Cross-Company AI Safety Testing
What happened
Anthropic and OpenAI are negotiating a legally binding agreement that would allow the two companies to test each other's commercially available AI models for safety vulnerabilities. Under the proposed arrangement, both companies would receive API access to the other's commercial models to identify potential risks and unexpected behavior. A key condition under discussion is that neither side would retain the other's data obtained during testing.
From livemint.com
Why it matters
The arrangement is intended to help identify safety risks as the companies develop increasingly advanced AI systems. This cross-company assessment allows Anthropic and OpenAI to probe each other's models for vulnerabilities that might not emerge during conventional internal evaluations.
Both Anthropic and OpenAI are currently facing major AI safety risks.
From livemint.com
Who's involved
Who could feel it
Possible knock-on effectsThese are possibilities Brind reasoned out, not predictions, and not advice. Most are not stated in any report.
Keep exploring
Part of
Both Anthropic and OpenAI are currently facing major AI safety risks.Also in this story
- OpenAI must ensure adherence to national interests and mitigate risks associated with independent AI action.
- Anthropic and OpenAI are accused of racing toward unchecked superintelligence, prompting calls for Congressional intervention.
The entities involved
-
Anthropic
American artificial intelligence corporation
-
OpenAI
American artificial intelligence research organization
- Leaders call for international cooperation on AI risks, tech leaders call for oversight, and the CMA proposes stricter search engine choice requirements.
- Experts, including Dario Amodei at Cornell University, warned about the power and limits of AI, specifically citing risks of AI taking control of the internet.
Related events
- Advocacy group critiques AI safety protocols for OpenAI.
- Leaders agree on the need for AI safety mechanisms following an incident involving unpublished OpenAI agents and calls for guardrails.
- Expert comments on AI safety risks, involving Nate Soares, OpenAI, and Machine Intelligence Research Institute.
- Industry leaders, including Jensen Huang, are discussing the future trajectory of AI and debating the necessary pace of development and safety measures.
- Anthropic and OpenAI are facing scrutiny over their AI safety practices, while the Future of Life Institute advocates for a slowdown in rapid AI development.