Anthropic and OpenAI Negotiate Cross-Company AI Safety Testing
What happened
Anthropic and OpenAI are negotiating a legally binding agreement that would allow the two companies to test each other's commercially available AI models for safety vulnerabilities. Under the proposed arrangement, both companies would receive API access to the other's commercial models to identify potential risks and unexpected behavior. A key condition under discussion is that neither side would retain the other's data obtained during testing.
From livemint.com
Why it matters
The arrangement is intended to help identify safety risks as the companies develop increasingly advanced AI systems. This cross-company assessment allows Anthropic and OpenAI to probe each other's models for vulnerabilities that might not emerge during conventional internal evaluations.
Both Anthropic and OpenAI are currently facing major AI safety risks.
From livemint.com
Who's involved
Who could feel it
Possible knock-on effectsThese are possibilities Brind reasoned out, not predictions, and not advice. Most are not stated in any report.
Keep exploring
Part of
Both Anthropic and OpenAI are currently facing major AI safety risks.Also in this story
- Anthropic and OpenAI are accused of irresponsible AI development, prompting researcher resignations and student protests in Massachusetts.
- Major AI firms, including Anthropic, OpenAI, Google, and Nvidia, signed a voluntary safety accord.
- OpenAI must ensure adherence to national interests and mitigate risks associated with independent AI action.
- Anthropic and OpenAI are accused of racing toward unchecked superintelligence, prompting calls for Congressional intervention.
The entities involved
-
Anthropic
American artificial intelligence corporation
-
OpenAI
American artificial intelligence research organization
Related events
- The Senate is currently debating new legislation concerning AI safety and governance, involving major industry players like OpenAI.
- OpenAI failed to alert the Australian government regarding model breaches, amid calls for global AI regulation and testing.
- Bernie Sanders and Greg Casar are co-introducing legislation alongside Anthropic to call for bans on advanced AI development and enhance AI safety.
- The capabilities of Meta AI and OpenAI are raising serious concerns regarding the containment of advanced artificial intelligence models.
- APRA is monitoring risks from OpenAI's AI capabilities and testing AI models from Anthropic.