Concerns Over AI Control and Systemic Risk Raised by Industry Expert
What happened
Lewis Liu discussed the risk of 'systemic qualitative risk,' describing potentially dangerous herd behavior in the financial system caused by the widespread use of AI models calibrated by frontier labs like Anthropic and OpenAI. Liu stated he deleted Claude because Anthropic’s system prompt explicitly states that the company’s interests take precedence over the user’s.
From cityam.com
Why it matters
The discussion highlighted increasing concerns that AI companies are exerting active thought control over individuals and financial markets. This raises questions about the competitive positioning of Anthropic and OpenAI, as well as the potential for systemic risk in the financial sector.
The rivalry between AI companies has intensified, with recent public disputes regarding AI advertising and accusations of deception between competitors.
From cityam.com
Who's involved
- AnthropicCompany whose system prompt was criticized for prioritizing its own interests over the user's.
- OpenAIMarket competitor to Anthropic, mentioned alongside Anthropic regarding systemic risk.
- Letitia JamesAttorney General of New York, who was present at the panel discussing systemic risk.
- Federal Trade CommissionUnited States federal government agency mentioned in the context of safety investigations.
Who could feel it
Possible knock-on effectsThese are possibilities Brind reasoned out, not predictions, and not advice. Most are not stated in any report.
- Federal Trade CommissionSpeculative
Concerns over control and systemic risk might reinforce the Federal Trade Commission's safety investigation.
Possible ripples
Who this could reach next, traced step by step from the reporting. Possibilities worth considering, not forecasts.Keep exploring
The entities involved
-
Anthropic
American artificial intelligence corporation
-
OpenAI
American artificial intelligence research organization
Related events
- Anthropic, SpaceX, OpenAI, Google, and Meta are leading the charge in frontier AI development, marked by shared leadership, diverse funding models, and intense competition for technological dominance.
- The competitive landscape of advanced AI is highlighted by the race among major labs (OpenAI, Google, Anthropic) to build powerful models and the movement of key researchers.
- Leaders, including Musk, Trump, and Altman, called for pacing frontier AI development at the All-in Summit in Los Angeles.
- Anthropic is developing AI products like Claude Code, while Menlo Ventures led major funding rounds for the company. Anthropic was founded by former OpenAI researchers.