- CoreWeave, a major cloud provider, utilizes Nvidia GPUs and holds a significant stake from Nvidia while competing with Microsoft and Meta.
- CoreWeave, Oracle, and Nvidia are competing for AI cloud revenue by utilizing scarce GPUs for data center capacity.
Article details exponential efficiency gains in AI computing hardware
What happened
A report published on September 16, 2026, stated that the price of utilizing machine learning intelligence is decreasing by several orders of magnitude annually and shows no signs of slowing. The report suggests that large language models (LLMs) are likely to be integrated into computing infrastructure rather than remaining solely as a product within the next couple of years. Furthermore, local LLMs running on commodity hardware are projected to become viable within three to six years.
From jyn.dev
Why it matters
These findings suggest that the operational costs for frontier AI models are declining due to hardware efficiency. The exponential gains in GPU efficiency are viewed as a factor validating the core business models of high-efficiency hardware providers. This trend impacts the competitive landscape for cloud computing services.
From jyn.dev
Who's involved
- GPUA former American energy company whose advanced AI research relies on GPU computing power.
- OpenAIAn American artificial intelligence research organization that utilizes GPT-2 technology.
- CoreWeaveAn American cloud computing company whose business model depends on high-performance GPU hardware.
- AMDAn American multinational semiconductor company that competes in the high-performance GPU market.
- NvidiaAn American multinational technology company involved in the high-efficiency GPU market.
- OracleA company based in Madrid, Spain, offering cloud services.
- AmazonAn American multinational technology company offering GPU-driven cloud services.
Who could feel it
Possible knock-on effectsThese are possibilities Brind reasoned out, not predictions, and not advice. Most are not stated in any report.
- CoreWeaveSpeculative
The company could see improved profitability and scalability of its cloud infrastructure due to lower costs per task.
- AMDSpeculative
The company might see demand for high-performance hardware validated by exponential GPU efficiency gains.
- OpenAISpeculative
The organization could experience lower operational expenditure as the cost per task decreases.
- OracleSpeculative
The company might find its cloud services more competitive and profitable due to decreasing AI compute costs.
- AmazonSpeculative
The company could see improved operational economics from the decreasing cost per task in its cloud offerings.
Keep exploring
The entities involved
-
GPU
former American energy company
-
OpenAI
American artificial intelligence research organization
- Leaders call for international cooperation on AI risks, tech leaders call for oversight, and the CMA proposes stricter search engine choice requirements.
- Experts, including Dario Amodei at Cornell University, warned about the power and limits of AI, specifically citing risks of AI taking control of the internet.
Related events
- OpenAI's new custom AI chip has successfully outperformed current Nvidia hardware in testing.
- OpenAI announces massive commitments to various partners, including 10 GW of Nvidia systems, a $300B cloud capacity goal, and new deals with AMD and Broadcom.
- Nvidia is managing its financial exposure related to the data center project in Ohio for OpenAI.
- Investment helped finance OpenAI's new competing chip, while market analysts discuss server useful life and Nvidia's future.
- OpenAI is developing custom silicon to reduce reliance on Nvidia's hardware, signaling a major market shift in the AI industry.