- CoreWeave, a major cloud provider, utilizes Nvidia GPUs and holds a significant stake from Nvidia while competing with Microsoft and Meta.
- CoreWeave, Oracle, and Nvidia are competing for AI cloud revenue by utilizing scarce GPUs for data center capacity.
Article details exponential efficiency gains in AI computing hardware
What happened
A report published on September 16, 2026, stated that the price of utilizing machine learning intelligence is decreasing by several orders of magnitude annually and shows no signs of slowing. The report suggests that large language models (LLMs) are likely to be integrated into computing infrastructure rather than remaining solely as a product within the next couple of years. Furthermore, local LLMs running on commodity hardware are projected to become viable within three to six years.
From jyn.dev
Why it matters
These findings suggest that the operational costs for frontier AI models are declining due to hardware efficiency. The exponential gains in GPU efficiency are viewed as a factor validating the core business models of high-efficiency hardware providers. This trend impacts the competitive landscape for cloud computing services.
From jyn.dev
Who's involved
- GPUA former American energy company whose advanced AI research relies on GPU computing power.
- OpenAIAn American artificial intelligence research organization that utilizes GPT-2 technology.
- CoreWeaveAn American cloud computing company whose business model depends on high-performance GPU hardware.
- AMDAn American multinational semiconductor company that competes in the high-performance GPU market.
- NvidiaAn American multinational technology company involved in the high-efficiency GPU market.
- OracleA company based in Madrid, Spain, offering cloud services.
- AmazonAn American multinational technology company offering GPU-driven cloud services.
Who could feel it
Possible knock-on effectsThese are possibilities Brind reasoned out, not predictions, and not advice. Most are not stated in any report.
- CoreWeaveSpeculative
The company could see improved profitability and scalability of its cloud infrastructure due to lower costs per task.
- AMDSpeculative
The company might see demand for high-performance hardware validated by exponential GPU efficiency gains.
- OpenAISpeculative
The organization could experience lower operational expenditure as the cost per task decreases.
- OracleSpeculative
The company might find its cloud services more competitive and profitable due to decreasing AI compute costs.
- AmazonSpeculative
The company could see improved operational economics from the decreasing cost per task in its cloud offerings.
Keep exploring
The entities involved
Related events
- OpenAI announces massive commitments to various partners, including 10 GW of Nvidia systems, a $300B cloud capacity goal, and new deals with AMD and Broadcom.
- GTC discussed the massive infrastructure requirements for advanced GPUs, noting that the annual energy consumption of this computing power rivals that of the Netherlands.
- AMD is gaining significant market share in the AI infrastructure race through major GPU commitments from OpenAI and Meta, supported by partners like ZT Systems.
- Microsoft is paying OpenAI for AI models and building its own MAI system, while Nvidia maintains high margins in the competitive AI hardware market.
- Broadcom is targeting companies like OpenAI with its XPU solutions as an alternative to Nvidia's dominant GPU market share.