Considering Replacing About 10% of Inference Infrastructure

OpenAI, the developer behind ChatGPT, has begun seeking alternatives to Nvidia's latest artificial intelligence (AI) chips.


On February 2 (local time), Reuters reported, citing eight sources, that OpenAI is pursuing this move because it is not satisfied with Nvidia's latest chips.

Reuters Yonhap News

Reuters Yonhap News

View original image

It is reported that OpenAI has encountered limitations with Nvidia's chips during the "inference" process, in which AI models like ChatGPT respond to user queries. While Nvidia still holds a dominant position in chips for large-scale AI model training, inference represents a new battleground in the AI chip sector. According to sources, OpenAI is looking to replace about 10% of its inference infrastructure with chips from other suppliers. Reuters predicted that OpenAI's decision to seek alternatives in the inference chip market will serve as a significant test of Nvidia's dominance in the AI market.


This decision by OpenAI to look for alternatives to Nvidia is also intertwined with investment negotiations between the two companies. On January 30, the Wall Street Journal (WSJ) reported that Nvidia had put on hold its plan to invest $100 billion in OpenAI, which was initially set for September last year. The two companies entered into a strategic partnership and began investment discussions in September 2025. OpenAI intended to use Nvidia's investment to build AI data centers and purchase Nvidia chips. Although the deal was expected to close within a few weeks, it has yet to be finalized. Sources explained that changes in OpenAI's product roadmap have altered the nature of its computational resource requirements, which has delayed negotiations with Nvidia. On January 31, Nvidia CEO Jensen Huang dismissed the WSJ report as "nonsense," stating that Nvidia would participate in OpenAI's ongoing investment round.


While the partnership agreement between Nvidia and OpenAI remains stalled, OpenAI last year signed a multi-year AI chip supply contract with AMD, a rival of Nvidia, and secured an option to acquire a 10% stake in AMD. Additionally, two sources said that OpenAI has been in talks with AI inference chip-focused startups such as Cerebras and Groq. However, discussions between OpenAI and Groq ended after Nvidia signed a $20 billion licensing deal with Groq.



Meanwhile, following the WSJ report that Nvidia's investment plan in OpenAI had been suspended, Nvidia's share price closed down 2.89% on the New York Stock Exchange that day.


This content was produced with the assistance of AI translation services.

© The Asia Business Daily. All rights reserved. Unauthorized AI training and use prohibited.

Today’s Briefing