AMD on Thursday said it plans to start mass production of a new version of its artificial-intelligence chip called the MI325X in the Q4 of the year. AMD said its AI chip is a direct aim at Nvidia’s data center graphics processors, known as GPUs. The AI chip is called Instinct MI325X, and production shall start before the end of 2024, AMD said on Thursday during an event announcing the new product.
(Image Credit: amd)If AMD’s AI chips are seen by developers and cloud giants as a close substitute for Nvidia’s products, it could put pricing pressure on Nvidia. Nvidia has enjoyed roughly 75% gross margins while its GPUs have been in high demand over the past year.
Increasing demand for AI chip
Advanced generative AI such as OpenAI’s ChatGPT requires massive data centers full of GPUs in order to do the necessary processing, which has created demand for more companies to provide AI chips.
In the past few years, Nvidia has dominated the majority of the data center GPU market, but AMD is historically in second place. Now, AMD is aiming to take share from its Silicon Valley rival or at least to capture a big chunk of the market, which it says will be worth $500 billion by 2028.
“AI demand has actually continued to take off and actually exceed expectations. It’s clear that the rate of investment is continuing to grow everywhere,” AMD CEO Lisa Su said at the event.
Customers for AMD MI325x
AMD didn’t reveal new major cloud or internet customers for its Instinct GPUs at the event, but the company has previously disclosed that both Meta and Microsoft buy its AI GPUs and that OpenAI uses them for some applications. The company also did not disclose pricing for the Instinct MI325X, which is typically sold as part of a complete server.
AMD AI MI325x specs
The flagship chip AMD AI MI325x boasts nearly 200 processing cores and is priced at $14,813. The whole line of processors uses the Zen 5 architecture that offers speed gains of as much as 37% for advanced AI data crunching.
MI325x competition for Nvidia Blackwell
The new AI chip is the successor to the MI300X, which started shipping late last year. AMD’s 2025 chip will be called MI350, and its 2026 chip will be called MI400, the company said.
The MI325X’s rollout will pit it against Nvidia’s upcoming Blackwell chips, which Nvidia has said will start shipping in significant quantities early next year.
A successful launch for AMD’s newest data center GPU could draw interest from investors that are looking for additional companies that are in line to benefit from the AI boom.
AMD sales
While AI accelerators and GPUs have become the most intensely watched part of the semiconductor industry, AMD’s core business has been central processors, or CPUs, that lay at the heart of nearly every server in the world.
AMD’s data center sales during the June quarter more than doubled in the past year to $2.8 billion, with AI chips accounting for only about $1 billion, the company said in July.
AMD’s EPYC 5th Gen
AMD takes about 34% of total dollars spent on data center CPUs, the company said. That’s still less than Intel, which remains the boss of the market with its Xeon line of chips. AMD is aiming to change that with a new line of CPUs, called EPYC 5th Gen, that it also announced Thursday.
Those chips come in a number of different configurations ranging from a low-cost and low-power 8-core chip that costs $527 to 192-core, 500-watt processors intended for supercomputers that cost $14,813 per chip.
The new CPUs are particularly good for feeding data into AI workloads, AMD said. Nearly all GPUs require a CPU on the same system in order to boot up the computer.
“Today’s AI is really about CPU capability, and you see that in data analytics and a lot of those types of applications,” Su said.
Stock update
AMD is only up 20% so far in 2024 while Nvidia’s stock has risen over 175%. Most industry estimates say Nvidia has more than 90% of the market for data center AI chips.
AMD’s stock fell 4% on Thursday. Nvidia shares were up about 1%.
