AMD Announces Availability of Instinct MI300X Accelerator and MI300A APU for High-Performance Computing and Generative AI

[Tsing]

AMD has announced that the Instinct MI300X accelerator and Instinct MI300A accelerated processing unit (APU) are now available as part of the company's new Instinct MI300 Series, aimed at high-performance computing, generative AI, and similar applications.

See full article...

 

[Zarathustra]

I hope we never see the day when bullshit like this is integrated in mainstream CPU's.

 

[Grimlakin]

I hope we never see the day when bullshit like this is integrated in mainstream CPU's.

Uhhh too late? Even mobile CPU's are doing AI acceleration now. It's been like that or projected to be that for over a year now.

To not expect it at this point (even if it is just a marketing blurb) is primary school yard fit throwing. It's coming, it is literally already happening in modern desktop/laptop CPU's.

Just just hope they don't or in your case do paywall it behind some subscription theme to unlock AI acceleration. (Like Intel wants to do with their next gen Xeon CPU's. )

 

[Brian_B]

Apple has had an AI accelerator in their SOC since A11 (iPhone X) -- they first used it to power Face ID/ biometrics.

The latest Apple Watch even added 4 AI cores to the watch SOC - they use it there to process voice commands for Siri and new gesture-based controls, among other things.

 

[Zarathustra]

Apple has had an AI accelerator in their SOC since A11 (iPhone X) -- they first used it to power Face ID/ biometrics.

The latest Apple Watch even added 4 AI cores to the watch SOC - they use it there to process voice commands for Siri and new gesture-based controls, among other things.

Well, to each their own, but I want absolutely no AI computation on my computer or any devices of mine. I also don't want anything derived from AI computation elsewhere to fins its way onto my computer or any other devices.

I want honest, local, static computing. That's it. Not just today, but every day, for now and for all eternity.

 

[Grimlakin]

Lets be real all AI processing nodes are, are nodes with instruction sets for better processing of specific data types. In this case used for 'ai' like functions... that are just enhanced scripting. Just beyond what is easily processed on a normal core.

 

[Brian_B]

I'm fine with whatever accelerators they want to put in my stuff - so long as I have a reasonable understanding of what it's doing and who it's talking it.

 

[Marees]

Google reportedly taps AMD to design next-generation TPU — hybrid AI ASIC could integrate on-package CPU cores for reinforcement learning​

News
By Anton Shilov
Published 4 hours ago
A custom TPU for agentic and RL workloads?

"Market chatter suggests [Google] is working with AMD on a TPU project in the v10 generation,"
— a SemiAnalysis note for clients cited by Sean reads.

Google hardly needs AMD to design a conventional TPU. Hence, chances that AMD will implement Google's TPU v10i for inference or V10t for training are low. Hence, Google might need something only a CPU maker like AMD could provide, including CPU IP, programmable logic, interconnects, or certain advanced packaging know-how.

SemiAnalysis claims that Google and its customers are pushing for TPUs with on-package CPU cores for reinforcement learning and potentially other CPU-heavy workloads. While conventional LLM training remains overwhelmingly accelerator-heavy, reinforcement learning for reasoning and agentic models can require considerably more general-purpose compute around accelerator operations.


This is where AMD comes into play, as it already has experience developing a data center-grade design — the Instinct MI300A — that packs both x86 and accelerator chiplets.


A hypothetical Google design could therefore combine Google-developed TPU compute chiplets with AMD CPU and HBM in a tightly integrated package built by AMD.


https://www.tomshardware.com/tech-i...-package-cpu-cores-for-reinforcement-learning

 

[igor_kavinski]

https://www.tomshardware.com/tech-i...-package-cpu-cores-for-reinforcement-learning

Pretty big and unexpected news. Weird that they chose AMD even though they have great success making their TPU accelerators. This is something they might be doing only due to time related pressure because they have enough money to deploy their own licensed ARM CPU cores if they wanted or develop something in-house. Could also be that they lost someone important from their silicon team.

I hope we never see the day when bullshit like this is integrated in mainstream CPU's.

Ahctually....I can see someone creating a Transmeta Crusoe like AI accelerated CPU that optimizes running code the longer it runs. That would be cool. As then developers can just focus on writing code and not spending time optimizing it.

 

[Zarathustra]

Pretty big and unexpected news. Weird that they chose AMD even though they have great success making their TPU accelerators. This is something they might be doing only due to time related pressure because they have enough money to deploy their own licensed ARM CPU cores if they wanted or develop something in-house. Could also be that they lost someone important from their silicon team.


Ahctually....I can see someone creating a Transmeta Crusoe like AI accelerated CPU that optimizes running code the longer it runs. That would be cool. As then developers can just focus on writing code and not spending time optimizing it.

I prefer all things to be deterministic.