NVIDIA Delivers 1000x Improvement in Single GPU Performance on AI Inference in 10 Years

[Tsing]

How is Huang's Law doing these days? Phenomenal, it seems, as NVIDIA has shared a new article that describes how it's been able to improve single GPU performance on AI inference by 1000x, and it did so in just 10 years' time. According to a chart that was shown off during a recent talk by NVIDIA Chief Scientist Bill Dally, the story originally began with the Tesla K20X—a GPU Accelerator that was released back in 2013—but its performance has now been completely eclipsed by more recent products that include the H100, NVIDIA's series of Hopper-powered GPUs that can deliver up to 68 teraFLOPS of performance. NVIDIA's biggest gain was achieved from "finding simpler ways to represent the numbers computers use to make their calculations," Dally explained.

See full article...

 

[Brian_B]

That's great.

I still have zero use cases for AI in my everyday life though.