The Data Exchange with Ben Lorica · AI Research & Frontier Labs · November 2026
Ben Lorica asked about AI hardware and whether Nvidia's dominance will last. Warden says GPUs are built for large batches and training, while inference puts a different load on hardware.
Though CPU could actually be pretty fast. Obviously,
the NVIDIA answer is why. We have all the HBM on high-bandwood memory right on the GPU, right?
And I like to think of GPUs as, you know, they're designed for large batches and training. I like to think of a GPU as like trying to use an oil tanker to go and do your shopping. You know, it's, it's, they're fantastic for these large training jobs, but they're complete overkill for inference. Inference has a very different shape to its, you know, to the workload that it places on hardware.
One thing that I've kind of started to pay attention lately. And it's very, very early as a high-bandwidth flash.
Absolutely. Right?
So, what's your take?