WG Walter Goodwin Walter Goodwin On The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

“We've scaled flop count about a millionfold in the last 25 years on these chips. Bandwidth, by contrast, is much more intrinsically physics limited. We've scaled it about 40-fold in the same time. So it's lagged behind the flop scaling about 25,000 times.”

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch · Startups & Venture · November 2026

“We've scaled flop count about a millionfold in the last 25 years on these chips. Bandwidth, by contrast, is much more intrinsically physics limited. We've scaled it about 40-fold in the same time. So it's lagged behind the flop scaling about 25,000 times.” — Walter Goodwin, The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

Context

Harry Stebbings asked why the "memory wall" is still such a problem. Fractile CEO Walter Goodwin explains that chip math has scaled far faster than memory bandwidth, which is why LLM text generation is held back by memory rather than compute.

Transcript

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch Around 13:28 into the episode
Walter Goodwin

…that made up sort of more than, let's say, 10% of the total compute burden. Suddenly we do. And I think that demands slightly different company structures that can have that kind of predictive power built in that try to also orchestrate the entire org around what it means to chase after that.

Harry Stebbings

You mentioned memory and HBM there. Why is the memory wall such a prominent problem still today? Yeah,

Walter Goodwin

it's one of these sort of interesting facts about kind of chip physics, right? If you look at the two-year-olds. So if you look across the last 20 years in the silicon world, there's sort of two things that really make up the kind of top-level specs, the kind of top trumps of your chip, right? And one of them, certainly for AI chips, is the flop count, how many floating point operations can you do per second? This is like a multiply or an add. And so that's your kind of mathematical power on that chip. And then the other piece is kind of the properties of the memory on that chip, the capacity, and in particular, the bandwidth to that memory. And that's how quickly you can, you know, shuttle data back and forth from you're looking at a GPU, you actually have that silicon in the middle of it that is running the maths. It's got that high flop count. And then there's other pieces of silicon around it, the HPM, that are kind of coming in on this on this sort of highway, bringing data in. And we've been extraordinarily good with Moore's law at…

Harry Stebbings

And is that why, sorry, you have SRAM? Am I right in saying that? Moving memory closer to it. So

Walter Goodwin

SRAM, yeah, so there's this sort of, you know, DRAM is like off in a different building, basically. And you're carrying these boxes down the stairs and then up the stairs again into the processor building where the maths is done. And you have to carry them back again, unfortunately, because there's…

Harry Stebbings

When you look at inference in the future of inference, which is then best suited? Is it DRAM or SRAM? Because latency is important.

Speaker names come from our own diarization. The position is estimated from where the line sits in the episode.

More from The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch