The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch · Startups & Venture · November 2026
Harry Stebbings asked why the "memory wall" is still such a problem. Fractile CEO Walter Goodwin explains that chip math has scaled far faster than memory bandwidth, which is why LLM text generation is held back by memory rather than compute.
…that made up sort of more than, let's say, 10% of the total compute burden. Suddenly we do. And I think that demands slightly different company structures that can have that kind of predictive power built in that try to also orchestrate the entire org around what it means to chase after that.
You mentioned memory and HBM there. Why is the memory wall such a prominent problem still today? Yeah,
it's one of these sort of interesting facts about kind of chip physics, right? If you look at the two-year-olds. So if you look across the last 20 years in the silicon world, there's sort of two things that really make up the kind of top-level specs, the kind of top trumps of your chip, right? And one of them, certainly for AI chips, is the flop count, how many floating point operations can you do per second? This is like a multiply or an add. And so that's your kind of mathematical power on that chip. And then the other piece is kind of the properties of the memory on that chip, the capacity, and in particular, the bandwidth to that memory. And that's how quickly you can, you know, shuttle data back and forth from you're looking at a GPU, you actually have that silicon in the middle of it that is running the maths. It's got that high flop count. And then there's other pieces of silicon around it, the HPM, that are kind of coming in on this on this sort of highway, bringing data in. And we've been extraordinarily good with Moore's law at…
And is that why, sorry, you have SRAM? Am I right in saying that? Moving memory closer to it. So
SRAM, yeah, so there's this sort of, you know, DRAM is like off in a different building, basically. And you're carrying these boxes down the stairs and then up the stairs again into the processor building where the maths is done. And you have to carry them back again, unfortunately, because there's…
When you look at inference in the future of inference, which is then best suited? Is it DRAM or SRAM? Because latency is important.