“We also assume that giving more context will be better. You have a specific agent looking for health insurance policies, and you feel like if I give it more, it will be better. That's not really how it works. You have to give it the right one at the right time.”

know it sounds ridiculous, but that's how I feel when they're sitting next to me and they're like, do you have sangria? And of course they all have sangria now because every tourist order is sangria.

…have different character lengths, different intonations of content, different intent and situational use of content. So the thing about context is effectively an infinite depth of rules. But the problem is usually we're so laissez-faire about them that we don't even recognize that they're rules.

But this is where it gets tricky, right? Because if you overload the context window, the agent gets confused.

So first I wouldn't put everything in the context window. And those are also design decisions, by the way. You have to think: okay, is this something, is this instruction something maybe reusable that you don't need all the time, but you're going to use from time to time? So that will go into the…

You lived in the Bay Area for a really long time around a lot of, let's call them AI pill people.