Things Kris Says on Podcasts

Yeah, which is like, I think, you know, anybody that works at one of these labs has a kind of their mind warped a bit, has a distortion, a distorted view of reality because they are working in the middle of this thing. It's like, it's also coming up from like kind of one of the conversations I was having with ChatGPT, where it's like, if you're someone that investigates airline crashes, like airplane incidents crashes, like, and that's your job, you're going to have a distorted view of reality where you think that airline, like airplane crashes are much more frequent than they are, say, compared to, say, car crashes, which are by like, I think, two orders of magnitude like more likely to happen. Yeah. And so it's like, even if you know it's still like less likely, you still think it's more likely than it actually is because your localized experience is, you see this all the time. You see this every day because that's the environment you live in. And I think this is also what's happening to people that are working at these frontier labs. They…

…really like gnarly, I'm probably going to stumble over. It's going to be much nicer if there's just a comment there. But like LLMs are very good at understanding gnarly code. If you hand it, it's like, no, this is how this thing works. They can like reason through, especially more modern LLMs can like reason through it. So like, I don't even think we need it for writing code in that way. Like, I think ironically, we're at the point where the thing that was built to generate text, the thing we needed to do the least is generate text. Because like, I think we all forgot how expensive words are. In the same way that like lines of code are expensive, I think words are expensive. And when you only have like a 250,000 token context window or maybe like a high and a million, but it really doesn't really go as far as I think people think it does over the course of like a long conversation. You can't just be like wasting words on…

…going to go back and something's going to go forward. Sometimes this one proposal that we're like, we're definitely going to accept it gets affected by a proposal that already got accepted and implemented. Now we got to go rethink this one, right? This is a very dynamic and fluid process. I think any attempt to like shut it down in a way or to draw a line somewhere, it's just not going to work. It's like when people say, oh, we have a dictionary that defines words, thinking that the word, the definition in the dictionary is the correct one. It's like, no, the definition in the dictionary is the emergent one. We all define words simply by using them. That's how language works. And similarly with these discussions and things we want to implement, we won't know the point at which something is ready to be implemented until we've had the conversation and figured out that we have talked about enough, this enough to implement it. And there's someone that's going to go implement it. Like, that's the gate. That's the thing at the end of the day. If the Go team wants to have a…