“Right now we're in the early days of RSI, where it's making a human engineer maybe three, four, five times more productive. The human's very much still in the loop. The next phase, which I think carries the most risk, is closed-loop RSI, where you somehow figure out how to do it without the human reviewer process. That will obviously be faster, but I think it's also a very dangerous way to get to full AGI. … The end result will likely be quite alien. It's going to be like an alien intelligence.”

…or less than 12 hours, it would start from random play in the morning to, you know, you'd have your coffee break at 11 a.m. and I could still just about beat it. Then by lunchtime, it was grandmaster level. And then by tea time, it was better than any chess-playing entity. Tea time is dinner

time for the US company. Yeah, computer time

So presume that the incentives to be in a race continue. And, you know, you and I, some people I know this, you know, have tried to figure out if there's various ways you can get global collaboration to have less. You've dedicated a huge amount of energy to that. So thank you. It's a hard game, as…

Well, what we're doing, and I think other leading labs are trying to do, is you've got to, so there's more prosaic things like make sure cyber defense is accelerating faster than cyber attack and making sure you give access to trusted cyber defenders first on maybe slightly fine-tuned versions of…

Should there be ways that the labs are encouraged, required, permitted to collaborate on this? And if so, what should some of those ways be? Because it obviously gets stronger if there is sharing of intelligence, methodology, you know, mutual accountability.