Risky Business · Software Engineering & Infra · November 2026
Patrick asked where offensive AI frameworks and harnesses are heading after discussing the Google report on agentic threat activity. Jason, the new CISO at an AI-safety nonprofit, predicts more stealth and many attacks run at once.
…the credentials out? Or was there like, you know, a 48, 72 hour 100 million token effort to extract this? That's the thing I would really like to know is just how, you know, how many steps did it have to go through to get to these credentials is the bit that's kind of missing from these stories.
…safety and whatever, but this is like really about harness engineering because like the model, it doesn't really matter what model you're using with these things. But what are your thoughts on where all of this is going with these types of harnesses slash agents like Artex and CAN and Antifox?
So I think that where it's headed next is, you know, an increase in parallelization and increase in stealth, right? And so absolutely makes sense that the first thing the model would do is start password spraying because why not? But the problem with that is it's very, very noisy. And so, you know, I think what we're going to see is we're going to see, you know, it evolve really in a few different ways of one of, you know, James Wilson sitting there watching it and the thing blows 24 hours on solving a CAPTCHA when it could have just said, hey, James Wilson hit a CAPTCHA, like solve the CAPTCHA. Human do a human thing. You know, and you see this out of models all the time where they're like, oh, well, I couldn't access this website because it was denied. So rather than asking you to do it, you know, I searched the web for 50 other things and blew through, you know, 10,000 more tokens instead of just saying like, hey, can you like download this into a PDF and attach it? So I think there'll be improvements there. And I think that there will be improvements in, you know, essentially focusing on the stealthy methods first and only getting noisy when you really have to. And then the other thing, and I think we're going to, you know, see this later on in the show as we move on in the news, is, you know, right…
Yeah. Speaking of the White House, it's super intelligence task force, its SI task force. It's asking regulators and whatnot in the US to go a bit easy on companies that have been owned as a result of like autonomous hacks because everyone's getting owned basically and sort of singling out and…
Yeah. And that's the thing is that, you know, I think right now saying, hey, we don't like, we're a little off the map. Lot of our best practices or some of our best practices aren't holding anymore. And so we need time to adjust. And what was reasonable and prudent six months ago isn't now. That's…
Now, last week, I said that people should grab Artex, run it against their own stuff, to which James and Chris Krebs both said, whoa, Pat, maybe check with your lawyers first because these things can go off the rails. I actually think the White House should similarly indicate that unless you've…