a16z Podcast · Startups & Venture · November 2026
Asked where his research intuition comes from and when a machine could replicate it, Schulman said much of it comes from personal experience: AI has the knowledge but not the experience of being wrong.
…just go and carry it out. And then there's taste, which is kind of how you come up with the idea in the first place. The models are still not phenomenally good at taste. They go very deep into things like hyperparameter optimization, essentially like tuning all the little knobs that you can tune.
Even in that example that you shared, the points where you were kind of nudging, redirecting AI, right, that's still coming from you. And I guess my question is, where does your intuition come from? And at what point do you think a machine could replicate that?
A lot of intuition just comes from my personal experience doing research. But to get good at a certain research field, you also have to read a lot of the past work in that field and you try to absorb the lessons from all this historical work. A lot of the things that I just described can also be done by AI. Like AI can read all the literature and never mind at all. Yeah, memorization can be a blessing and a curse. Yeah, you don't have the experience of being wrong or of making predictions and then seeing how they fared. So I think there's some ways in which the way we train AI might make them worse at some of these capabilities, but it's a little hard to say.
What John is getting at is essentially the difference between knowledge and experience.
Companies will probably also just do RL from human feedback to collect data from researchers on like which proposed ideas are good. And that's kind of like absorbing whatever human intuitions like the human researchers have developed and trying to like bake that into the models.
Creating automated AI researchers also requires us to have reliable ways to know that their work is producing better models. The measurement itself is important for hill climbing to make tangible improvement. You know, a researcher is by definition, you know, it's more open-ended than solving a…