Ho is describing a technique for predicting what a model will learn from a dataset before it trains on it. Data points are clustered by what they would teach the model, and the unwanted clusters are removed.
That's right. Yeah. We want to give gradient descent a choice.
So what's the current state of this? Is intentional design something that you're working on and that's like the next like whatever, one, two, three years of research or is it something that's working today? Like what's the state of the art?
…what your model will learn from a data set before the model even trains on it? And then what ends up working best is some type, this type of clustering technique where you can cluster data points according to what they will teach the model. And you can then just remove the data that you don't want. So we're able to find pockets of data in these public data sets that were quite surprising. Like one of these pockets of data was physics sycophancy. Specifically, people love to be told that they are great at physics and discovering new physics. I think there was some guy out on Twitter like two years ago saying like, I'm out here discovering new physics. Like it's for guys like that. And models have figured out that people love that. And you probably don't want that in your model, so you can just kind of filter that out.
Great. We've been talking about Goodfire as a research lab, but you're not just a research lab, you're a commercial enterprise, venture-backed. So how does the business side of the company work? You launch a product called Silico. What does that do? And who do you sell it to?
Well, Silico, in short, is our interpretability agent. It can do things like really quickly train a probe to monitor your model. And so we use Silico as our way to move really, really quickly and essentially help with activation monitoring, training other types of interpreter models that reverse…
And you seem to have a number of customers in biology as well, Arc Institute, Mayo Clinique. Primamente. What's the use case there?