“Let's say you have a neuron that fires on clothing, it fires on exercise equipment, and it fires on dishes and on tablecloths. That seems very polysemantic, right? But what if the concept that the model has is things you might find at a garage sale? Then suddenly those things are unified, but you might never see it from the outside.”

They can vary widely between neurons. We see neurons doing so many different things. As you said, sometimes they'll contain multiple ideas, like this neuron will activate, you know, on oral health and marine environments, usually on the point at which someone decides to get oral surgery or at the point at which a specific animal in the marine environment was described. The description will read something like this. Most neurons do have something of a central concept that unifies them. But as I've looked at, you know, thousands of neuron descriptions and what they actually tend to represent, I think I've come to a somewhat different philosophical perception of things than simple monosemanticity or polysemanticity. So like monosemanticity or just like semanticity in general is this idea that a neuron or something else like a feature represents a single thing, a single concept. It's just detecting whether that's there. But in practice, I think it ends up much more complex. So each neuron can connect to thousands of other neurons upstream. And that provides a lot of information to this neuron. One thing that you might…