MS

Mona Sarantakos

Things Mona Says on Podcasts

Where to Find Them

Mona Sarantakos has been a guest on Lenny's Newsletter and Lenny's Podcast: Product | Career | Growth .

Recently: “Meta’s Muse: How we launched the most successful consumer product this year | Mona Sarantakos” on Lenny's Podcast: Product | Career | Growth (November 2026); “Meta’s Muse: How we launched the most successful consumer product this year | Mona Sarantakos” on Lenny's Newsletter (November 2026).

What They Said

“I did not think shopping was going to be as big of a use case as it's become. … I predicted personal productivity, health and personal finance were the three I was pretty focused on. … Then we started to see shopping pop up a lot more with our dogfooders, and it was a complete surprise. All of our evals had been over here, and we actually needed to focus on shopping… now shopping is one of our top use cases.” — Mona Sarantakos, Lenny's Podcast: Product | Career | Growth

Asked how the Muse team handled unexpected use cases, Sarantakos says the big surprise was shopping, which they had not built evals for. It is an early data point on agentic commerce from a mass-market assistant.

Lenny's Podcast: Product | Career | Growth · 2026-11-15 Permalink → Listen →
Lenny's Podcast: Product | Career | Growth Around 30:40 into the episode
Mona Sarantakos

…but so we spent a lot of time talking about use cases and what we would like talk about was our own personal use case and because we had you know people testing both and we had this like very long uh ux our panel that we started very early on actually that ux panel started i think in march and

Lenny Rachitsky

this was internal people or external

Mona Sarantakos

external so we had external people um that we had recruited we also had the internal people obviously using it and we would and the internal people we have a forum i don't know if you you're familiar we have workplace right and it's basically like facebook groups for internal and people post in there right and so we had a feedback group for uh for muse so between those things we were getting all of this feedback about what people were doing and how like what they were using it for and we would bring it to mark and matt and alex almost on a weekly basis and like kind of obsess over it right and we were like here's what like you know here's all the stories that we've heard this is what people found magic in what didn't find magic in all of that sort of stuff and so it actually was kind of nice because yes you're always going to get like someone's like oh i have the mma story or whatever but because we were kind of like rooting everybody in these like real life experiences um it never like we didn't actually get thrashed on that front what did happen was there were like surprises so uh i did not think shopping was going to be as big of a use case as it's become like i would not have predicted…

Lenny Rachitsky

i heard there's an engineer on the team who loves shopping

Mona Sarantakos

yeah christina wad she is the head of engineer so she's the so we've got tarek who is our uh kind of our tech lead or core architect and then christine who's our engineering manager um and i uh i am terrified about how much money she spent through museum she is she is like it's so funny because…

Lenny Rachitsky

perspective on shopping versus I don't know how much time you spend thinking about this but there's it's such a new world that is emerging uh in so many ways but one is this idea of how we shop and how we find stuff just you know like the world like retail has been built around we'll market to you…

Speaker names come from our own diarization. The position is estimated from where the line sits in the episode.
“There's actually been this funny trend recently where our system prompt has to be handwritten. You cannot use an AI to write a system prompt, any part of it. It must be handwritten. … The behavioral spec needs to be handwritten. We use agents a lot, but there's a lot of personal time and effort that goes into this sort of thing.” — Mona Sarantakos, Lenny's Podcast: Product | Career | Growth

Asked how many evals Muse has and who writes them, Sarantakos says agents help build the evals, but the system prompt and behavioral spec are written by people, because skipping human review always caused problems.

Lenny's Podcast: Product | Career | Growth · 2026-11-15 Permalink → Listen →
Lenny's Podcast: Product | Career | Growth Around 41:40 into the episode
Mona Sarantakos

Yeah.

Lenny Rachitsky

…to hear a bit more about the evals. So the way I think about it is you just kind of have these evals that define success for all the core use cases and ways you expect people to use Muse. How many evals do you have roughly? And who's writing these generally? Is it you? Is it PMs? Is it engineers?

Mona Sarantakos

Yeah. We have a ton. I couldn't even count the number of overheads. For sure. Like, so the way that it, so there's major evals, priority evals that we look at. And those tend to be like kind of core. It's like, you know, there's some like, if these don't exist, the product isn't working. Safety is an example of that. Right. So we have like evals for prompt injection. We have evals for general safety for, you know, harm, like all of these kinds of things. So like that's like a whole category. We have a capability, you know, we have capabilities versions of evals. You know, how can like, is it using the browser well? Is it able to, you know, task complete? And then you have like behavioral evals, which is really about the personality of the agent and, you know, how it behaves with the user. Right. And in there, you know, you've got like, is it asking follow-up questions? Is it, you know, how good is it at intent understanding? Right. Can it like figure out what the user is saying? And then you've got your use case evals, like that kind of category, right? Of the priority use cases. And so, and each of these have…

Lenny Rachitsky

Okay. This season's supporting sponsor is DX. Now that everybody at your company is finally using AI, the question that engineering leaders face is no longer, are we using AI, but is it paying off? With DX, you can measure and benchmark the impact of AI adoption across your full product lifecycle.…

Mona Sarantakos

I mean, this is the number one problem that we have. People are like, why? I already have a chat bot. Like, I don't get it. Why do I need another one? So the most effective lever out there is word of mouth. It's like basically hearing other people's stories. Like that is number one. I was with a…

Lenny Rachitsky

there kind of a non-obvious decision that y'all made that you made in the development of Muse that now feels like a very key part of its success? Well,

Speaker names come from our own diarization. The position is estimated from where the line sits in the episode.
“I still think there's a lot of babysitting of agents. You spend a lot of time… it's like the Tamagotchi. You're trying to feed it and you're trying to make sure that it's okay. … That's an area I care a lot about, because at the point where I'm babysitting an agent, I might as well do it myself. And that is a bad place to be.” — Mona Sarantakos, Lenny's Podcast: Product | Career | Growth

Asked where Meta's Muse agent goes next, Sarantakos names the capability she cares about most: an agent that can intuit what you want and act on its own instead of needing supervision.

Lenny's Podcast: Product | Career | Growth · 2026-11-15 Permalink → Listen →
Lenny's Podcast: Product | Career | Growth Around 1:16:15 into the episode
Mona Sarantakos

…guardrails and evals, but like, it's just going to figure it out, right? It's wild. But, but I think that's what's also so special. No two muses are really the same, right? Like the way that your muse talks to you is going to be really different than the way that it talks to me and what it does.

Lenny Rachitsky

…a final question, what's next? Where are things going? What's kind of the vision of where this heads? I know there's like a charm launching at some point, if that's what it's called, a little device. What's kind of ahead for Muse? How different may it look in the future? What's kind of the vision?

Mona Sarantakos

Well, I think one is, I mean, to the point of the charm and other devices, like, I think that Muse is obviously going to, I think if you really want personal super intelligence everywhere with you, it has to become very ambient, right? And so like right now it's sort of trapped in an app, but I think soon it should be in your glasses on your charm devices, whatever that might be, right? And I think, so like, you know, it's like, I think this idea of an agent sort of being beyond an app and being in your world is going to be quite important. I think figuring like the democratization of this is going to be quite important, right? Like that whole idea, I mean, we're like, when you're, when you work at Meta, you really think about like this idea that everybody could have a product. And so figuring out how to make that scale and affordable so that, you know, it can become an equalizer in some ways. I think that's really important for me. And then like a really small thing, like I, just from a capability perspective, like I still think that like there's a lot of babysitting of agents, right? Like you spend a lot of…

Lenny Rachitsky

What a time to be alive. I know.

Mona Sarantakos

It's crazy. It's crazy.

Lenny Rachitsky

It's so crazy.

Speaker names come from our own diarization. The position is estimated from where the line sits in the episode.
“Our system prompt has to be handwritten. You cannot use an AI to write a system prompt, any part of it. It must be handwritten. The evals, the prompt distribution needs to be checked, because you have to make sure this matches what the product reality is. The behavioral spec needs to be handwritten.” — Mona Sarantakos, Lenny's Newsletter

Lenny asked how many evals the Muse team has and who writes them. Mona says agents help with a lot of the work. But a person has to write the core specs and check the data by hand.

Lenny's Newsletter · 2026-11-15 Permalink → Listen →
Lenny's Newsletter
Mona Sarantakos

Yeah.

Lenny Rachitsky

…to hear a bit more about the evals. So the way I think about it is you just kind of have these evals that define success for all the core use cases and ways you expect people to use Muse. How many evals do you have roughly? And who's writing these generally? Is it you? Is it PMs? Is it engineers?

Mona Sarantakos

Yeah. We have a ton. I couldn't even count the number of overheads. For sure. Like, so the way that it, so there's major evals, priority evals that we look at. And those tend to be like kind of core. It's like, you know, there's some like, if these don't exist, the product isn't working. Safety is an example of that. Right. So we have like evals for prompt injection. We have evals for general safety for, you know, harm, like all of these kinds of things. So like that's like a whole category. We have a capability, you know, we have capabilities versions of evals. You know, how can like, is it using the browser well? Is it able to, you know, task complete? And then you have like behavioral evals, which is really about the personality of the agent and, you know, how it behaves with the user. Right. And in there, you know, you've got like, is it asking follow-up questions? Is it, you know, how good is it at intent understanding? Right. Can it like figure out what the user is saying? And then you've got your use case evals, like that kind of category, right? Of the priority use cases.…

Lenny Rachitsky

Okay. This season's supporting sponsor is DX. Now that everybody at your company is finally using AI, the question that engineering leaders face is no longer, are we using AI, but is it paying off? With DX, you can measure and benchmark the impact of AI adoption across your full product lifecycle.…

Mona Sarantakos

I mean, this is the number one problem that we have. People are like, why? I already have a chat bot. Like, I don't get it. Why do I need another one? So the most effective lever out there is word of mouth. It's like basically hearing other people's stories. Like that is number one. I was with a…

Lenny Rachitsky

there kind of a non-obvious decision that y'all made that you made in the development of Muse that now feels like a very key part of its success? Well,

Speaker names come from our own diarization. The position is estimated from where the line sits in the episode.
“I still think that there's a lot of babysitting of agents. It's like the Tamagotchi. You're trying to feed it and you're trying to make sure that it's okay, and it has all the context, and it's checking in with you a lot. … At the point where I'm babysitting an agent, I might as well do it myself. And that is a bad place to be.” — Mona Sarantakos, Lenny's Newsletter

Lenny asked where Meta's Muse assistant is heading. After describing ambient agents in glasses and other devices, Mona names the gap she most wants closed: agents that need constant supervision.

Lenny's Newsletter · 2026-11-15 Permalink → Listen →
Lenny's Newsletter
Mona Sarantakos

…guardrails and evals, but like, it's just going to figure it out, right? It's wild. But, but I think that's what's also so special. No two muses are really the same, right? Like the way that your muse talks to you is going to be really different than the way that it talks to me and what it does.

Lenny Rachitsky

…a final question, what's next? Where are things going? What's kind of the vision of where this heads? I know there's like a charm launching at some point, if that's what it's called, a little device. What's kind of ahead for Muse? How different may it look in the future? What's kind of the vision?

Mona Sarantakos

Well, I think one is, I mean, to the point of the charm and other devices, like, I think that Muse is obviously going to, I think if you really want personal super intelligence everywhere with you, it has to become very ambient, right? And so like right now it's sort of trapped in an app, but I think soon it should be in your glasses on your charm devices, whatever that might be, right? And I think, so like, you know, it's like, I think this idea of an agent sort of being beyond an app and being in your world is going to be quite important. I think figuring like the democratization of this is going to be quite important, right? Like that whole idea, I mean, we're like, when you're, when you work at Meta, you really think about like this idea that everybody could have a product. And so figuring out how to make that scale and affordable so that, you know, it can become an equalizer in some ways. I think that's really important for me. And then like a really small thing, like I, just from a capability perspective, like I still think that like there's a lot of babysitting of agents, right? Like you spend a lot of…

Lenny Rachitsky

What a time to be alive. I know.

Mona Sarantakos

It's crazy. It's crazy.

Lenny Rachitsky

It's so crazy.

Speaker names come from our own diarization. The position is estimated from where the line sits in the episode.

Collections They Appear In