Ilia Karelin
Former tennis pro turned AI builder.
“I can send something really random, like say something like, again, hi or something at the end when I'm still thinking about what to say. And that resets the timer again. And I feel like it allows me to prolong my sessions and extend my usage limits much, much more.”
The AI Maker · AI Builders · November 2026
Context
A host asked him to explain the cache-timer mod he built. He said the model re-reads the whole session on each prompt and the cache holds it only for a limited time, so a visible countdown lets him send a throwaway message to keep it warm and stretch his usage limits.
Transcript
Yeah, and then the cache timer starts right here. So obviously, five minutes, that's like the two biggest one, five minutes, and then one hour.
Sorry, can you explain? Can you explain again for people who don't know the cache timer, how does it work and why is it method?
Okay, so I believe the way it was the reason why cache even exists, I think is because the way models work is that it has to read your whole session from top to the bottom every time you. Send out the send out the prompt. And so the cache existing is that essentially the model is going to hold for five minutes that all the context that you have before it drops it. And so that's why. And I think for the latest models, they made it super cheap. I think it's like 90% off for every prompt essentially. So that's why I thought it would have been important for me to have a cache timer for five minutes in one hour. And so that's why, like, if I have all the tasks, like, let's say, so this little line right here is going to start turning red when it's, you know, 10, 15 seconds last one. And so I can send something really random, like say something like, again, hi or something at the end when I'm still thinking about what to say. And so, and that resets the timer again. And I feel like it allows me to prolong my sessions and extend my usage limits much, much…
Right. So and it in it and it also affects the speed of the respond as well, right? Because then if the cache is still there, then ideally the agent can understand better the current context and then not and not to reset the context again and then reread them again, right?
Yeah. And then here on the right side of this, I have just a little five-hour little circle right here. Basically, it shows me, you know, how close I am to my hitting my limits for the five-hour limit. And then seven-day one
is just the same. Got it. So little. Okay, so basically, like if you don't have this mod, then actually you need to click the usage on the settings, right? But since you already have this mod, then you can show it on your screen on top of the chat section. And then so you can monitor where you are…
More from The AI Maker
