What is a capsule?
A capsule is one question, locked so it can never change, plus every answer any model has ever given to it.
That locking is the whole point. If the question stays exactly the same, then an answer from today and an answer from next year can be compared honestly — the difference comes from the model getting better or worse, not from you having reworded the question along the way.
Full size The one thing to know before you start
A capsule stays editable until you run it for the first time. That first run seals the question, the files attached to it, and your checklist — for good. Nothing can unlock them afterwards.
You can still rename it, recategorise it, edit your notes and change who can see it. But if you want to try a different wording, make a new capsule: that way you keep both, and you can compare them.
Create your first capsule
On your dashboard, click New Capsule. Only a title and a question are required — but the optional fields are what turn a one-off test into something worth re-running in a year.
Full size Title
The name you will recognise it by. You can change it whenever you like.
Prompt
Locked on first runThe exact question every model will be asked. This is the part that gets frozen, so it is the part worth taking time over.
Category
Helps people find your capsule if you make it public. Optional, and changeable later.
Visibility
Private capsules are yours alone. Public ones show up in Explore and can be read by anyone. You can switch either way at any time.
Attachments
Locked on first runUp to 3 PDFs or images, 10 MB each, sent to every model along with your prompt — handy for "summarise this report" style questions.
Expected markers
Locked on first runWords or phrases a good answer should contain. If an answer misses them, the run gets a small warning so you can spot it at a glance. You decide whether all of them are required, or just one.
Writing a question worth locking
The best questions are the ones models answer differently. If they all say the same thing, you learn nothing. Be strict about the shape of the answer you want — ending with something like Answer with a JSON list and nothing else. gives you results you can actually line up next to each other. And note down what a right answer must mention: those become your checklist.
The two kinds of capsule
Most capsules are chat capsules: you ask, the model answers, you compare answers. An agentic capsule is a different exercise — instead of answering, each model actually goes off and builds the thing you described. You pick which kind at creation, and it cannot be changed later.
| Chat | Agentic | |
|---|---|---|
| You give it | A question | A job to do |
| The model gives back | An answer, or an image | Working files — a page, an app, a game |
| How long | Seconds to a few minutes | Half an hour or more |
| What it costs | Only the model | The model, plus the machine it works on |
| Who can use it | Everyone | Invited accounts only, for now |
Agentic capsules are still invitation-only
If you do not see a Chat / Agentic choice when you create a capsule, that is why — they are open to a small group while we make sure they are safe and predictable. Everything else on this page works for everyone.
Run it against a model
You use your own OpenRouter account, which you connect once in Settings. That gives you hundreds of models — the big names and the open-source ones — and you pay them directly, at their price, with nothing added on top.
Full size The request goes straight from your browser to the model. Nothing passes through us, which is good for your privacy — and worth knowing for one practical reason: the run lives in your open tab. You will see the answer appear as it is written, and a model that genuinely needs six minutes to think will get them.
Four things you can adjust
Thinking
Some models can reason through a problem before answering. You choose how hard they think, from a light pass to an exhaustive one — deeper thinking usually means better answers, more time, and a bigger bill. You can also let the model think privately and only keep its final answer.
Web search
Lets the model look things up online before answering, which matters for anything recent. It costs a little extra, and the result card tells you whether the model really searched or just answered from memory.
Canvas
Ask for a working web page instead of text. You can then open what each model built and click through it — the fastest way to see the gap between two models on the same brief. Nothing runs until you press play.
Answer length
A ceiling on how long the answer may be. Leave it on Auto for normal questions; raise it for long documents or code. A cut-off answer almost always means this was set too low, and you can pick your own default in Settings.
If you close the tab by accident
Your run will not vanish. We warn you before you leave while one is still running, and if it does get interrupted you come back to a clear interrupted card with a Retry button — never a blank result pretending everything went fine.
Agentic capsules
Here you are not asking a question, you are handing out a job: build me a page that does this. Several models take it on at the same time, each on its own, and you get back what they actually built. This one does not live in your tab — close it, come back an hour later, the work carries on without you.
Two ways to give the job
From scratch
Just your brief. The model builds from nothing — a page, a small app, a game — and you can open the result and use it right there.
On an existing project
Not ready yetPoint at a public GitHub project and ask for a change — modernise it, refactor it, make the tests pass. The form lets you set this up, but the runs themselves are not switched on yet, so a capsule made this way cannot be run for now.
What happens once you start
It gets a workspace
Each model receives its own private machine, walled off from everything else.
It works on its own
It reads, writes files and runs commands, checking its own work, until it decides the job is done. Every model gets the same tools, so the only thing being compared is the model.
The result is kept
Every file it made is saved, along with a full log of what it did and how long it took.
The workspace is destroyed
Nothing is left running once the job is over.
You are never left without a brake
A model working on its own for half an hour can waste a lot of money if it goes wrong. Five limits stop that happening:
- A spending limit per model, set before you start: $1, $3, or your own figure (minimum $0.50). Work stops when the limit is reached.
- A hard stop after 2 hours, whatever happens.
- If a model goes quiet for 20 minutes, the job is ended rather than left to burn through the clock. The card warns you long before that.
- A Stop button, so you can end a job the moment you see it going nowhere.
- One comparison at a time: as many models as you like on one capsule, but not two capsules at once.
What you get back
Full size Preview shows the finished thing, working. Code lets you read every file. Reasoning replays what the model did, step by step. And the download button packages the lot into a zip, so you can carry on from where the model stopped.
An External label means the result pulls something off the internet to work — a font, an icon set. It is a note, not a failure.
Understand your results
Every run is kept with far more than its answer. Months later, that is what lets you say why a model improved — it got cheaper, it got faster, or the provider quietly swapped it for a newer version.
Full size What gets recorded
- What it cost you, down to the fraction of a cent
- How long it took to start answering, and how fast it wrote
- How much text went in and came out
- Which exact version of the model answered — providers update them silently
- Whether the answer finished properly or was cut off
When a result is flagged
A model answering is not the same as a model answering well. We mark a run as worth a second look when:
- It was cut off before finishing
- It was blocked by the provider’s safety filter
- The model declined to answer
- It got stuck repeating itself
- It missed the checklist you set on the capsule
What you can do with a result
If an answer was cut off, you can ask the model to carry on from where it stopped, or run it again with more room — which gives you a fresh result and leaves the original untouched. Results you would rather not count can be archived: they leave your timeline and your averages, but they are never deleted behind your back.
Compare models
Tick Compare on two or more results and open the Compare Studio. Speed, price and length line up as bars, so the trade-off is obvious at a glance.
Full size When you compare exactly two answers, you can highlight what changed between them, word by word — the quickest way to see whether a new model really said something different or just reshuffled the same points.
Full size The same model, over time
Compare History pulls together every run of one model on this capsule, so you can watch it drift across months — which is the reason this whole thing exists.
Taking it away
Export the comparison as a web page to read or send to someone, or as a text file if you want to hand the whole thing to another AI for a second opinion.
One thing we deliberately do not do: crown a winner. Numbers alone cannot tell a good answer from a fast refusal — a model that replies "I can't help with that" in one second would win on speed every time. You get the figures and the answers side by side; the judgement stays yours.
Keys and privacy
Your OpenRouter key
Your questions go from your browser straight to the model — they never travel through our servers, and we never see them. Your key is stored in your browser and saved to your account so it follows you between devices. It is scrambled rather than protected by a password only you know, so treat it the way you would any key saved in a website: give it a spending limit on OpenRouter, and replace it if you ever stop trusting the computer you saved it on.
Never put a password or key inside a question
A question is sent to every model and locked forever — and if the capsule is public, anyone can read it. When your question needs a key, save it in Settings and drop in a placeholder instead, like {{SECRET:MY_KEY}}. Only the placeholder is stored; the real key is filled in at the last moment, and only for the websites you allowed it to reach.
Paste something that looks like a real key and we will spot it and offer to swap it for a placeholder in one click, before it can be saved.
Full size What "public" really means
Making a capsule public shows everyone its title, its question, your notes and all its results — answers, costs and speeds included. Search engines can find it too. Files attached to a private capsule stay private. You can go back to private at any moment, even after the capsule is locked.
Want to see one first?
Have a look at what other people have locked away. No account needed.