⏱ Capsule Public Content Creation

Mirror Torture Test

Ezarwebmaster· Jul 3, 2026

Brief

## Why This Capsule Exists Most image benchmarks test one thing at a time: counting, text rendering, or spatial reasoning. Real-world image generation fails happen when **multiple constraints compete for the model's attention simultaneously** — which is exactly what happens in production use cases. This capsule stacks 8 independent, objectively verifiable constraints into a single prompt to reveal how models handle compounded instruction-following pressure. ## What This Tests | Constraint | Capability Probed | |---|---| | Clock reads exactly 10:08 | Precise analog time rendering (a known weak spot across model generations) | | Glove on right hand only, left hand bare | Asymmetric instruction-following (resisting the default "matching pair" bias) | | Bare hand shows exactly 4 fingers | Exact small-number generation on body parts | | Mirror reflection matches reality (correct flip) | Geometric/spatial reasoning, not just pattern repetition | | Exactly 7 apples | Object counting accuracy at small scale | | Exactly 1 green apple | Basic attribute assignment (color) | | Sign reads "NO PHOTOS ALLOWED" | Legible text rendering without duplication/glitches | | No windows in the room | Negation handling (ignoring implied defaults) | ## Expected Results - **No model is expected to pass all 8 criteria.** A perfect score would be a signal to add harder constraints, not evidence the benchmark has failed. - **Weakest points across the board:** exact clock time and exact object counts — these fail even on otherwise photorealistic, high-quality outputs, showing that visual fidelity and instruction accuracy are separate capabilities. - **The mirror consistency check is the strongest signal for genuine spatial reasoning.** Models that just repeat the face without correctly flipping the glove side are pattern-matching "mirror = duplicate person," not simulating reflection physics. - **Asymmetric instructions (one gloved hand, one bare) are frequently collapsed into symmetric defaults** — this is a good proxy for how well a model resists its own training priors when they conflict with the prompt. ## How to Read a Run Score each run against the 8-point checklist below. Partial credit applies where an element is present but incorrect (e.g., wrong finger count, right time but wrong minute). This capsule is designed to produce **score dispersion across models and over time**, not a pass/fail verdict — the goal is watching the score trend upward as models improve, not expecting any single run to "win." ### Scoring Checklist - [ ] Clock shows exactly 10:08 - [ ] Glove on one hand only, other hand bare - [ ] Bare hand shows exactly 4 fingers - [ ] Mirror reflection is geometrically consistent (correct side flip) - [ ] Exactly 7 apples - [ ] Exactly 1 green apple - [ ] Sign text reads correctly, no duplication/glitches - [ ] No windows visible in the room

Locked Reference Prompt

IMMUTABLE

Scientific timeline lock active

A wooden analog clock on a brick wall showing exactly 10:08, hanging directly above a round mirror. In front of the mirror stands a woman with her back to the camera, wearing a red glove on her right hand only (left hand bare), holding up 4 fingers on her bare hand. The mirror reflection must show her face and confirm the glove is on her LEFT hand as seen in the mirror. On a table to the woman's right sit exactly 7 apples, one of them green, arranged in a single row — no apples stacked. A wooden sign on the wall reads "NO PHOTOS ALLOWED" in bold black letters. The room has no windows. Lighting comes from a single lamp on the left side of the frame, casting all shadows to the right.

Add a Benchmark Run

Sign in to run this prompt against hundreds of models with your own OpenRouter key and archive the results.

Timeline (11 runs)

Run Activity

11 runs in the last 6 months

Jan
Feb
Mar
Apr
May
Jun
Jul
LessMore

Cost vs Speed

size = output tokens · top-left is best

1001k10k$0.10fast · cheapfast · priceyslow · cheapslow · priceyCost per request ($, log)Speed (tokens/sec, log)
size = tokens7312.9k7.3k
value frontier — no model is faster & cheaper

Capsule Stats

Runs
11
Total cost
$1.3497
Tokens
45k
Avg latency
6.03 s
Models
11
Web Searches
0
Fastest openai/gpt-5.4-image-2-20260421550 ms
Cheapest google/gemini-3.1-flash-lite-image-20260630$0.0336
Top provider Google DeepMind×4
3k reasoning last 7d ago
Tip: Select 2 or more runs via their "Compare" buttons — or filter by company below and compare them all at once — then open the Compare Studio: verdicts, benchmark bars, charts, side-by-side reading and response diff.

Benchmark Run — Jul 4, 2026 Latest

Sourceful
Sourcefulriverflow-v2.5-pro-20260605
sourceful/riverflow-v2.5-proJul 4, 2026, 06:25:49 PM
stop
Latency
10.20 s
client → response
Input Tokens
183
prompt tokens
Output
4,175
generated
Total Tokens
4,358
in + out
Billed Cost
$0.1870
OR Credits
Reasoning
thinking tokens
Generated Image
Researcher Notes

Benchmark Run — Jul 4, 2026

Recraft
Recraftrecraft-v4-pro-20260413
recraft/recraft-v4-proJul 4, 2026, 06:23:39 PM
stop
Latency
10.30 s
client → response
Input Tokens
183
prompt tokens
Output
4,175
generated
Total Tokens
4,358
in + out
Billed Cost
$0.2500
OR Credits
Reasoning
thinking tokens
Generated Image
Researcher Notes

Benchmark Run — Jul 3, 2026

OpenAI
OpenAIgpt-5.4-image-2-20260421
openai/gpt-5.4-image-2Jul 3, 2026, 04:44:58 AM
stop
Latency
550 ms
client → response
Input Tokens
1,963
prompt tokens
Output
7,237
generated
Total Tokens
9,200
in + out
Billed Cost
$0.2296
OR Credits
Reasoning
thinking tokens
Generated Image
Researcher Notes

Benchmark Run — Jul 3, 2026

Black Forest Labs
Black Forest Labsflux.2-max
black-forest-labs/flux.2-maxJul 3, 2026, 04:44:32 AM
stop
Latency
10.21 s
client → response
Input Tokens
183
prompt tokens
Output
4,096
generated
Total Tokens
4,279
in + out
Billed Cost
$0.0700
OR Credits
Reasoning
thinking tokens
Generated Image
Researcher Notes

Benchmark Run — Jul 3, 2026

OpenAI
OpenAIgpt-5-image
openai/gpt-5-imageJul 3, 2026, 04:44:31 AM
stop
Latency
1.07 s
client → response
Input Tokens
3,724
prompt tokens
Output
7,308
generated
Total Tokens
11,032
in + out
Billed Cost
$0.2356
OR Credits
Reasoning
2,688
thinking tokens
Generated Image
Researcher Notes

Benchmark Run — Jul 3, 2026

Microsoft
Microsoftmai-image-2.5
microsoft/mai-image-2.5Jul 3, 2026, 04:43:33 AM
stop
Latency
10.26 s
client → response
Input Tokens
166
prompt tokens
Output
1,024
generated
Total Tokens
1,190
in + out
Billed Cost
$0.0490
OR Credits
Reasoning
thinking tokens
Generated Image
Researcher Notes

Benchmark Run — Jul 3, 2026

xAI (Grok)
xAI (Grok)grok-imagine-image-quality-20260512
x-ai/grok-imagine-image-qualityJul 3, 2026, 04:43:17 AM
stop
Latency
6.25 s
client → response
Input Tokens
183
prompt tokens
Output
4,175
generated
Total Tokens
4,358
in + out
Billed Cost
$0.0500
OR Credits
Reasoning
thinking tokens
Generated Image
Researcher Notes

Benchmark Run — Jul 3, 2026

Google DeepMind
Google DeepMindgemini-3-pro-image-20260528
google/gemini-3-pro-imageJul 3, 2026, 04:43:10 AM
stop
Latency
2.72 s
client → response
Input Tokens
179
prompt tokens
Output
1,577
generated
Total Tokens
1,756
in + out
Billed Cost
$0.1377
OR Credits
Reasoning
245
thinking tokens
Generated Image
Researcher Notes

Benchmark Run — Jul 3, 2026

Google DeepMind
Google DeepMindgemini-2.5-flash-image
google/gemini-2.5-flash-imageJul 3, 2026, 04:43:07 AM
stop
Latency
5.87 s
client → response
Input Tokens
178
prompt tokens
Output
1,290
generated
Total Tokens
1,468
in + out
Billed Cost
$0.0388
OR Credits
Reasoning
thinking tokens
Generated Image
Researcher Notes

Benchmark Run — Jul 3, 2026

Google DeepMind
Google DeepMindgemini-3.1-flash-image-20260528
google/gemini-3.1-flash-imageJul 3, 2026, 04:42:50 AM
stop
Latency
6.48 s
client → response
Input Tokens
179
prompt tokens
Output
1,487
generated
Total Tokens
1,666
in + out
Billed Cost
$0.0684
OR Credits
Reasoning
thinking tokens
Generated Image
Researcher Notes

Benchmark Run — Jul 3, 2026

Google DeepMind
Google DeepMindgemini-3.1-flash-lite-image-20260630
google/gemini-3.1-flash-lite-imageJul 3, 2026, 04:42:41 AM
stop
Latency
2.46 s
client → response
Input Tokens
178
prompt tokens
Output
1,120
generated
Total Tokens
1,298
in + out
Billed Cost
$0.0336
OR Credits
Reasoning
thinking tokens
Generated Image
Researcher Notes