Main Street Bench v0.14 — gpt-6.1-terra medium GPT-6.1 Terra
Score: 29 / 100
Protected $64,300 of the $100,000 at risk. The basics hold $50,000 of that; the score is the share of the other $50,000 it protected, after what it missed, broke, wrongly claimed or advised that would destroy something.
Fixed 48 of 100 problems: 28 of the 35 basics and 20 of the other 65 (20 checked by code, 0 by the judge). Broke 0 things that worked.
Scorecard // run 2Score · $ for the run
Run 2GPT-6.1 Terra Medium OpenAI29$0.15
| Area | Fixed |
|---|---|
| Menu, prices and allergens | 3/4 |
| Website and ordering | 2/16 |
| Money and books | 7/18 |
| Policies and legal | 4/11 |
| Customers and inbox | 4/16 |
By how hard they were to spot: Obvious 1/2, Digging 10/27, Hidden 9/36
| The basics | 28 of 35 fixed; the misses cost $2,450 |
|---|---|
| The other 65 | 20 fixed, $19,750 of $50,000 caught |
| What it broke | nothing |
| Said it fixed something, but didn't | 3, costing $3,000 |
| Advised a step that would destroy something | 0 |
| Judge | claude-sonnet-5-5 (high) |
| Model the tool reported | gpt-6.1-terra, gpt-6.1-terra (medium) |
| Tool profile | clean: the person's sign-in, none of their own settings |
| Integrity | clean |
| Run time | 1 min 57 s |
| Tokens burned | 861.5K (10.3K output) |
| Speed | 88 output tokens per second |
| Cost | $0.15, estimated from token counts at public API prices |
Run 2026-11-03-gpt-6.1-terra-medium-v0.14-02 from commit 7c22111 on 2026-11-03.
47 runsEach run’s scorecard
- Claude Opus 5.581 out of 100Run 1 10 min · $2.50Scorecard
- Claude Opus 5.574 out of 100Run 2 8 min · $2.31Scorecard
- Claude Opus 5.571 out of 100Run 3 12 min · $2.78Scorecard
- GPT-6.1 Sol69 out of 100Run 1 16 min · ~$0.70Scorecard
- GPT-6.1 Sol75 out of 100Run 2 15 min · ~$0.77Scorecard
- GPT-6.1 Sol72 out of 100Run 3 12 min · ~$0.63Scorecard
- GPT-6 Astra55 out of 100Run 1 12 min · ~$3.52Scorecard
- GPT-6 Astra80 out of 100Run 2 13 min · ~$3.99Scorecard
- GPT-6 Astra79 out of 100Run 3 12 min · ~$3.38Scorecard
- Kimi K3.1 Pro61 out of 100Run 1 14 min · $1.98Scorecard
- Kimi K3.1 Pro51 out of 100Run 2 13 min · $2.85Scorecard
- Kimi K3.1 Pro58 out of 100Run 3 13 min · $2.08Scorecard
- Gemini 4 Argon56 out of 100Run 1 14 min · ~$4.17Scorecard
- Gemini 4 Argon50 out of 100Run 2 10 min · ~$2.36Scorecard
- Gemini 4 Argon58 out of 100Run 3 16 min · ~$4.02Scorecard
- DeepSeek V4.1 Flash 101727 out of 100Run 1 13 min · $0.22Scorecard
- DeepSeek V4.1 Flash 101750 out of 100Run 2 18 min · $0.19Scorecard
- DeepSeek V4.1 Flash 101771 out of 100Run 3 16 min · $0.13Scorecard
- Claude Sonnet 5.564 out of 100Run 1 8 min · $1.52Scorecard
- Claude Sonnet 5.522 out of 100Run 2 8 min · $1.53Scorecard
- Claude Sonnet 5.562 out of 100Run 3 8 min · $1.72Scorecard
- Grok 4.746 out of 100Run 1 18 min · ~$3.32Scorecard
- Grok 4.746 out of 100Run 2 19 min · —Scorecard
- Grok 4.753 out of 100Run 3 20 min · ~$3.28Scorecard
- Muse Wonder49 out of 100Run 1 7 min · ~$3.45Scorecard
- Muse Wonder45 out of 100Run 2 6 min · ~$2.76Scorecard
- Muse Wonder35 out of 100Run 3 30 min · ~$2.34Scorecard
- Muse Wonder0 out of 100Run 4 38 min · ~$2.07Scorecard
- GLM 5.329 out of 100Run 1 8 min · ~$2.15Scorecard
- GLM 5.328 out of 100Run 2 18 min · ~$1.29Scorecard
- GLM 5.317 out of 100Run 3 19 min · ~$1.95Scorecard
- GPT-6.1 Terra23 out of 100Run 1 2 min · ~$0.14Scorecard
- GPT-6.1 Terra29 out of 100Run 2 2 min · ~$0.15This scorecard
- GPT-6.1 Terra20 out of 100Run 3 2 min · ~$0.14Scorecard
- Gemini 3.8 Flash14 out of 100Run 1 11 min · ~$1.19Scorecard
- Gemini 3.8 Flash15 out of 100Run 2 9 min · ~$1.06Scorecard
- Gemini 3.8 Flash21 out of 100Run 3 10 min · ~$1.23Scorecard
- Kimi K30 out of 100Run 1 4 min · ~$2.60Scorecard
- Kimi K334 out of 100Run 2 21 min · ~$1.46Scorecard
- Kimi K331 out of 100Run 3 21 min · ~$1.45Scorecard
- DeepSeek V4.1 Flash6 out of 100Run 1 3 min · ~$0.25Scorecard
- DeepSeek V4.1 Flash9 out of 100Run 2 4 min · ~$0.13Scorecard
- DeepSeek V4.1 Flash16 out of 100Run 3 8 min · ~$0.28Scorecard
- Muse Spark Open17 out of 100Run 1 17 min · $2.47Scorecard
- Muse Spark Open0 out of 100Run 2 30 min · $2.78Scorecard
- Muse Spark Open0 out of 100Run 3 30 min · $8.25Scorecard
- Muse Spark Open0 out of 100Run 4 28 min · $3.54Scorecard