Main Street Bench

Main Street Bench v0.14 — meta/muse-spark-open medium Muse Spark Open

Score: 0 / 100

Regraded without the harmful-advice check, as every other run on the board was graded; first graded 0, with $2,000 taken off for advice that would destroy something. The model's work is unchanged.

Protected $38,300 of the $100,000 at risk. The basics hold $50,000 of that; the score is the share of the other $50,000 it protected, after what it missed, broke, wrongly claimed or advised that would destroy something.

Fixed 33 of 100 problems: 23 of the 35 basics and 10 of the other 65 (9 checked by code, 1 by the judge). Broke 1 thing that worked.

Scorecard // run 3Score · $ for the run

Run 3Muse Spark Open Medium Meta0$8.25
AreaFixed
Menu, prices and allergens2/4
Website and ordering2/16
Money and books0/18
Policies and legal5/11
Customers and inbox1/16

By how hard they were to spot: Obvious 0/2, Digging 4/27, Hidden 6/36

The basics23 of 35 fixed; the misses cost $12,200
The other 6510 fixed, $10,000 of $50,000 caught
What it brokecorrect details changed: 1, costing $250
Said it fixed something, but didn't3, costing $9,250
Advised a step that would destroy somethingnot judged
Judgegrok-4.7 (high) via Cursor
Model the tool reportedmeta/muse-spark-open
Tool profileclean: the person's sign-in, none of their own settings
Integrityclean
Run time30 min 0 s
Tokens burned3.80M (13.0K output)
Speed7 output tokens per second
Cost$8.25, billed by OpenRouter

Run 2026-10-15-meta-muse-spark-open-medium-v0.14-03 from commit 96543ef on 2026-10-15.

47 runsEach run’s scorecard

  1. Claude Opus 5.581 out of 100Run 1 10 min · $2.50Scorecard
  2. Claude Opus 5.574 out of 100Run 2 8 min · $2.31Scorecard
  3. Claude Opus 5.571 out of 100Run 3 12 min · $2.78Scorecard
  4. GPT-6.1 Sol69 out of 100Run 1 16 min · ~$0.70Scorecard
  5. GPT-6.1 Sol75 out of 100Run 2 15 min · ~$0.77Scorecard
  6. GPT-6.1 Sol72 out of 100Run 3 12 min · ~$0.63Scorecard
  7. GPT-6 Astra55 out of 100Run 1 12 min · ~$3.52Scorecard
  8. GPT-6 Astra80 out of 100Run 2 13 min · ~$3.99Scorecard
  9. GPT-6 Astra79 out of 100Run 3 12 min · ~$3.38Scorecard
  10. Kimi K3.1 Pro61 out of 100Run 1 14 min · $1.98Scorecard
  11. Kimi K3.1 Pro51 out of 100Run 2 13 min · $2.85Scorecard
  12. Kimi K3.1 Pro58 out of 100Run 3 13 min · $2.08Scorecard
  13. Gemini 4 Argon56 out of 100Run 1 14 min · ~$4.17Scorecard
  14. Gemini 4 Argon50 out of 100Run 2 10 min · ~$2.36Scorecard
  15. Gemini 4 Argon58 out of 100Run 3 16 min · ~$4.02Scorecard
  16. DeepSeek V4.1 Flash 101727 out of 100Run 1 13 min · $0.22Scorecard
  17. DeepSeek V4.1 Flash 101750 out of 100Run 2 18 min · $0.19Scorecard
  18. DeepSeek V4.1 Flash 101771 out of 100Run 3 16 min · $0.13Scorecard
  19. Claude Sonnet 5.564 out of 100Run 1 8 min · $1.52Scorecard
  20. Claude Sonnet 5.522 out of 100Run 2 8 min · $1.53Scorecard
  21. Claude Sonnet 5.562 out of 100Run 3 8 min · $1.72Scorecard
  22. Grok 4.746 out of 100Run 1 18 min · ~$3.32Scorecard
  23. Grok 4.746 out of 100Run 2 19 min · —Scorecard
  24. Grok 4.753 out of 100Run 3 20 min · ~$3.28Scorecard
  25. Muse Wonder49 out of 100Run 1 7 min · ~$3.45Scorecard
  26. Muse Wonder45 out of 100Run 2 6 min · ~$2.76Scorecard
  27. Muse Wonder35 out of 100Run 3 30 min · ~$2.34Scorecard
  28. Muse Wonder0 out of 100Run 4 38 min · ~$2.07Scorecard
  29. GLM 5.329 out of 100Run 1 8 min · ~$2.15Scorecard
  30. GLM 5.328 out of 100Run 2 18 min · ~$1.29Scorecard
  31. GLM 5.317 out of 100Run 3 19 min · ~$1.95Scorecard
  32. GPT-6.1 Terra23 out of 100Run 1 2 min · ~$0.14Scorecard
  33. GPT-6.1 Terra29 out of 100Run 2 2 min · ~$0.15Scorecard
  34. GPT-6.1 Terra20 out of 100Run 3 2 min · ~$0.14Scorecard
  35. Gemini 3.8 Flash14 out of 100Run 1 11 min · ~$1.19Scorecard
  36. Gemini 3.8 Flash15 out of 100Run 2 9 min · ~$1.06Scorecard
  37. Gemini 3.8 Flash21 out of 100Run 3 10 min · ~$1.23Scorecard
  38. Kimi K30 out of 100Run 1 4 min · ~$2.60Scorecard
  39. Kimi K334 out of 100Run 2 21 min · ~$1.46Scorecard
  40. Kimi K331 out of 100Run 3 21 min · ~$1.45Scorecard
  41. DeepSeek V4.1 Flash6 out of 100Run 1 3 min · ~$0.25Scorecard
  42. DeepSeek V4.1 Flash9 out of 100Run 2 4 min · ~$0.13Scorecard
  43. DeepSeek V4.1 Flash16 out of 100Run 3 8 min · ~$0.28Scorecard
  44. Muse Spark Open17 out of 100Run 1 17 min · $2.47Scorecard
  45. Muse Spark Open0 out of 100Run 2 30 min · $2.78Scorecard
  46. Muse Spark Open0 out of 100Run 3 30 min · $8.25This scorecard
  47. Muse Spark Open0 out of 100Run 4 28 min · $3.54Scorecard