Model scores by category.

Third-party leaderboard results, copied as published with the board, metric, harness, as-of date and source. We don't make our own score.

Boards checked · 409 results from 13 boards · 114 model pages

Code

Repository bug-fix and code-editing benchmarks (SWE-bench Verified, Aider polyglot).

Terminal-Bench 4.0
  1. GPT-6 Astra (xhigh)57.88%
  2. GPT-6 Astra (high)57.88%
  3. Fable 5.1 (xhigh)57.88%

as of 2026-09-03 · Accuracy %

SWE-rebenchStale
  1. GLM-5.2 [high]62.9%
  2. Junie Agent61.8%
  3. Codex Agent58%

as of 2026-07-01 · Resolved rate %

SWE-Bench Pro (Scale, public set)
  1. qwen3-coder-480b-a35b38.7%
  2. minimax-2.136.81%
  3. kimi-k2-instruct27.67%

as of 2026-10-16 · % resolved

Agentic / terminal

End-to-end tasks an agent completes in a terminal. Scores are per model and harness.

Terminal-Bench 4.0
  1. Opus 5.5 (max)64.85%
  2. Sonnet 5.5 (max)61.82%
  3. GPT-6 Astra (max)58.18%

as of 2026-09-29 · Resolution rate

Websites

Human-preference arenas for front-end and full-stack web builds. Elo measures preference, not correctness.

LMArena WebDev ArenaHuman preference8 preliminary
  1. claude-opus-5.5-max1807
  2. gpt-6-astra-max1774
  3. claude-sonnet-5.5-xhigh1769

as of 2026-10-22 · Arena score

Vals AI Vibe Code Bench v1.1
  1. Claude Sonnet 5.592.39%
  2. Gemini 4 Argon91.91%
  3. Claude Haiku 5.590.44%

as of 2026-10-20 · Score %

Design Arena (Fullstack)Human preference
  1. gpt-6-astra1357
  2. claude-fable-5-11326
  3. kimi-k31315

as of 2026-10-24 · Elo

Design

Human-preference votes on generated UI. Measures taste, not whether the code works.

Design Arena (All categories)Human preference
  1. claude-opus-5-51389
  2. gpt-6-astra1383
  3. muse-wonder-1.01377

as of 2026-10-24 · Elo

Android

Android app tasks run by Google. Vendor-run, small task sets, wide confidence intervals.

Android Bench 2.0 (long-horizon, 30 tasks)Vendor-run
  1. Claude Opus 5.532.7%
  2. GPT 6 Astra28%
  3. Claude Fable 5.122.7%

as of 2026-10-06 · Pass rate

Android Bench 1.0 tasks (100 tasks)Vendor-run
  1. Kimi K390.2%
  2. Qwen3.8 Max87%
  3. GLM 5.272.2%

as of 2026-08-11 · Score %

iOS

No mature public leaderboard exists.

No mature public leaderboard

One research benchmark exists (SWE-Bench Mobile). We don't show it as a score.

Top 3 per board in the board's own order. Numbers from different boards use different metrics and can't be compared. Researchy 0-10 composite category scores were deliberately not imported (no home-made scores).

Which labs hold the top spots

Count of top-10 rows per lab on each category's active boards. This counts rows; it is not a score or a ranking of labs.

Code

Share of top-10 rowsCode: share of top-10 rows across 3 active boards (Terminal-Bench 4.0, SWE-rebench, SWE-Bench Pro), newest as of 2026-10-16. Counts rows, not a score.
OpenAI: 5 of 27Anthropic: 4 of 27Google: 1 of 27Meta: 2 of 27Chinese labs: 12 of 27Others: 3 of 2712/27Chinese labs
Code: share of top-10 rows across 3 active boards (Terminal-Bench 4.0, SWE-rebench, SWE-Bench Pro), newest as of 2026-10-16. Counts rows, not a score.
LabRows
OpenAI5
Anthropic4
Google1
Meta2
Chinese labs12
Others3

Sources: tbench.ai · swe-rebench.com · scale.com

Agentic / terminal

Share of top-10 rowsAgentic / terminal: share of top-10 rows across 1 active board (Terminal-Bench 4.0), newest as of 2026-09-29. Counts rows, not a score.
OpenAI: 2 of 10Anthropic: 3 of 10Google: 1 of 10xAI: 1 of 10Chinese labs: 3 of 103/10Anthropic
Agentic / terminal: share of top-10 rows across 1 active board (Terminal-Bench 4.0), newest as of 2026-09-29. Counts rows, not a score.
LabRows
OpenAI2
Anthropic3
Google1
xAI1
Chinese labs3

Sources: tbench.ai

Websites

Share of top-10 rowsWebsites: share of top-10 rows across 3 active boards (LMArena WebDev Arena, Vals AI Vibe Code Bench v1.1, Design Arena), newest as of 2026-10-24. Counts rows, not a score.
OpenAI: 5 of 30Anthropic: 9 of 30Google: 3 of 30xAI: 1 of 30Meta: 4 of 30Chinese labs: 6 of 30Others: 2 of 309/30Anthropic
Websites: share of top-10 rows across 3 active boards (LMArena WebDev Arena, Vals AI Vibe Code Bench v1.1, Design Arena), newest as of 2026-10-24. Counts rows, not a score.
LabRows
OpenAI5
Anthropic9
Google3
xAI1
Meta4
Chinese labs6
Others2

Sources: lmarena.ai · vals.ai · designarena.ai

Design

Share of top-10 rowsDesign: share of top-10 rows across 1 active board (Design Arena), newest as of 2026-10-24. Counts rows, not a score.
OpenAI: 3 of 10Anthropic: 3 of 10Meta: 3 of 10Chinese labs: 1 of 103/10OpenAI
Design: share of top-10 rows across 1 active board (Design Arena), newest as of 2026-10-24. Counts rows, not a score.
LabRows
OpenAI3
Anthropic3
Meta3
Chinese labs1

Sources: designarena.ai

Android

Share of top-10 rowsAndroid: share of top-10 rows across 2 active boards (Android Bench 2.0, Android Bench 1.0 tasks), newest as of 2026-10-06. Counts rows, not a score.
OpenAI: 2 of 17Anthropic: 2 of 17Google: 1 of 17Chinese labs: 12 of 1712/17Chinese labs
Android: share of top-10 rows across 2 active boards (Android Bench 2.0, Android Bench 1.0 tasks), newest as of 2026-10-06. Counts rows, not a score.
LabRows
OpenAI2
Anthropic2
Google1
Chinese labs12

Sources: developer.android.com · developer.android.com

What we did not import13
  • SWE-bench Verified: Vals AI no longer scores new releases (page 'Updated 9/1/2026'; parent cites 2026-09-05). Treat as final standings.
  • WebDev Arena: Gemini 4 Argon (High) 1678, qwen3.8-max(-0902) and hy4-preview are marked 'Preliminary' on the board (as of 2026-10-13).
  • Aggregator-sourced numbers (theindexofai, genztech.blog, kunya.ai, llmboard.ai, paperswithcode.co, benchlm.ai, llm.ing, anotherwrapper.com) were NOT imported. Each needs the original board; Terminal-Bench 2.0, Design Arena Website and LiveCodeBench 93.5 (DeepSeek V4 Pro Max) could not be confirmed on the original boards.
  • GPT-6 Astra DeepSWE 74.1% is OpenAI-reported via an aggregator (kunya.ai); not imported.
  • Design Arena per-category boards (Website, UI Component, Mobile Apps, Native Apps) require a Bearer API key per Design Arena API docs (https://docs.designarena.ai/api-reference/leaderboard); only the server-rendered All-categories and Fullstack boards were captured.
  • Aider polyglot: not updated since 2025-10-03 (last commit to leaderboard YAML 2025-10-04) - frozen; prefer Vals Vibe Code Bench / Terminal-Bench 4.0
  • swebench.com: all boards end 2026-02-26 or earlier - frozen; Vals SWE-bench Verified frozen 9/1/2026 (saturated)
  • LiveCodeBench official site data still ends 2025-04-07; Vals LCB frozen 9/1/2026 - no active LCB board found
  • SWE-Bench Pro (Scale) public board is active (Muse Spark 1.1 marked NEW) but lists no 2026 Anthropic/OpenAI frontier models; no as-of date on page
  • SWE-rebench last changelog 2026-07-01 - stale
  • superseded flag is an automatic same-family/newer-version heuristic within each board; verify before hiding rows
  • Design Arena per-category boards (android, mobile, ui-components) still need an API key
  • hosting_region: no model card states a hosting region; Muse Spark Open lists US-and-other hosted partners (Baseten, Fireworks, Groq, Modal, Nebius, OpenRouter, Together) without regions
License and hosting region

license_as_listed is copied from the board's listing (LMArena WebDev shows a license column); hosting_region is not_confirmed until checked against each model card. Proprietary-API models from Chinese vendors are tagged with license 'Proprietary' as listed.

The weekly diff

What changed in AI coding plans: prices, limits, resets. Email signups open soon. Until then, updates go out on X.

Follow @QuietlyByG on X RSS feed

No email form yet, so we don't collect any email addresses.