Rankings

Numbers with a source and a date.

Quality comes from the official SWE-bench leaderboard JSON. Price and context come from the public OpenRouter models API. Speed and Artificial Analysis scores are unknown in this snapshot, for the reasons below. Every figure has a source and a fetch timestamp.

Fresh snapshot written 2026-11-22T12:28:32-05:00 (America/New_York) to data/bench.json. Prior snapshot kept at data/bench-2026-10-23T0631Z.json. SWE-bench: official JSON, fetched 2026-11-22T12:28:32-05:00. OpenRouter: models API, fetched 2026-11-22T12:28:32-05:00. Official instance counts are from the SWE-bench homepage cards the same day. For Artificial Analysis, use their site.

Quality — SWE-bench

Verified · 500 official instances (count from swebench.com cards) · 180 rows in the official leaderboard JSON fetched 2026-11-22T12:28:32-05:00. Source: SWE-bench official leaderboard JSON. “Resolved” is the official resolved-% score. Cost is whatever the official board included (USD in their file); unknown if they left it null. “Checked” is the official field. Each row keeps its own date from SWE-bench.

#AgentModelResolved %DateCostOpen modelCheckedAttemptsSite
1Sonar Foundation Agent
Sonar
Claude 4.5 Opus
Anthropic
79.22025-12-05unknownnonoAttempts - 1source
2live-SWE-agent
UIUC
Claude 4.5 Opus
Anthropic
79.22025-12-15unknownnonoAttempts - 1source
3TRAE
ByteDance
Doubao-Seed-Code
ByteDance
78.82025-09-28unknownnonoAttempts - 2+source 1 · source 2
4live-SWE-agent
UIUC
Gemini 3 Pro Preview
Google DeepMind
77.42025-11-20unknownnonoAttempts - 1source
5EPAM AI/Run Developer Agent
EPAM Systems, Inc.
Claude 4 Sonnet
Anthropic
76.82025-08-04unknownnonoAttempts - 2+source
6Atlassian Rovo Dev
Atlassian
Multiple
Anthropic
76.82025-09-02unknownnonoAttempts - 2source
7mini-SWE-agent
SWE-agent
Claude 4.5 Opus
Anthropic
76.82026-02-17376.95nonoAttempts - 1source
8ACoder
ACoder
Multiple
Anthropic
76.42025-08-19unknownnonoAttempts - 2+source
9mini-SWE-agent
SWE-agent
Gemini 3 Flash
Google DeepMind
75.82026-02-17177.98nonoAttempts - 1source
10mini-SWE-agent
SWE-agent
MiniMax M2.5
Minimax
75.82026-02-1736.64yesnoAttempts - 1source
11Warp
Warp
Multiple
OpenAI
75.62025-09-01unknownnonoAttempts - 2+source
12mini-SWE-agent
SWE-agent
Claude 4.6 Opus
Anthropic
75.62026-02-17275.76nonoAttempts - 1source
13TRAE
TRAE
Multiple
Anthropic
75.22025-06-12unknownnonoAttempts - 2+source
14Harness AI
Harness
Claude Sonnet 4
Anthropic
74.82025-07-31unknownnonoAttempts - 1source
15Sonar Foundation Agent
Sonar
Claude 4.5 Sonnet
Anthropic
74.82025-11-03unknownnonoAttempts - 1source
16Lingxi-v1.5
Lingxi
Claude 4 Sonnet
Anthropic
74.62025-07-20unknownnonoAttempts - 1source
17JoyCode
JoyCode
Multiple
Anthropic
74.62025-09-15unknownnonoAttempts - 1source
18Refact.ai Agent
Refact.ai
Multiple
Anthropic
74.42025-06-03unknownnonoAttempts - 1source
19Prometheus-v1.2.1
EuniAI
GPT-5
OpenAI
74.42025-10-15unknownnonoAttempts - 2+source
20mini-SWE-agent
SWE-agent
Claude 4.5 Opus
Anthropic
74.42025-11-24360.62noyesAttempts - 1source
21mini-SWE-agent
SWE-agent
Gemini 3 Pro Preview
Google DeepMind
74.22025-11-18229.98noyesAttempts - 1source
22Salesforce AI Research SAGE
Salesforce AI Research
Multiple
Anthropic
73.82025-11-03unknownnonoAttempts - 2+source
23Tools
Claude 4 Opus
Anthropic
73.22025-05-22unknownnonoAttempts - 1source
24Salesforce AI Research SAGE
Salesforce AI Research
Multiple
Anthropic
73.02025-10-21unknownnonoAttempts - 2+source
25mini-SWE-agent
SWE-agent
GLM 5
Z-AI
72.82026-02-17267.19yesnoAttempts - 1source
26mini-SWE-agent
SWE-agent
GPT 5.2
OpenAI
72.82026-02-17236.78nonoAttempts - 1source
27mini-SWE-agent
SWE-agent
GPT 5.2 Codex
OpenAI
72.82026-02-19224.71nonoAttempts - 1source
28Tools
Claude 4 Sonnet
Anthropic
72.42025-05-22unknownnonoAttempts - 1source
29OpenHands
OpenHands
GPT-5
OpenAI
71.82025-08-07unknownnoyesAttempts - 1source
30mini-SWE-agent
SWE-agent
GPT 5.2
OpenAI
71.82025-12-11260.13nonoAttempts - 1source
31mini-SWE-agent
SWE-agent
Claude 4.5 Sonnet
Anthropic
71.42026-02-17328.95nonoAttempts - 1source
32Bloop
Bloop AI
Claude 4 Sonnet
Anthropic
71.22025-07-10unknownnonoAttempts - 1source
33Qodo Command
Qodo
Multiple
Anthropic
71.22025-07-15unknownnonoAttempts - 1source
34Prometheus-v1.2
EuniAI
GPT-5
OpenAI
71.22025-09-29unknownnonoAttempts - 1source
35Lingxi v1.5
Huawei
Kimi K2
Moonshot AI
71.22025-10-14unknownyesnoAttempts - 1source
36Warp
Warp
Multiple
Anthropic
71.02025-06-23unknownnonoAttempts - 1source
37Moatless Tools
Moatless AI
Claude 4 Sonnet
Anthropic
70.82025-06-11unknownnoyesAttempts - 1source
38mini-SWE-agent
SWE-agent
Kimi K2.5
Moonshot AI
70.82026-02-1773.28yesnoAttempts - 1source
39TRAE
Undisclosed
70.62025-05-19unknownnonoAttempts - 2+source
40mini-SWE-agent
SWE-agent
Claude 4.5 Sonnet
Anthropic
70.62025-09-29279.17noyesAttempts - 1source
41Refact.ai Agent
Refact.ai
Multiple
Anthropic
70.42025-05-15unknownnonoAttempts - 1source
42OpenHands
OpenHands
Claude 4 Sonnet
Anthropic
70.42025-05-24unknownnoyesAttempts - 1source
43Augment Agent v1
Undisclosed
70.42025-06-10unknownnonoAttempts - 1source
44devlo
devlo
Multiple
Anthropic
70.22025-05-19unknownnonoAttempts - 1source
45Zencoder
Multiple
Anthropic
70.02025-04-30unknownnonoAttempts - 2+source
46mini-SWE-agent
SWE-agent
DeepSeek V3.2
DeepSeek
70.02026-02-17223.92yesnoAttempts - 1source
47OpenHands
Qwen
Qwen3-Coder-480B-A35B-Instruct
Qwen
69.62025-08-05unknownyesnoAttempts - 1source
48mini-SWE-agent
SWE-agent
Gemini 3 Pro
Google DeepMind
69.62026-02-26480.01nonoAttempts - 1source
49mini-SWE-agent
SWE-agent
GPT 5.2
OpenAI
69.02025-12-11134.83nonoAttempts - 1source
50Nemotron-CORTEXA
NVIDIA
Multiple
OpenAI
68.22025-05-16unknownnonoAttempts - 2+source
51Undisclosed
Z.ai
GLM-4.6
Z.ai
68.22025-09-30unknownyesnoAttempts - 1source
52mini-SWE-agent
SWE-agent
Claude 4 Opus
Anthropic
67.62025-08-02565.64noyesAttempts - 1source
53SWE-agent
SWE-agent
Claude 4 Sonnet
Anthropic
66.62025-05-22unknownnoyesAttempts - 1source
54mini-SWE-agent
SWE-agent
Claude 4.5 Haiku
Anthropic
66.62026-02-17165.46nonoAttempts - 1source
55Aime-coder v1
ByteDance DevInfra
Claude 3.7 Sonnet
Anthropic
66.42025-05-14unknownnonoAttempts - 2+source
56mini-SWE-agent
SWE-agent
GPT 5.1
OpenAI
66.02025-11-20153.08nonoAttempts - 1source
57mini-SWE-agent
SWE-agent
GPT 5.1 Codex
OpenAI
66.02025-11-24294.44nonoAttempts - 1source
58OpenHands
OpenHands
Undisclosed
65.82025-04-15unknownnoyesAttempts - 2+source
59Augment Agent v0
Undisclosed
65.42025-03-16unknownnonoAttempts - 2+source
60Amazon Q Developer Agent
AWS
Undisclosed
65.42025-04-05unknownnonoAttempts - 2+source
61OpenHands
OpenHands
Kimi K2
Moonshot AI
65.42025-07-16unknownyesyesAttempts - 1source
62mini-SWE-agent
SWE-agent
GPT 5
OpenAI
65.02025-08-07140.19noyesAttempts - 1source
63mini-SWE-agent
SWE-agent
Claude 4 Sonnet
Anthropic
64.932025-07-26185.73noyesAttempts - 1source
64W&B Programmer O1 crosscheck5
o1-preview
OpenAI
64.62025-01-17unknownnonoAttempts - 2+source
65PatchPilot-v1.1
o4-mini
OpenAI
64.62025-05-03unknownnonoAttempts - 2+unknown
66Undisclosed
Z.ai
GLM-4.5
Z.ai
64.22025-07-28unknownyesnoAttempts - 1source
67AgentScope
Alibaba
Claude 3.5 Sonnet
Anthropic
63.42025-02-06unknownnonoAttempts - 2+source
68mini-SWE-agent
SWE-agent
Kimi K2 Thinking
Moonshot AI
63.42025-12-10219.15yesyesAttempts - 1source
69Tools
Anthropic
Claude 3.7 Sonnet
Anthropic
63.22025-02-24unknownnonoAttempts - 2+source
70Blackbox AI Agent
Undisclosed
62.82025-01-10unknownnonoAttempts - 2+source
71EPAM AI/Run Developer Agent
Claude 3.5 Sonnet
Anthropic
62.82025-02-28unknownnonoAttempts - 2+source
72SWE-agent
SWE-agent
Claude 3.7 Sonnet w/ Review Heavy
Anthropic
62.42025-02-25unknownnoyesAttempts - 2+source
73CodeStory Midwit Agent
swe-search
Anthropic
62.22024-12-21unknownnonoAttempts - 2+source
74mini-SWE-agent
SWE-agent
MiniMax M2
Minimax
61.02025-11-24214.13yesyesAttempts - 1source
75OpenHands
OpenHands
4x Scaled
60.82025-02-03unknownnoyesAttempts - 2+source
76EntroPO + R2E
42-b3yond-6ug
Qwen3-Coder-30B-A3B-Instruct
Qwen
60.42025-09-01unknownyesnoAttempts - 2+source
77Learn-by-interact
Google
Claude 3.5 Sonnet
Anthropic
60.22025-01-10unknownnonoAttempts - 2+source
78mini-SWE-agent
SWE-agent
DeepSeek V3.2 Reasoner
deepseek
60.02025-12-0114.04yesyesAttempts - 1unknown
79mini-SWE-agent
SWE-agent
GPT 5 mini
OpenAI
59.82025-08-0717.74noyesAttempts - 1source
80DeepSWE-Preview
Agentica
TTS(Bo16)
OpenAI
58.82025-06-29unknownyesnoAttempts - 2+source
81mini-SWE-agent
SWE-agent
o3
OpenAI
58.42025-07-26166.83noyesAttempts - 1source
82devlo
Undisclosed
58.22024-12-13unknownnonoAttempts - 2+source
83Nemotron-CORTEXA
NVIDIA
Multiple
Anthropic
58.22025-04-10unknownnoyesAttempts - 2+source
84Emergent E1
Multiple
Anthropic
57.22024-12-23unknownnonoAttempts - 2+source
85Gru
Undisclosed
57.02024-12-08unknownnonoAttempts - 2+source
86Artemis Agent v2
Turintech
Claude Sonnet 4
Anthropic
57.02025-09-24unknownnonoAttempts - 1source
87SWE-Rizzo
Undisclosed
56.62025-04-05unknownnonoAttempts - 2+source
88mini-SWE-agent
SWE-agent
Devstral Small (2512)
mistral
56.42025-12-09unknownyesyesAttempts - 1unknown
89mini-SWE-agent
SWE-agent
GPT 5 mini
OpenAI
56.22026-02-1723.6nonoAttempts - 1source
90EPAM AI/Run Developer Agent
Claude 3.5 Sonnet
Anthropic
55.42024-12-12unknownnonoAttempts - 2+source
91mini-SWE-agent
SWE-agent
Qwen3-Coder 480B/A35B Instruct
Qwen
55.42025-08-02123.96yesyesAttempts - 1source
92mini-SWE-agent
SWE-agent
GLM 4.6
Z.ai
55.42025-12-0148.31yesyesAttempts - 1unknown
93Amazon Q Developer Agent
AWS
Undisclosed
55.02024-12-02unknownnonoAttempts - 2+source
94devlo
Claude 3.5 Sonnet
Anthropic
54.22024-11-08unknownnonoAttempts - 2+source
95mini-SWE-agent
SWE-agent
GLM 4.5
Z.ai
54.22025-08-22148.6yesyesAttempts - 1source
96mini-SWE-agent
SWE-agent
Devstral (2512)
mistral
53.82025-12-09unknownyesyesAttempts - 1unknown
97FrogBoss-32B-2510
Microsoft
Frogboss 32B 2510
53.62025-11-10unknownnonoAttempts - 1source
98mini-SWE-agent
SWE-agent
Gemini 2.5 Pro
Google DeepMind
53.62025-07-26144.19noyesAttempts - 1source
99CodeSweep - SWE-agent
CodeSweep Inc.
Kimi K2 Instruct
Moonshot AI
53.42025-08-04unknownyesnoAttempts - 1source
100Bracket.sh
Undisclosed
53.22025-01-20unknownnonoAttempts - 2+source
101OpenHands
OpenHands
CodeAct v2.1 (claude-3-5-sonnet-20241022)
Anthropic
53.02024-10-29unknownnoyesAttempts - 2+source
102mini-SWE-agent
SWE-agent
Claude 3.7 Sonnet
Anthropic
52.82025-07-20177.31noyesAttempts - 1source
103Google Jules
Google
Gemini 2.0 Flash (v20241212-experimental)
Google DeepMind
52.22024-12-12unknownnonoAttempts - 2+source
104EntroPO + R2E
42-b3yond-6ug
Qwen3-Coder-30B-A3B-Instruct
Qwen
52.22025-09-01unknownyesnoAttempts - 1source
105Engine Labs
Engine Labs
Claude 3.5 Sonnet
Anthropic
51.82024-11-25unknownnonoAttempts - 1source
106AutoCodeRover-v2.1
Claude 3.5-Sonnet-20241022
Anthropic
51.62025-01-22unknownnonoAttempts - 2+source
107OpenHands
Qwen
Qwen3-Coder-30B-A3B-Instruct
Qwen
51.62025-08-05unknownyesnoAttempts - 1source
108Agentless-1.5
Agentless
Claude 3.5 Sonnet
Anthropic
50.82024-12-02unknownnonoAttempts - 2+source
109Solver
Undisclosed
50.02024-10-28unknownnonoAttempts - 2+source
110Bytedance MarsCode Agent
Bytedance
Undisclosed
50.02024-11-25unknownnonoAttempts - 2+source
111nFactorial
Multiple
Anthropic
49.22024-11-05unknownnonoAttempts - 2+source
112Tools
Anthropic
Claude 3.5 Sonnet
Anthropic
49.02024-10-22unknownnonoAttempts - 2+source
113Composio SWE-Kit
Multiple
Anthropic
48.62024-10-25unknownnoyesAttempts - 2+source
114AppMap Navie v2
Multiple
Anthropic
47.22024-11-06unknownnoyesAttempts - 2+source
115Skywork-SWE-32B
Skywork AI
TTS(Bo8)
Qwen
47.02025-06-16unknownyesyesAttempts - 2+source
116OpenHands
OpenHands
DevStral Small 2505
Mistral
46.82025-05-20unknownyesyesAttempts - 1source
117Emergent E1
Multiple
Anthropic
46.62024-10-23unknownnonoAttempts - 2+source
118AutoCodeRover-v2.0
Claude 3.5-Sonnet-20241022
Anthropic
46.22024-11-08unknownnonoAttempts - 2+source
119PatchPilot
Co-PatcheR
46.02025-05-28unknownyesnoAttempts - 2+source
120Solver
Undisclosed
45.42024-09-24unknownnonoAttempts - 2+source
121Gru
Undisclosed
45.22024-08-24unknownnonoAttempts - 2+source
122FrogMini-14B-2510
Microsoft
Frogmini 14B 2510
45.02025-11-10unknownnonoAttempts - 1source
123mini-SWE-agent
SWE-agent
o4-mini
OpenAI
45.02025-07-26104.99noyesAttempts - 1source
124CodeShellAgent
Gemini 2.0 Flash (Experimental)
Google DeepMind
44.22025-01-18unknownnonoAttempts - 2+source
125mini-SWE-agent
SWE-agent
Kimi K2 Instruct
Moonshot AI
43.82025-08-07265.8yesyesAttempts - 1source
126Solver
Undisclosed
43.62024-09-20unknownnonoAttempts - 2+source
127Agentless Lite
Agentless
O3 Mini
OpenAI
42.42025-02-14unknownnoyesAttempts - 2+source
128Amazon Nova Premier 1.0
Amazon Nova
Amazon.nova Premier v1:0
42.42025-05-27unknownnonoAttempts - 2+source
129R2E-Gym
Agentica
DeepSWE-Preview
42.22025-06-29unknownyesnoAttempts - 1source
130SWE-Exp
SWE-Exp
DeepSeek V3 0324
DeepSeek
42.02025-08-06unknownyesnoAttempts - 2source
131nFactorial
Multiple
Anthropic
41.62024-10-30unknownnonoAttempts - 2+source
132ugaiforge
Undisclosed
41.62025-01-12unknownnonoAttempts - 2+unknown
133Agentless Mini
Agentless
Llama3-SWE-RL-70B
Meta
41.22025-02-26unknownnonoAttempts - 2+source
134Honeycomb
Undisclosed
40.62024-08-20unknownnonoAttempts - 2+source
135Composio SWEkit
Claude 3.5 Sonnet
Anthropic
40.62024-10-16unknownnonoAttempts - 2+source
136Tools
Anthropic
Claude 3.5 Haiku
Anthropic
40.62024-10-22unknownnonoAttempts - 2+source
137Nebius AI
Multiple
Meta
40.62024-11-13unknownnonoAttempts - 2+source
138SWE-agent
SWE-agent
SWE-agent-LM-32B
Qwen
40.22025-05-11unknownyesyesAttempts - 1source
139EPAM AI/Run Developer Agent
Claude 3.5 Sonnet
Anthropic
39.62024-10-29unknownnonoAttempts - 2+source
140mini-SWE-agent
SWE-agent
GPT 4.1
OpenAI
39.582025-07-2673.16noyesAttempts - 1source
141Amazon Q Developer Agent
AWS
Undisclosed
38.82024-07-21unknownnonoAttempts - 2+source
142Agentless-1.5
Agentless
GPT-4o
OpenAI
38.82024-10-28unknownnonoAttempts - 1source
143AutoCodeRover
GPT-4o
OpenAI
38.42024-06-28unknownnonoAttempts - 2+source
144Skywork-SWE-32B
Skywork AI
Qwen2.5 Coder 32B Instruct
Qwen
38.02025-06-16unknownyesyesAttempts - 1source
145SWE-agent
SWE-agent
DevStral Small 2507
Mistral
38.02025-07-25unknownyesyesAttempts - 1source
146Factory Code Droid
Undisclosed
37.02024-06-17unknownnonoAttempts - 2+source
147mini-SWE-agent
SWE-agent
GPT 5 nano
OpenAI
34.82025-08-0719.04noyesAttempts - 1source
148SWE-agent
SWE-agent
Claude 3.5 Sonnet
Anthropic
33.62024-06-20unknownnoyesAttempts - 1source
149SWE-Fixer
Qwen2.5 (7B + 72B)
Qwen
32.82025-03-06unknownyesyesAttempts - 1source
150MASAI
GPT-4o
OpenAI
32.62024-06-12unknownnonoAttempts - 2+source
151Artemis Agent v1
Undisclosed
32.02024-11-20unknownnonoAttempts - 2+source
152nFactorial
Undisclosed
31.62024-10-07unknownnonoAttempts - 2+source
153SWE-Fixer
Qwen2.5 (7B + 72B)
Qwen
30.22024-11-28unknownnonoAttempts - 2+source
154Lingma Agent
Alibaba
Lingma SWE-GPT 72b (v0925)
OpenAI
28.82024-10-02unknownnonoAttempts - 2+source 1 · source 2
155mini-SWE-agent
SWE-agent
Gemini 2.5 Flash
Google DeepMind
28.732025-07-2666.94noyesAttempts - 1source
156EPAM AI/Run Developer Agent
GPT-4o
OpenAI
27.02024-10-16unknownnonoAttempts - 2+source
157AppMap Navie
GPT-4o
OpenAI
26.22024-06-15unknownnoyesAttempts - 2+source
158mini-SWE-agent
SWE-agent
gpt-oss-120b
OpenAI
26.02025-08-0728.56yesyesAttempts - 1source
159nFactorial
Undisclosed
25.82024-10-01unknownnonoAttempts - 2+source
160Amazon Q Developer Agent
AWS
Undisclosed
25.62024-05-09unknownnonoAttempts - 2+source
161Lingma Agent
Alibaba
Lingma SWE-GPT 72b (v0918)
OpenAI
25.02024-09-18unknownnonoAttempts - 2+source
162EPAM AI/Run Developer Agent
GPT-4o
OpenAI
24.02024-08-20unknownnonoAttempts - 2+source
163mini-SWE-agent
SWE-agent
GPT 4.1 mini
OpenAI
23.942025-07-20217.58noyesAttempts - 1source
164SWE-agent
SWE-agent
GPT-4o
OpenAI
23.22024-07-28unknownnoyesAttempts - 1source
165MCTS-Refine-7B
MCTS Refine 7B
23.22025-06-27unknownyesnoAttempts - 1source
166SWE-agent
SWE-agent
GPT-4 (1106)
OpenAI
22.42024-04-02unknownnoyesAttempts - 1source
167mini-SWE-agent
SWE-agent
GPT 4o
OpenAI
21.622025-07-20765.57noyesAttempts - 1source
168mini-SWE-agent
SWE-agent
Llama 4 Maverick Instruct
Meta
21.042025-07-20156.85noyesAttempts - 1source
169Lingma Agent
Alibaba
Lingma SWE-GPT 7b (v0925)
OpenAI
18.22024-10-02unknownnonoAttempts - 2+source 1 · source 2
170SWE-agent
SWE-agent
Claude 3 Opus
Anthropic
15.82024-04-02unknownnoyesAttempts - 1source
171mini-SWE-agent
SWE-agent
Gemini 2.0 Flash
Google DeepMind
13.522025-07-260noyesAttempts - 1source
172Lingma Agent
Alibaba
Lingma SWE-GPT 7b (v0918)
OpenAI
10.22024-09-18unknownnonoAttempts - 2+source
173mini-SWE-agent
SWE-agent
Llama 4 Scout Instruct
Meta
9.062025-07-2057.82noyesAttempts - 1source
174mini-SWE-agent
SWE-agent
Qwen2.5-Coder 32B Instruct
Qwen
9.02025-08-0334.06yesyesAttempts - 1source
175RAG baseline
Claude 3 Opus
Anthropic
7.02024-04-02unknownnoyesAttempts - 2+source
176RAG baseline
Claude 2
Anthropic
4.42023-10-10unknownnoyesAttempts - 1unknown
177RAG baseline
GPT-4 (1106)
OpenAI
2.82024-04-02unknownnoyesAttempts - 2+unknown
178RAG baseline
SWE-agent
SWE-Llama 7B
Meta
1.42023-10-10unknownnoyesAttempts - 1unknown
179RAG baseline
SWE-agent
SWE-Llama 13B
Meta
1.22023-10-10unknownnoyesAttempts - 1unknown
180RAG baseline
SWE-agent
GPT-3.5
OpenAI
0.42023-10-10unknownnoyesAttempts - 1unknown

Price and context — OpenRouter

USD per 1M input/output tokens and context window in tokens, 476 models, from the OpenRouter models API, fetched 2026-11-22T12:28:32-05:00. Speed (tokens/sec) and quality scores are unknown in this table.

ModelOrgContextIn $/MOut $/MWeights
Thinking Machines: Inkling 2 Minithinkingmachines10485760.0750.3open
RadixArk: DaisyRose 27Bradixark2621440.151.875open
Mistral: Pixtral Large 2502mistralai1280002.06.0closed / API
Google: Gemini 4 Neongoogle10485763.015.0closed / API
Google: Gemini 4 Neon (batch)google10485761.57.5closed / API
OpenAI: GPT-6.2 Astra Proopenai10500008.040.0closed / API
OpenAI: GPT-6.2 Astra Pro (batch)openai10500004.020.0closed / API
OpenAI: GPT-6.2 Astraopenai10500008.040.0closed / API
OpenAI: GPT-6.2 Astra (batch)openai10500004.020.0closed / API
OpenAI: GPT-6.2 Sol Proopenai10500002.010.0closed / API
OpenAI: GPT-6.2 Sol Pro (batch)openai10500001.05.0closed / API
OpenAI: GPT-6.2 Solopenai10500002.010.0closed / API
OpenAI: GPT-6.2 Sol (batch)openai10500001.05.0closed / API
Tencent: Hy4 flashtencent10485760.0350.14049999999999999open
Qwen: Qwen4 Maxqwen10000001.42499999999999984.2749999999999995closed / API
inclusionAI: Ling 3.2 Flash (free)inclusionai10485760.00.0open
Google: Gemini 4 Hydrogengoogle10485761.57.5closed / API
Google: Gemini 4 Hydrogen (batch)google10485760.753.75closed / API
Baidu: ERNIE-5.5-Flash-Preview (free)baidu10240000.00.0open
Baidu: ERNIE-Light-DT-1.0baidu10240001.133.9400000000000004closed / API
Google: Gemini 4 Carbongoogle10485762.010.0closed / API
Google: Gemini 4 Carbon (batch)google10485761.05.0closed / API
Nex AGI: Nex-N2.6nex-agi2621440.120.39999999999999997open
Thinking Machines: Inkling 2 Smallthinkingmachines10485760.31.0open
Anthropic: Claude Fable 5.2anthropic10000008.040.0closed / API
Anthropic: Claude Fable 5.2 (batch)anthropic10000004.020.0closed / API
Meta: Muse Embermeta10485760.099999999999999990.5closed / API
LiquidAI: LFM3-1.7Bliquid2621440.080.19999999999999998open
LiquidAI: LFM3-1.7B (free)liquid2621440.00.0open
Google: Gemini Omni 1.2 Flashgoogle1310721.59.0closed / API
KT: Mi:dm K 3.0 Prokt2617950.199999999999999980.7999999999999999closed / API
Google: Gemini Omni 1.1 Flashgoogle1310721.59.0closed / API
Ricursive: Ripple 65B Previewricursiveai10485760.099999999999999990.3open
Tencent: Hy4tencent10485760.4171.2505open
Motif Technologies: Motif 3motif-technologies2621440.31.2open
Z.ai: GLM 5.3 FlashX Legalz-ai10485760.371.25closed / API
Particle AI: Particle-1particle-ai10485760.070.5closed / API
Particle AI: Particle-1 (free)particle-ai10485760.00.0closed / API
OpenAI: GPT-6.1 Terra Proopenai10500001.05.0closed / API
OpenAI: GPT-6.1 Terra Pro (batch)openai10500000.52.5closed / API
OpenAI: GPT-6.1 Terraopenai10500001.05.0closed / API
OpenAI: GPT-6.1 Terra (batch)openai10500000.52.5closed / API
MoonshotAI: Kimi K3.1 Promoonshotai10485760.24038.402299999999999open
MoonshotAI: Kimi K3.1 Pro (batch)moonshotai10485760.3725.582999999999999open
Recursive: Flint (free)recursive2621440.00.0open
MiniMax: MiniMax M3.1 Flashminimax10485760.0750.3open
DeepSeek: DeepSeek V4.1 Flash 1017deepseek10485760.150.6open
DeepSeek: DeepSeek V4.1 Flash 1017 (batch)deepseek10485760.0350.149open
Elorian: Glimpseelorian2621440.63.0closed / API
Reflection: Beam 1.0 501B A23Breflection10485760.251.0open
PrismML: Ternary Bonsai 2 9Bprism-ml2621440.080.13open
Moondream: Moondream 3 Previewmoondream320000.32.5open
Moondream: Moondream 3.1moondream320000.32.5open
Meta: Muse Spark Openmeta10485761.254.25open
NVIDIA: Nemotron 3.5 Super VLnvidia10485760.150.47open
NVIDIA: Nemotron 3.5 Super VL (free)nvidia10000000.00.0open
Pareto 26.10unbiased10485760.79999999999999993.1999999999999997closed / API
Pareto Latest~unbiased10485760.79999999999999993.1999999999999997closed / API
Pareto 26.9unbiased2621442.57.5closed / API
LiquidAI: LFM2.5-24B-A2Bliquid1280000.0499999999999999960.7open
Google: Gemini 4 Argongoogle10485762.010.0closed / API
Google: Gemini 4 Argon (batch)google10485761.05.0closed / API
ScaleDown: Summarizescaledown10000000.040.0closed / API
ScaleDown: Extractscaledown10000000.040.0closed / API
Meta: Muse Wondermeta10485764.020.0closed / API
StepFun: Step 5 Previewstepfun10000001.02.7open
Anthropic: Claude Haiku 5.5anthropic10000000.099999999999999990.5closed / API
Anthropic: Claude Haiku 5.5 (batch)anthropic10000000.0499999999999999960.25closed / API
Google: Nano Banana 2.1google655361.57.5closed / API
Mistral: Mistral Large 4mistralai10485760.72.0999999999999996open
inclusionAI: Ling 3.1 Flashinclusionai10000000.060.18open
Pareto 26.10 Previewunbiased10485760.79999999999999993.1999999999999997closed / API
OpenAI: GPT-6.1 Sol Proopenai10500002.010.0closed / API
OpenAI: GPT-6.1 Sol Pro (batch)openai10500001.05.0closed / API
OpenAI: GPT-6.1 Solopenai10500002.010.0closed / API
OpenAI: GPT-6.1 Sol (batch)openai10500001.05.0closed / API
Anthropic: Claude Sonnet 5.5anthropic10000002.010.0closed / API
Anthropic: Claude Sonnet 5.5 (batch)anthropic10000001.05.0closed / API
Perceptron: Perceptron Mk1.5perceptron368640.151.5closed / API
Fireworks: Ember-1fireworks10485763.015.0closed / API
Z.ai: GLM 5.3 Primez-ai10000001.685.28closed / API
Qwen: Qwen3.8 Max Primeqwen10000004.012.0closed / API
AionLabs: Aion 3.5 Miniaion-labs2621440.71.4closed / API
AionLabs: Aion 3.5aion-labs2621443.06.0closed / API
Upstage: Solar Mini 4upstage5242880.0499999999999999960.19999999999999998closed / API
Cohere: Command A+cohere1920000.31.5open
OpenAI: GPT-6 Luna Proopenai10500000.099999999999999990.5closed / API
OpenAI: GPT-6 Luna Pro (batch)openai10500000.0499999999999999960.25closed / API
OpenAI: GPT-6 Lunaopenai10500000.099999999999999990.5closed / API
OpenAI: GPT-6 Luna (batch)openai10500000.0499999999999999960.25closed / API
OpenAI: GPT-6 Sol Proopenai10500002.010.0closed / API
OpenAI: GPT-6 Sol Pro (batch)openai10500001.05.0closed / API
OpenAI: GPT-6 Solopenai10500002.010.0closed / API
OpenAI: GPT-6 Sol (batch)openai10500001.05.0closed / API
Anthropic: Claude Opus 5.5anthropic10000004.020.0closed / API
Anthropic: Claude Opus 5.5 (batch)anthropic10000002.010.0closed / API
Xiaomi: MiMo-V2.6-Pro-UltraSpeedxiaomi10485764.358.7closed / API
Xiaomi: MiMo-V2.6-Flashxiaomi10485760.140.28open
Xiaomi: MiMo-V2.6-Proxiaomi10485760.4350.87open
SpaceXSI: Grok 4.7x-ai5000002.06.0closed / API
SpaceXSI: Grok 4.7 (batch)x-ai5000001.59999999999999994.8closed / API
Qwen: Qwen3.8 Omni Flashqwen10000000.150.47closed / API
PrismML: Ternary Bonsai 2 27Bprism-ml2621440.0750.5open
Z.ai: GLM 5.3 FlashXz-ai10485760.371.25closed / API
DeepSeek: DeepSeek Pro Latest~deepseek10485760.11888.0closed / API
DeepSeek: DeepSeek Flash Latest~deepseek10485760.0360.5closed / API
Inference.net: Schematron V2 Turboinference-net1280000.030.15open
Inference.net: Schematron V2 Smallinference-net1280000.0499999999999999960.22999999999999998open
OpenAI: GPT Astra Latest~openai10500008.040.0closed / API
OpenAI: GPT Sol Latest~openai10500002.010.0closed / API
OpenAI: GPT Terra Latest~openai10500001.05.0closed / API
OpenAI: GPT Luna Latest~openai10500000.099999999999999990.5closed / API
Sakana: Fugu Ultra v2sakana10000005.030.0closed / API
Sakana: Fugu Maxsakana10000002.06.0closed / API
inclusionAI: Ling 3.0 Flash VLinclusionai1310720.060.18open
DeepSeek: DeepSeek V4.1 Flashdeepseek10485760.0498000000000000040.19920000000000002open
DeepSeek: DeepSeek V4.1 Flash (batch)deepseek10485760.0499999999999999960.15open
Nex AGI: Nex-N2.5-Mininex-agi2621440.0249999999999999980.09999999999999999open
Nex AGI: Nex-N2.5-Pronex-agi2621440.0750.25open
OpenAI: GPT-6 Astraopenai105000010.050.0closed / API
OpenAI: GPT-6 Astra (batch)openai10500005.025.0closed / API
OpenAI: GPT-6 Astra Proopenai105000010.050.0closed / API
OpenAI: GPT-6 Astra Pro (batch)openai10500005.025.0closed / API
Qwen: Qwen3.8 Max (0902)qwen10000002.06.0closed / API
Qwen: Qwen3.8 Max (0902) (batch)qwen2621441.153.45closed / API
Meta: Muse Spark 1.3 Contributormeta10485760.099999999999999990.19999999999999998closed / API
Meta: Muse Spark 1.3meta10485761.254.25closed / API
Google: Gemini 3.8 Flashgoogle10485760.82500000000000014.125closed / API
Google: Gemini 3.8 Flash (batch)google10485760.3751.875closed / API
Anthropic: Claude Fable 5.1anthropic100000010.050.0closed / API
Anthropic: Claude Fable 5.1 (batch)anthropic10000005.025.0closed / API
IBM: Granite 4.2 8Bibm-granite1310720.060.15open
Tencent: Hy4 previewtencent10485760.75059999999999992.2509open
Z.ai: GLM Flash Latest~z-ai10485760.03990.0784closed / API
Qwen: Qwen3.8 Flashqwen10000000.150.47open
Z.ai: GLM 5.3 Flashz-ai10485760.03990.0784open
Z.ai: GLM 5.3 Flash (batch)z-ai10485760.0230.068open
Meta: Muse Spark 1.2 Contributormeta10485760.099999999999999990.19999999999999998closed / API
DeepSeek: DeepSeek V4 Flash Vision Expdeepseek10485760.215599999999999990.6468open
Tencent: Hy-MT2-1.8Btencent81920.0440.17700000000000002open
Tencent: Hy-MT2-30B-A3Btencent81920.0740.295open
Z.ai: GLM Latest~z-ai10485760.06991.4closed / API
Tencent: Hy-MT2-7Btencent81920.0740.295open
Z.ai: GLM 5.3z-ai10485760.06991.4open
Z.ai: GLM 5.3 (batch)z-ai10485760.281.249open
Qwen: Qwen3.8 27Bqwen10240000.0351.5open
Qwen: Qwen3.8 27B (batch)qwen2621440.162.0open
Google: Gemini 3.7 Flashgoogle10485760.753.75closed / API
Google: Gemini 3.7 Flash (batch)google10485760.3751.875closed / API
ByteDance Seed: Seed 2.1 Turbobytedance-seed2621440.52.5closed / API
Qwen: Qwen3.8 2.4T A95Bqwen10485762.06.0open
DeepSeek: DeepSeek V4 Pro 0813deepseek10485761.323.9600000000000004open
SpaceXSI: Grok 4.6x-ai5000002.06.0closed / API
SpaceXSI: Grok 4.6 (batch)x-ai5000001.59999999999999994.8closed / API
NVIDIA: Nemotron 3.5 Lightningnvidia10485760.070.19999999999999998open
NVIDIA: Nemotron 3.5 Lightning (free)nvidia10000000.00.0open
Sakana: Sakana Namazusakana2621440.954.0closed / API
Upstage: Solar Pro 4upstage5242880.150.6closed / API
Meta: Muse Glimmer 30Bmeta1310720.351.5open
Meta: Muse Glimmer 30B (batch)meta1310720.240.96open
inclusionAI: Ling 3.0 Tinyinclusionai2621440.0150.045open
Meta: Muse Spark 1.2meta10485761.254.25closed / API
DeepSeek: DeepSeek V4 Flash Latest~deepseek10485760.0440.13199999999999998closed / API
DeepSeek: DeepSeek V4 Flash 0731deepseek10485760.04430.3open
DeepSeek: DeepSeek V4 Flash 0731 (batch)deepseek10485760.0480.144open
Thinking Machines: Inkling Smallthinkingmachines5242880.449999999999999961.2open
Thinking Machines: Inkling Small (batch)thinkingmachines5242880.360.96open
Qwen: Qwen3.7 Flashqwen10000000.030.13closed / API
Anthropic: Claude Opus 5anthropic10000005.025.0closed / API
Anthropic: Claude Opus 5 (batch)anthropic10000002.512.5closed / API
inclusionAI: Ling 3.0 Flashinclusionai2621440.0209999999999999980.063open
Google: Gemini 3.6 Flashgoogle10485760.753.75closed / API
Google: Gemini 3.6 Flash (batch)google10485760.3751.875closed / API
Google: Gemini 3.5 Flash Litegoogle10485760.32.5closed / API
Google: Gemini 3.5 Flash Lite (batch)google10485760.151.25closed / API
Thinking Machines: Inklingthinkingmachines5242881.04.05open
MoonshotAI: Kimi K3moonshotai10485760.19216.0open
MoonshotAI: Kimi K3 (batch)moonshotai10485762.280000000000000211.399999999999999open
Meta: Muse Spark 1.1meta10485761.254.25closed / API
OpenAI: GPT-5.6 Luna Proopenai10500000.199999999999999981.2closed / API
OpenAI: GPT-5.6 Luna Pro (batch)openai10500000.099999999999999990.6closed / API
OpenAI: GPT-5.6 Lunaopenai10500000.199999999999999981.2closed / API
OpenAI: GPT-5.6 Luna (batch)openai10500000.099999999999999990.6closed / API
OpenAI: GPT-5.6 Terra Proopenai10500002.012.0closed / API
OpenAI: GPT-5.6 Terra Pro (batch)openai10500001.06.0closed / API
OpenAI: GPT-5.6 Terraopenai10500002.012.0closed / API
OpenAI: GPT-5.6 Terra (batch)openai10500001.06.0closed / API
OpenAI: GPT-5.6 Sol Proopenai10500004.020.0closed / API
OpenAI: GPT-5.6 Sol Pro (batch)openai10500002.010.0closed / API
OpenAI: GPT-5.6 Solopenai10500004.020.0closed / API
OpenAI: GPT-5.6 Sol (batch)openai10500002.010.0closed / API
SpaceXSI: Grok 4.5x-ai5000002.06.0closed / API
xAI: Grok Latest~x-ai5000002.06.0closed / API
AionLabs: Aion-3.0-Miniaion-labs1310720.71.4closed / API
AionLabs: Aion-3.0aion-labs1310723.06.0closed / API
Tencent: Hy3tencent2621440.140.58open
Anthropic: Claude Sonnet 5anthropic10000002.010.0closed / API
Anthropic: Claude Sonnet 5 (batch)anthropic10000001.05.0closed / API
Google: Nano Banana 2 Lite (Gemini 3.1 Flash Lite Image)google655360.251.5closed / API
Sakana: Fugu Ultrasakana10000005.030.0closed / API
Google: Nano Banana 2 (Gemini 3.1 Flash Image)google1310720.53.0closed / API
Google: Nano Banana Pro (Gemini 3 Pro Image)google1310722.012.0closed / API
Z.ai: GLM 5.2z-ai10485760.622.42open
Z.ai: GLM 5.2 (batch)z-ai10485760.3220.989open
MoonshotAI: Kimi K2.7 Codemoonshotai2621440.63.0open
Anthropic: Claude Fable Latest~anthropic10000008.040.0closed / API
Anthropic: Claude Fable 5anthropic100000010.050.0closed / API
Anthropic: Claude Fable 5 (batch)anthropic10000005.025.0closed / API
NVIDIA: Nemotron 3.5 Content Safetynvidia1310720.199999999999999980.19999999999999998open
NVIDIA: Nemotron 3 Ultranvidia2621440.52.2open
NVIDIA: Nemotron 3 Ultra (free)nvidia10000000.00.0open
Qwen: Qwen3.7 Plusqwen10000000.321.28closed / API
Qwen: Qwen3.7 Plus (batch)qwen2621440.229999999999999980.9199999999999999closed / API
MiniMax: MiniMax M3minimax10485760.31.2open
MiniMax: MiniMax M3 (batch)minimax5242880.2240.88open
StepFun: Step 3.7 Flashstepfun2621440.199999999999999981.15open
Anthropic: Claude Opus 4.8anthropic10000005.025.0closed / API
Anthropic: Claude Opus 4.8 (batch)anthropic10000002.512.5closed / API
Qwen: Qwen3.7 Maxqwen10000001.4754.425closed / API
Google: Gemini 3.5 Flashgoogle10485761.59.0closed / API
Google: Gemini 3.5 Flash (batch)google10485760.754.5closed / API
Perceptron: Perceptron Mk1perceptron327680.151.5closed / API
Google: Gemini 3.1 Flash Litegoogle10485760.251.5closed / API
Google: Gemini 3.1 Flash Lite (batch)google10485760.1250.75closed / API
OpenAI: GPT Chat Latestopenai4000005.030.0closed / API
SpaceXSI: Grok 4.3x-ai10000001.252.5closed / API
SpaceXSI: Grok 4.3 (batch)x-ai10000001.02.0closed / API
Mistral: Mistral Medium 3.5mistralai2621441.57.5open
Mistral: Mistral Medium 3.5 (batch)mistralai2621440.753.75open
NVIDIA: Nemotron 3 Nano Omni (free)nvidia2560000.00.0open
Anthropic: Claude Haiku Latest~anthropic10000000.099999999999999990.5closed / API
OpenAI: GPT Mini Latest~openai4000000.754.5closed / API
Google: Gemini Pro Latest~google10485762.010.0closed / API
MoonshotAI: Kimi Latest~moonshotai10485760.1823999999999999811.0055closed / API
Google: Gemini Flash Latest~google10485761.57.5closed / API
Anthropic: Claude Sonnet Latest~anthropic10000002.010.0closed / API
Qwen: Qwen3.5 Plus 2026-04-20qwen10000000.31.7999999999999998closed / API
Qwen: Qwen3.6 Flashqwen10000000.18751.125closed / API
Qwen: Qwen3.6 35B A3Bqwen2621440.099999999999999990.8999999999999999open
Qwen: Qwen3.6 27Bqwen2621440.323.1999999999999997open
OpenAI: GPT-5.5 Proopenai105000030.0180.0closed / API
OpenAI: GPT-5.5 Pro (batch)openai105000015.090.0closed / API
OpenAI: GPT-5.5openai10500005.030.0closed / API
OpenAI: GPT-5.5 (batch)openai10500002.515.0closed / API
DeepSeek: DeepSeek V4 Pro 0423deepseek10485760.89999999999999991.5open
DeepSeek: DeepSeek V4 Flash 0423deepseek10485760.090.18open
Xiaomi: MiMo-V2.5-Proxiaomi2621440.481.7999999999999998open
Xiaomi: MiMo-V2.5xiaomi10000000.399999999999999972.0open
OpenAI: GPT-5.4 Image 2openai2720008.015.0closed / API
Anthropic: Claude Opus Latest~anthropic10000004.020.0closed / API
MoonshotAI: Kimi K2.6moonshotai2621440.653.41open
Anthropic: Claude Opus 4.7anthropic10000005.025.0closed / API
Anthropic: Claude Opus 4.7 (batch)anthropic10000002.512.5closed / API
Z.ai: GLM 5.1z-ai2048001.44.4open
Google: Gemma 4 26B A4B google2621440.06750.22499999999999998open
Google: Gemma 4 26B A4B (free)google2621440.00.0open
Google: Gemma 4 31Bgoogle2621440.199999999999999980.39999999999999997open
Google: Gemma 4 31B (free)google2621440.00.0open
Qwen: Qwen3.6 Plusqwen10000000.3251.95closed / API
Z.ai: GLM 5V Turboz-ai2027521.24.0closed / API
SpaceXSI: Grok 4.20 Multi-Agentx-ai20000001.252.5closed / API
SpaceXSI: Grok 4.20x-ai20000001.252.5closed / API
Google: Lyria 3 Pro Previewgoogle10485760.00.0closed / API
Google: Lyria 3 Clip Previewgoogle10485760.00.0closed / API
Reka Edgerekaai163840.099999999999999990.09999999999999999open
MiniMax: MiniMax M2.7minimax1966080.61.7999999999999998open
OpenAI: GPT-5.4 Nanoopenai4000000.199999999999999981.25closed / API
OpenAI: GPT-5.4 Nano (batch)openai4000000.099999999999999990.625closed / API
OpenAI: GPT-5.4 Miniopenai4000000.754.5closed / API
OpenAI: GPT-5.4 Mini (batch)openai4000000.3752.25closed / API
Mistral: Mistral Small 4mistralai2621440.150.6open
Z.ai: GLM 5 Turboz-ai2027521.24.0closed / API
NVIDIA: Nemotron 3 Supernvidia2621440.0750.39999999999999997open
ByteDance Seed: Seed-2.0-Litebytedance-seed2621440.252.0closed / API
Qwen: Qwen3.5-9Bqwen2621440.169999999999999980.25open
OpenAI: GPT-5.4 Proopenai105000030.0180.0closed / API
OpenAI: GPT-5.4 Pro (batch)openai105000015.090.0closed / API
OpenAI: GPT-5.4openai10500002.515.0closed / API
OpenAI: GPT-5.4 (batch)openai10500001.257.5closed / API
Google: Gemini 3.1 Flash Lite Previewgoogle10485760.251.5closed / API
ByteDance Seed: Seed-2.0-Minibytedance-seed2621440.099999999999999990.39999999999999997closed / API
Google: Nano Banana 2 (Gemini 3.1 Flash Image Preview)google655360.53.0closed / API
Qwen: Qwen3.5-35B-A3Bqwen2621440.141.0open
Qwen: Qwen3.5-27Bqwen2621440.262.6open
Qwen: Qwen3.5-122B-A10Bqwen2621440.262.08open
Qwen: Qwen3.5-Flashqwen10000000.0650.26closed / API
Google: Gemini 3.1 Pro Preview Custom Toolsgoogle10485762.012.0closed / API
OpenAI: GPT-5.3-Codexopenai4000001.7514.0closed / API
AionLabs: Aion-2.0aion-labs1310720.79999999999999991.5999999999999999closed / API
Google: Gemini 3.1 Pro Previewgoogle10485762.012.0closed / API
Google: Gemini 3.1 Pro Preview (batch)google10485761.06.0closed / API
Anthropic: Claude Sonnet 4.6anthropic10000003.015.0closed / API
Anthropic: Claude Sonnet 4.6 (batch)anthropic10000001.57.5closed / API
Qwen: Qwen3.5 Plus 2026-02-15qwen10000000.261.56closed / API
Qwen: Qwen3.5 397B A17Bqwen2621440.449999999999999963.0open
MiniMax: MiniMax M2.5minimax1980000.270.95open
Z.ai: GLM 5z-ai2048001.03.1999999999999997open
Anthropic: Claude Opus 4.6anthropic10000005.025.0closed / API
Anthropic: Claude Opus 4.6 (batch)anthropic10000002.512.5closed / API
Qwen: Qwen3 Coder Nextqwen2621440.120.7999999999999999open
MoonshotAI: Kimi K2.5moonshotai2621440.52.5open
Writer: Palmyra X5writer10400000.66.0closed / API
OpenAI: GPT Audioopenai1280002.510.0closed / API
OpenAI: GPT Audio Miniopenai1280000.62.4closed / API
Z.ai: GLM 4.7 Flashz-ai2000000.0605000000000000050.39999999999999997open
OpenAI: GPT-5.2-Codexopenai4000001.7514.0closed / API
Z.ai: GLM 4.7z-ai2048000.62.2open
Google: Gemini 3 Flash Previewgoogle10485760.53.0closed / API
Google: Gemini 3 Flash Preview (batch)google10485760.251.5closed / API
NVIDIA: Nemotron 3 Nano 30B A3Bnvidia2621440.060.24open
OpenAI: GPT-5.2 Chatopenai1280001.7514.0closed / API
OpenAI: GPT-5.2 Proopenai40000021.0168.0closed / API
OpenAI: GPT-5.2 Pro (batch)openai40000010.584.0closed / API
OpenAI: GPT-5.2openai4000001.7514.0closed / API
OpenAI: GPT-5.2 (batch)openai4000000.8757.0closed / API
Mistral: Devstral 2 2512mistralai2621440.399999999999999972.0open
Relace: Relace Searchrelace2560001.03.0closed / API
Z.ai: GLM 4.6Vz-ai1310720.30.8999999999999999open
OpenAI: GPT-5.1-Codex-Maxopenai4000001.2510.0closed / API
Amazon: Nova 2 Liteamazon10000000.32.5closed / API
Mistral: Ministral 3 14B 2512mistralai2621440.199999999999999980.19999999999999998open
Mistral: Ministral 3 8B 2512mistralai2621440.150.15open
Mistral: Ministral 3 3B 2512mistralai1310720.099999999999999990.09999999999999999open
Mistral: Mistral Large 3 2512mistralai2621440.51.5open
DeepSeek: DeepSeek V3.2deepseek1638400.260.38open
Anthropic: Claude Opus 4.5anthropic2000005.025.0closed / API
Anthropic: Claude Opus 4.5 (batch)anthropic2000002.512.5closed / API
Google: Nano Banana Pro (Gemini 3 Pro Image Preview)google655362.012.0closed / API
OpenAI: GPT-5.1openai4000001.2510.0closed / API
OpenAI: GPT-5.1 (batch)openai4000000.6255.0closed / API
OpenAI: GPT-5.1-Codexopenai4000001.2510.0closed / API
OpenAI: GPT-5.1-Codex-Miniopenai4000000.252.0closed / API
MoonshotAI: Kimi K2 Thinkingmoonshotai2621440.62.5open
Amazon: Nova Premier 1.0amazon10000002.512.5closed / API
Perplexity: Sonar Pro Searchperplexity2000003.015.0closed / API
Mistral: Voxtral Small 24B 2507mistralai327680.099999999999999990.3open
OpenAI: gpt-oss-safeguard-20bopenai1310720.0750.3open
OpenAI: GPT-5 Image Miniopenai4000002.52.0closed / API
Anthropic: Claude Haiku 4.5anthropic2000001.05.0closed / API
Anthropic: Claude Haiku 4.5 (batch)anthropic2000000.52.5closed / API
Qwen: Qwen3 VL 8B Instructqwen2621440.250.75open
OpenAI: GPT-5 Imageopenai40000010.010.0closed / API
Google: Nano Banana (Gemini 2.5 Flash Image)google327680.32.5closed / API
Qwen: Qwen3 VL 30B A3B Instructqwen2621440.150.6open
OpenAI: GPT-5 Proopenai40000015.0120.0closed / API
OpenAI: GPT-5 Pro (batch)openai4000007.560.0closed / API
Z.ai: GLM 4.6z-ai2048000.52.0open
Anthropic: Claude Sonnet 4.5anthropic10000003.015.0closed / API
Anthropic: Claude Sonnet 4.5 (batch)anthropic10000001.57.5closed / API
DeepSeek: DeepSeek V3.2 Expdeepseek1638400.270.41open
TheDrummer: Cydonia 24B V4.1thedrummer1310720.30.5open
Relace: Relace Apply 3relace2560000.851.25closed / API
Qwen: Qwen3 VL 235B A22B Instructqwen2621440.211.9open
DeepSeek: DeepSeek V3.1 Terminusdeepseek1638400.271.0open
Qwen: Qwen3 Coder Flashqwen10000000.1950.975closed / API
Qwen: Qwen3 Next 80B A3B Instructqwen2621440.099999999999999991.1open
MoonshotAI: Kimi K2 0905moonshotai2621440.62.5open
Nous: Hermes 4 405Bnousresearch1310721.03.0open
DeepSeek: DeepSeek V3.1deepseek1638400.250.95open
Mistral: Mistral Medium 3.1mistralai1310720.442.2closed / API
Z.ai: GLM 4.5Vz-ai655360.61.7999999999999998open
OpenAI: GPT-5openai4000001.2510.0closed / API
OpenAI: GPT-5 (batch)openai4000000.6255.0closed / API
OpenAI: GPT-5 Miniopenai4000000.252.0closed / API
OpenAI: GPT-5 Mini (batch)openai4000000.1251.0closed / API
OpenAI: GPT-5 Nanoopenai4000000.0499999999999999960.39999999999999997closed / API
OpenAI: GPT-5 Nano (batch)openai4000000.0249999999999999980.19999999999999998closed / API
OpenAI: gpt-oss-120bopenai1310720.090.36open
OpenAI: gpt-oss-120b (batch)openai1310720.02960.136open
OpenAI: gpt-oss-20bopenai1310720.0750.3open
OpenAI: gpt-oss-20b (batch)openai1310720.0240.112open
Anthropic: Claude Opus 4.1anthropic20000015.075.0closed / API
Anthropic: Claude Opus 4.1 (batch)anthropic2000007.537.5closed / API
Mistral: Codestral 2508mistralai2560000.30.8999999999999999closed / API
Qwen: Qwen3 Coder 30B A3B Instructqwen2621440.070.28open
Qwen: Qwen3 30B A3B Instruct 2507qwen2621440.099999999999999990.3open
Z.ai: GLM 4.5z-ai1310720.62.2open
Z.ai: GLM 4.5 Airz-ai1310720.130.85open
Qwen: Qwen3 235B A22B Thinking 2507qwen1280000.449999999999999963.5open
Qwen: Qwen3 Coder 480B A35Bqwen2621440.31.0open
ByteDance: UI-TARS 7B bytedance1280000.099999999999999990.19999999999999998open
Google: Gemini 2.5 Flash Litegoogle10485760.099999999999999990.39999999999999997closed / API
Qwen: Qwen3 235B A22B Instruct 2507qwen2621440.140.7999999999999999open
MoonshotAI: Kimi K2 0711moonshotai1310720.57000000000000012.3open
Venice: Uncensoredcognitivecomputations1280000.199999999999999980.8999999999999999open
Morph: Morph V3 Largemorph2621440.89999999999999991.9closed / API
Morph: Morph V3 Large (batch)morph2621440.449999999999999960.95closed / API
Morph: Morph V3 Fastmorph2621440.79999999999999991.2closed / API
Morph: Morph V3 Fast (batch)morph819200.399999999999999970.6closed / API
Mistral: Mistral Small 3.2 24Bmistralai2560000.0750.19999999999999998open
Google: Gemini 2.5 Flashgoogle10485760.32.5closed / API
Google: Gemini 2.5 Progoogle10485761.2510.0closed / API
OpenAI: o3 Proopenai20000020.080.0closed / API
Google: Gemini 2.5 Pro Preview 06-05google10485761.2510.0closed / API
DeepSeek: R1 0528deepseek1638400.57100000000000012.2859999999999996open
Mistral: Mistral Medium 3mistralai1310720.442.2closed / API
Meta: Llama Guard 4 12Bmeta-llama1638400.180.18open
Qwen: Qwen3 30B A3Bqwen409600.120.5open
Qwen: Qwen3 14Bqwen409600.120.24open
Qwen: Qwen3 32Bqwen1310720.080.28open
OpenAI: o3openai2000002.08.0closed / API
OpenAI: o3 (batch)openai2000001.04.0closed / API
OpenAI: o4 Mini (batch)openai2000000.552.2closed / API
OpenAI: GPT-4.1openai10475762.08.0closed / API
OpenAI: GPT-4.1 (batch)openai10475761.04.0closed / API
OpenAI: GPT-4.1 Miniopenai10475760.399999999999999971.5999999999999999closed / API
OpenAI: GPT-4.1 Mini (batch)openai10475760.199999999999999980.7999999999999999closed / API
OpenAI: GPT-4.1 Nanoopenai10475760.099999999999999990.39999999999999997closed / API
OpenAI: GPT-4.1 Nano (batch)openai10475760.0499999999999999960.19999999999999998closed / API
Meta: Llama 4 Maverickmeta-llama5242880.351.0open
Meta: Llama 4 Scoutmeta-llama13107200.099999999999999990.3open
DeepSeek: DeepSeek V3 0324deepseek1638400.251.0open
Mistral: Mistral Small 3.1 24Bmistralai1280000.3510.5549999999999999open
Google: Gemma 3 4Bgoogle1310720.040.049999999999999996open
Google: Gemma 3 12Bgoogle1310720.0499999999999999960.15open
Cohere: Command Acohere2560002.510.0open
Reka Flash 3rekaai655360.099999999999999990.19999999999999998open
Google: Gemma 3 27Bgoogle1310720.080.44999999999999996open
TheDrummer: Skyfall 36B V2thedrummer327680.550.7999999999999999open
Perplexity: Sonar Reasoning Properplexity1280002.08.0closed / API
Perplexity: Sonar Properplexity2000003.015.0closed / API
Perplexity: Sonar Deep Researchperplexity1280002.08.0closed / API
Mistral: Sabamistralai327680.199999999999999980.6closed / API
AionLabs: Aion-RP 1.0 (8B)aion-labs327680.79999999999999991.5999999999999999open
Qwen: Qwen2.5 VL 72B Instructqwen1280000.79999999999999991.0open
Qwen: Qwen-Plusqwen10000000.260.78closed / API
OpenAI: o3 Mini (batch)openai2000000.552.2closed / API
Mistral: Mistral Small 3mistralai327680.0499999999999999960.08open
Perplexity: Sonarperplexity1270721.01.0closed / API
Microsoft: Phi 4microsoft163840.070.14open
DeepSeek: DeepSeek V3deepseek1638400.25741.0287open
Cohere: Command R7B (12-2024)cohere1280000.03750.15open
Meta: Llama 3.3 70B Instructmeta-llama1310720.710.71open
Amazon: Nova Lite 1.0amazon3000000.060.24closed / API
Amazon: Nova Micro 1.0amazon1280000.0350.14closed / API
Amazon: Nova Pro 1.0amazon3000000.79999999999999993.1999999999999997closed / API
OpenAI: GPT-4o (2024-11-20)openai1280002.510.0closed / API
Mistral Large 2407mistralai1310722.06.0open
Qwen2.5 Coder 32B Instructqwen327680.661.0open
TheDrummer: UnslopNemo 12Bthedrummer10240000.399999999999999970.39999999999999997open
Magnum v4 72Banthracite-org327682.55.0open
Meta: Llama 3.2 3B Instructmeta-llama1310720.0499999999999999960.33open
Qwen2.5 72B Instructqwen327680.360.39999999999999997open
Cohere: Command R (08-2024)cohere1280000.150.6open
Cohere: Command R+ (08-2024)cohere1280002.510.0open
Sao10K: Llama 3.1 Euryale 70B v2.2sao10k1310720.850.85open
Sao10K: Llama 3 8B Lunarissao10k81920.040.049999999999999996open
OpenAI: GPT-4o (2024-08-06)openai1280002.510.0closed / API
Meta: Llama 3.1 70B Instructmeta-llama1310720.720.72open
Meta: Llama 3.1 8B Instructmeta-llama1310720.020.04open
Mistral: Mistral Nemomistralai1310720.0290.03open
OpenAI: GPT-4o-miniopenai1280000.150.6closed / API
OpenAI: GPT-4o-mini (2024-07-18)openai1280000.150.6closed / API
OpenAI: GPT-4o-mini (batch)openai1280000.0750.3closed / API
Google: Gemma 2 27Bgoogle81920.650.65open
OpenAI: GPT-4oopenai1280002.510.0closed / API
OpenAI: GPT-4o (2024-05-13)openai1280005.015.0closed / API
OpenAI: GPT-4o (batch)openai1280001.255.0closed / API
Mistral: Mixtral 8x22B Instructmistralai655362.06.0open
OpenAI: GPT-4 Turbo (batch)openai1280005.015.0closed / API
Mistral Largemistralai1280002.06.0closed / API
OpenAI: GPT-3.5 Turbo (older v0613)openai40951.02.0closed / API
OpenAI: GPT-3.5 Turbo 16kopenai163853.04.0closed / API
Mancer: Weaver (alpha)mancer80000.30.5closed / API
ReMM SLERP 13Bundi9561440.30.5open
MythoMax 13Bgryphe81920.30.5open
OpenAI: GPT-4openai819130.060.0closed / API
Auto Routeropenrouter2000000-1000000.0-1000000.0closed / API
Auto Codeopenrouter2000000-1000000.0-1000000.0closed / API
TypeSafe: Jev Routertypesafe1000000-1000000.0-1000000.0closed / API
NVIDIA: Switchyardnvidia1000000-1000000.0-1000000.0closed / API
Auto Router (Beta)openrouter2000000-1000000.0-1000000.0closed / API
OpenRouter: Fusionopenrouter1000000-1000000.0-1000000.0closed / API
Pareto Code Routeropenrouter2000000-1000000.0-1000000.0closed / API
Free Models Routeropenrouter2000000.00.0closed / API
Body Builder (beta)openrouter128000-1000000.0-1000000.0closed / API

Speed

Unknown. OpenRouter publishes per-provider throughput_last_30m (tokens/sec) and latency_last_30m (time to first token) on /api/v1/models/{author}/{slug}/endpoints, but their docs say those fields are visible only when authenticated with an API key or cookie. An unauthenticated GET to openai/gpt-4o/endpoints on 2026-11-22T12:28:32-05:00 returned HTTP 200 with both fields null for every listed provider. We did not use a key, and we will not invent tokens/sec or latency.

Artificial Analysis

Unknown. Their free API (/api/v2/language/models/free) requires an API key: an unauthenticated GET on 2026-11-22T12:28:32-05:00 returned HTTP 401 (“API key is required”). Their data-platform terms also limit free-tier redistribution to internal use with attribution, which does not cover republishing a public rankings table. See the live Artificial Analysis leaderboard.

ABUZ8 Arena v1 (our own measured set)

120 contamination-checked agent tool tasks (pick the right tool and arguments), scored exact-match, greedy decoding, on one RTX 5090. Date on the snapshot: 2026-08-19.

The regex baseline is there on purpose: a benchmark a regex can pass is measuring keywords, not reasoning. The earlier 30-task arena was solved 29/30 by regex, so it was retired and every claim made on it withdrawn. The internal disk path that was stored with this snapshot is not published here. Public pointer: the GitHub org abuz8studios-ship-it and data/bench.json.
SystemKindScore
Muse Glimmer 30B (local)model98.3
12-line regex baselinebaseline85.8
Jabarr / MUTHALLATH-1 m0 (0.6B + triangle organs)experiment77.5