Leaderboard | Coding

Models

Choose model family

Claude by Anthropic

Mistral by Mistral AI

More filters

Show inactive models

Hide models that are no longer actively available on Yupp.

Turns

Filter model performance by the number of turns in a conversation.

All Single turn Multiple turns

Open license models

Filter the leaderboard to only show models that have an open license.

All selected Open license Proprietary license

1596

Claude Opus 4.6

1594

Claude Sonnet 4.6

1594

GPT-5.4

1566

Claude Opus 4.6 (Thinking)

1506

Claude Sonnet 4.6 (Thinking)

1464

GPT-5.4 (High)

1446

Claude Opus 4.5 (Thinking)

1418

Gemini 3.1 Pro

1409

Claude Opus 4.5

1381

GPT-5.3 Codex (High)

1362

Claude Sonnet 4.5 (Thinking)

1358

GPT-5.2 Instant

1353

Claude Haiku 4.5 (Extended Thinking)

1352

Claude Opus 4 (Thinking)

1340

GPT-5.2

Last updated about 1 month ago

Rank	Overall	Name	VIBE Score	Confidence Interval	Votes	Downvote %	Abort %	Speed	Latency	Context	Cost (Input)	Cost (Output)
1	1	Claude Opus 4.6	1596	±6	21.6K	1.1%	2.1%	48 tps	1.7s	200K	$5.00	$25.00
2	1	Claude Sonnet 4.6	1594	±10	15.7K	1.4%	1.6%	47 tps	1.2s	200K	$3.00	$15.00
3	1	GPT-5.4	1594	±14	4.4K	1.6%	2.6%	55 tps	0.8s	1M	$2.50	$15.00
4	4	Claude Opus 4.6 (Thinking)	1566	±8	16.5K	1.6%	2.5%	56 tps	1.6s	200K	$5.00	$25.00
5	5	Claude Sonnet 4.6 (Thinking)	1506	±8	16.2K	3.5%	4.7%	57 tps	1.1s	200K	$3.00	$15.00
6	6	GPT-5.4 (High)	1464	±12	4.9K	3.9%	4.6%	68 tps	7.9s	1M	$2.50	$15.00
7	6	Claude Opus 4.5 (Thinking)	1446	±4	60.8K	1.9%	1.8%	49 tps	1.4s	200K	$5.00	$25.00
8	7	Gemini 3.1 Pro	1418	±9	22K	2.5%	3.5%	35 tps	4.1s	1M	$2.00	$12.00
9	7	Claude Opus 4.5	1409	±5	15.1K	2.2%	1.5%	45 tps	1.5s	200K	$5.00	$25.00
10	9	GPT-5.3 Codex (High)	1381	±9	3.2K	1.2%	2.0%	61 tps	17.8s	400K	$1.75	$14.00
11	10	Claude Sonnet 4.5 (Thinking)	1362	±4	58.2K	3.3%	1.9%	44 tps	1.1s	200K	$3.00	$15.00
12	10	GPT-5.2 Instant	1358	±6	15.7K	3.3%	1.7%	52 tps	2.0s	400K	$1.75	$14.00
13	12	Claude Haiku 4.5 (Extended Thinking)	1353	±4	14.3K	3.8%	1.4%	115 tps	0.7s	200K	$1.00	$5.00
14	13	Claude Opus 4 (Thinking)	1352	±5	2.6K	2.6%	<0.1%	28 tps	1.3s	200K	$15.00	$75.00
15	13	GPT-5.2	1340	±8	11.3K	3.2%	4.1%	18 tps	2.7s	400K	$1.75	$14.00
16	13	Gemini 3 Pro	1337	±5	59.4K	2.6%	2.1%	50 tps	3.6s	1M	$2.00	$12.00
17	15	GLM 5	1324	±14	11.7K	3.3%	3.4%	36 tps	2.7s	200K	$0.72	$2.55
18	15	GPT-5.1	1319	±7	12.9K	3.4%	2.3%	71 tps	1.4s	400K	$1.42	$11.33
19	17	Claude Sonnet 4.5	1307	±3	20.9K	5.0%	1.4%	41 tps	1.3s	200K	$1.80	$9.00
20	17	GPT-5.2 (High)	1297	±8	30.7K	2.8%	6.7%	18 tps	16.3s	400K	$1.75	$14.00
21	21	GPT-5.1 (Medium)	1291	±9	3.2K	6.4%	<0.1%	86 tps	3.8s	400K	$0.83	$6.67
22	19	Gemini 3 Pro (Low)	1291	±6	11.9K	4.2%	2.4%	51 tps	3.5s	1M	$2.00	$12.00
23	19	GPT-5.1 (High)	1290	±6	19.1K	3.5%	3.2%	76 tps	6.9s	400K	$1.25	$10.00
24	19	Gemini 3 Flash Preview Thinking	1286	±6	32.7K	3.3%	1.6%	3 tps	6.2s	1M	$0.50	$3.00
25	19	Claude Haiku 4.5	1283	±3	16.4K	4.5%	1.1%	100 tps	0.9s	200K	$1.00	$5.00
26	19	MiniMax M2.5	1283	±28	510	3.8%	1.4%	70 tps	1.9s	205K	$0.28	$1.20
27	19	GPT-5.3 Codex (Medium)	1278	±27	1.1K	2.3%	2.3%	62 tps	10.3s	400K	$1.75	$14.00
28	29	Claude Opus 4	1274	±4	12.4K	2.7%	<0.1%	25 tps	1.5s	200K	$15.00	$75.00
29	29	Claude Opus 4.1 (Thinking)	1272	±5	7.7K	5.2%	<0.1%	20 tps	3.9s	200K	$15.00	$75.00
30	19	GPT-5.3 Instant	1271	±12	4.2K	2.5%	0.9%	63 tps	0.8s	400K	$1.75	$14.00
31	27	Claude Sonnet 4 (Thinking)	1261	±3	25.9K	2.9%	1.5%	52 tps	1.5s	200K	$3.00	$13.67
32	27	GPT-5 Codex (High)	1260	±7	18.5K	3.3%	3.2%	122 tps	7.1s	400K	$1.25	$10.00
33	27	GPT-5 (High)	1259	±4	16.2K	3.5%	4.5%	81 tps	35.9s	400K	$1.25	$10.00
34	27	GPT-5.2 Codex (High)	1257	±12	3.1K	2.8%	8.8%	41 tps	12.9s	400K	$1.75	$14.00
35	36	Claude Opus 4.1	1254	±4	7.1K	4.6%	3.0%	17 tps	3.7s	200K	$15.00	$75.00
36	31	GPT-5.1 Codex (High)	1240	±8	37K	3.3%	3.2%	96 tps	3.9s	400K	$1.25	$10.00
37	31	Grok 4.1 Fast Non-Reasoning	1239	±6	9.4K	5.4%	0.9%	101 tps	0.5s	2M	$0.20	$0.50
38	31	GPT-5 Chat	1231	±4	35K	4.5%	1.3%	95 tps	0.9s	400K	$1.25	$10.00
39	37	Nova Experimental Chat 11-10	1230	±8	5.2K	6.3%	0.4%	84 tps	8.9s	98K	$0	$0
40	37	Polaris Alpha	1226	±14	755	5.6%	<0.1%	48 tps	1.1s	256K	$0	$0
41	44	GPT-4.5 Preview	1223	±7	2.5K	1.8%	<0.1%	36 tps	3.0s	200K	$75.00	$150.00
42	44	Nova Experimental Chat 10-20	1221	±5	4.4K	8.1%	<0.1%	30 tps	0.5s	98K	$0	$0
43	36	GPT-5.2 (Extra High)	1221	±9	8K	3.5%	13.2%	17 tps	20.5s	400K	$1.75	$14.00
44	36	Qwen3 VL 235B A22B Instruct	1220	±7	5.6K	6.7%	3.1%	75 tps	1.9s	129K	$0.37	$1.81
45	36	GPT-5 Codex (Medium)	1214	±6	8.8K	3.9%	4.1%	122 tps	5.2s	400K	$1.25	$10.00
46	36	GPT-5.2 Codex (Medium)	1211	±12	2.4K	3.0%	5.7%	37 tps	6.3s	400K	$1.75	$14.00
47	53	Claude Sonnet 3.7 (Thinking)	1210	±3	13.6K	3.1%	<0.1%	41 tps	2.6s	200K	$3.00	$15.00
48	53	Mistral Medium 3.1	1206	±5	16.4K	5.1%	<0.1%	77 tps	0.7s	128K	$0.40	$2.00
49	43	Claude Sonnet 4	1205	±3	43.2K	3.7%	1.8%	49 tps	1.3s	200K	$3.00	$15.00
50	43	Gemini 3 Flash Preview	1205	±11	7.2K	3.7%	1.3%	138 tps	1.4s	1M	$0.50	$3.00
51	43	Gemini 2.5 Pro High	1204	±3	21.1K	5.7%	1.5%	48 tps	2.3s	1M	$1.25	$10.00
52	43	Qwen3 Max Instruct Preview	1203	±6	16.1K	4.6%	1.1%	31 tps	1.7s	256K	$1.43	$6.61
53	58	Claude Sonnet 3.7	1201	±4	12.1K	3.2%	<0.1%	39 tps	1.6s	200K	$3.00	$15.00
54	43	GPT-5.1 Codex Max	1200	±12	6.4K	3.9%	3.0%	118 tps	4.1s	400K	$1.25	$10.00
55	43	MiniMax M2.1 Lightning	1197	±23	875	3.3%	1.7%	52 tps	2.1s	205K	$0.30	$2.40
56	49	Qwen3 30B A3B Instruct 2507	1194	±5	12.7K	5.7%	1.2%	55 tps	1.3s	131K	$0.13	$0.72
57	62	OpenAI o1-mini	1192	±4	15K	4.6%	<0.1%	118 tps	N/A	128K	$1.13	$4.51
58	49	MiniMax M2.1	1192	±8	19.4K	3.6%	2.1%	66 tps	2.6s	205K	$0.30	$1.20
59	49	DeepSeek V3.2	1189	±8	5.1K	4.7%	1.4%	83 tps	5.1s	131K	$0.43	$1.09
60	62	Qwen Plus 0728	1189	±8	2.1K	7.5%	<0.1%	55 tps	0.9s	1M	$0.40	$1.20
61	49	MiniMax M2.5 FP8	1185	±17	610	3.2%	3.6%	33 tps	1.7s	205K	$0.45	$1.75
62	49	GPT-5	1185	±4	21.3K	5.3%	3.1%	78 tps	23.1s	400K	$1.25	$9.67
63	49	Grok 4 Fast Non-Reasoning	1185	±5	8.1K	7.1%	1.5%	93 tps	0.6s	2M	$0.27	$0.67
64	49	MiniMax M2	1183	±5	19.7K	4.2%	2.2%	39 tps	2.3s	205K	$0.21	$0.85
65	49	Nova Experimental Chat 12-10	1182	±9	2.9K	3.8%	2.4%	84 tps	12.9s	98K	$0	$0
66	49	GLM 4.6	1182	±7	17.2K	4.4%	5.4%	39 tps	1.5s	200K	$0.42	$1.66
67	49	GPT-5.3 Codex (Low)	1178	±28	510	1.0%	1.8%	61 tps	4.3s	400K	$1.75	$14.00
68	60	Grok 4.1 Fast Reasoning	1178	±7	39.5K	4.4%	1.5%	58 tps	7.3s	2M	$0.20	$0.50
69	60	Grok 4 Fast Reasoning	1177	±3	14.5K	5.0%	2.1%	102 tps	3.1s	2M	$0.30	$0.75
70	60	Gemini 2.5 Pro	1176	±3	37.9K	4.8%	2.3%	45 tps	2.6s	1M	$1.25	$10.00
71	75	Gemini 2.5 Flash Thinking Preview 0925	1173	±7	9.2K	6.8%	<0.1%	111 tps	4.7s	1M	$0.30	$2.50
72	60	Qwen3 235B A22B Instruct 2507	1172	±4	12.6K	6.4%	6.8%	13 tps	1.9s	262K	$0.13	$0.52
73	60	Claude Sonnet 3.5 v2	1171	±6	5.5K	3.4%	<0.1%	46 tps	1.4s	200K	$3.00	$15.00
74	60	GPT-5.1 Codex (Medium)	1171	±14	3K	3.2%	4.6%	71 tps	3.7s	400K	$1.25	$10.00
75	60	GPT-5.1 Instant	1171	±8	8.3K	4.1%	1.3%	50 tps	1.9s	400K	$1.25	$10.00
76	75	Gemini 2.5 Pro Low	1170	±4	9.6K	8.1%	<0.1%	89 tps	2.4s	1M	$1.25	$10.00
77	60	Grok 4.20 Beta Reasoning	1167	±22	1.2K	4.1%	1.1%	77 tps	4.5s	2M	$2.00	$5.50
78	69	Qwen3.5 35B A3B	1164	±25	865	3.9%	2.1%	116 tps	2.1s	256K	$0.63	$1.13
79	69	GPT-5 Codex (Low)	1163	±10	5K	4.1%	2.7%	112 tps	3.5s	400K	$1.25	$10.00
80	69	GLM 4.7	1161	±7	16.8K	3.7%	5.8%	40 tps	1.5s	200K	$0.77	$1.73
81	86	Gemini 2.5 Flash Preview	1161	±8	3K	1.1%	<0.1%	138 tps	6.9s	1M	$0.15	$0.60
82	86	GPT-5 (Minimal)	1158	±5	8.3K	7.4%	<0.1%	67 tps	1.4s	400K	$1.25	$10.00
83	69	DeepSeek V3.1 Terminus Chat	1158	±5	6.5K	6.9%	3.4%	27 tps	1.5s	131K	$0.86	$1.80
84	74	Qwen Plus (Aug'24)	1146	±5	17.2K	4.7%	1.4%	53 tps	1.3s	30K	$0.40	$1.20
85	74	Qwen3.5 397B A17B	1142	±14	2.5K	2.9%	4.3%	57 tps	1.4s	256K	$0.52	$3.00
86	74	Gemini 2.5 Flash Preview 0925	1140	±6	7.6K	6.0%	1.2%	5 tps	0.9s	1M	$0.13	$0.97
87	93	Gemini 2.5 Flash Preview Thinking	1136	±10	1.4K	1.8%	<0.1%	26 tps	1.8s	1M	$0.15	$1.76
88	77	GPT-5 Mini	1131	±5	8.6K	5.4%	2.6%	66 tps	14.2s	400K	$0.25	$2.00
89	77	DeepSeek V3.1 Turbo	1130	±7	4.8K	5.3%	0.9%	173 tps	1.3s	164K	$2.00	$3.75
90	77	Grok 4.20 Multi Agent Beta	1129	±19	945	3.6%	1.2%	56 tps	8.8s	2M	$2.00	$6.00
91	77	Qwen3 Max Thinking Preview	1127	±10	6.3K	5.7%	3.1%	40 tps	2.1s	256K	$1.20	$6.00
92	77	Grok 4	1125	±3	39.6K	4.4%	3.9%	29 tps	11.1s	256K	$3.00	$15.00
93	97	Ministral 8B 2512	1125	±15	510	7.3%	<0.1%	174 tps	0.5s	128K	$0.15	$0.15
94	77	GPT-4.1	1123	±5	32.8K	5.2%	3.7%	112 tps	1.3s	1M	$2.00	$8.00
95	77	Gemini 2.5 Flash Lite Preview 0925	1122	±7	8.5K	6.6%	1.2%	209 tps	0.7s	1M	$0.25	$0.35
96	97	Gemini 2.5 Pro Preview 0605	1121	±10	1.7K	2.3%	<0.1%	0 tps	3.7s	1M	$1.25	$10.00
97	85	Gemini 2.5 Flash Thinking	1118	±4	13.7K	3.6%	2.2%	88 tps	6.4s	1M	$0.30	$2.50
98	85	GPT-5 Mini Minimal	1114	±12	3.2K	8.5%	1.2%	63 tps	1.4s	400K	$0.25	$2.00
99	85	GPT-5.2 Codex (Low)	1113	±19	1.2K	3.2%	4.5%	41 tps	5.0s	400K	$1.75	$14.00
100	108	Gemini 2.5 Pro Preview 0325	1111	±11	1.5K	3.2%	<0.1%	3 tps	16.6s	1M	$1.25	$10.00
101	85	DeepSeek V3.1 Chat	1110	±7	4.9K	6.6%	2.8%	21 tps	1.6s	131K	$0.38	$1.00
102	85	Qwen3 Omni 30B A3B Thinking	1110	±10	2.3K	6.0%	3.7%	67 tps	1.2s	66K	$0.97	$1.79
103	90	Qwen Max	1107	±4	18.3K	4.2%	1.5%	49 tps	1.5s	33K	$1.60	$6.40
104	114	GPT-5 Mini Low	1104	±8	2.8K	7.2%	<0.1%	69 tps	3.2s	400K	$0.25	$2.00
105	90	Gemini 2.5 Flash Lite	1103	±5	21.3K	6.2%	1.3%	210 tps	0.7s	1M	$0.10	$0.40
106	90	Grok 3 Fast	1102	±14	2.5K	4.7%	1.7%	52 tps	2.4s	131K	$5.00	$25.00
107	90	GPT-4o	1102	±5	8.5K	3.7%	1.0%	49 tps	2.4s	128K	$3.71	$12.57
108	90	DeepSeek V3 0324	1100	±4	15.1K	4.3%	5.8%	12 tps	2.7s	164K	$0.38	$0.93
109	90	Qwen3 Coder 480B A35B Instruct	1099	±8	3.1K	4.5%	3.3%	61 tps	2.0s	262K	$0.71	$1.34
110	98	Gemini 2.5 Flash	1098	±4	35.9K	3.2%	1.3%	2 tps	3.7s	1M	$0.30	$2.50
111	98	Grok 3	1098	±4	19.1K	5.5%	1.5%	53 tps	0.6s	1M	$3.67	$18.33
112	98	DeepSeek V3 0324 Turbo	1093	±5	15.5K	5.7%	6.3%	12 tps	2.4s	164K	$0.73	$1.79
113	123	Nova Experimental Chat 10-09	1091	±7	3.2K	10.7%	<0.1%	59 tps	6.1s	98K	$0	$0
114	123	Sherlock Dash Alpha	1090	±19	835	6.7%	<0.1%	68 tps	0.7s	2M	$0	$0
115	98	OpenAI o3-pro	1090	±8	5.4K	4.3%	5.2%	22 tps	70.8s	200K	$20.00	$80.00
116	98	DeepSeek V3.1	1089	±12	2.3K	4.7%	0.8%	197 tps	0.4s	164K	$0.55	$1.60
117	132	Claude Sonnet 3.5	1088	±10	2.9K	4.9%	1.0%	40 tps	2.7s	200K	$3.00	$15.00
118	132	Qwen Plus 0728 (Thinking)	1087	±9	1.2K	8.9%	<0.1%	56 tps	1.1s	1M	$0.40	$4.00
119	105	GPT-4.1 mini	1087	±5	19.7K	4.2%	1.1%	67 tps	0.9s	1M	$0.34	$1.60
120	105	GPT-4.1 nano	1085	±5	17K	5.0%	0.6%	175 tps	0.5s	1M	$0.10	$0.40
121	105	Qwen3 Omni 30B A3B Instruct	1085	±13	775	4.3%	3.9%	65 tps	1.2s	66K	$0.35	$0.97
122	105	DeepSeek V3 (Turbo)	1082	±20	1.5K	5.1%	1.5%	32 tps	1.5s	64K	$0.40	$1.30
123	132	Solar Pro 2 250710	1081	±5	10.6K	6.9%	<0.1%	9 tps	N/A	66K	$0.50	$0.50
124	105	Seed 1.8 251228	1081	±10	3.2K	3.1%	3.7%	41 tps	2.1s	256K	$0.25	$2.00
125	105	Mistral Medium	1080	±4	9.6K	5.6%	1.8%	48 tps	0.6s	33K	$1.48	$4.55
126	105	Qwen3 Max Thinking	1080	±18	1.5K	2.0%	13.5%	32 tps	2.3s	256K	$1.20	$6.00
127	112	GLM 4.5	1075	±5	6K	7.0%	3.7%	46 tps	1.4s	131K	$0.43	$1.63
128	112	Kimi K2 0905	1074	±7	8.7K	4.3%	4.0%	30 tps	1.4s	262K	$0.63	$2.39
129	112	GPT-5 (Low)	1070	±14	690	3.5%	1.8%	75 tps	8.2s	400K	$1.25	$10.00
130	112	Kimi K2 0905 Turbo	1070	±6	7.5K	9.1%	0.7%	373 tps	0.5s	262K	$1.70	$6.50
131	144	Qwen Turbo	1064	±5	10K	6.0%	<0.1%	53 tps	1.1s	1M	$0.05	$0.20
132	112	Grok 4.20 Beta Non-reasoning	1063	±36	500	4.8%	1.1%	151 tps	0.6s	2M	$2.00	$6.00
133	119	OpenAI o1	1062	±6	9.9K	3.3%	4.2%	92 tps	5.5s	200K	$15.00	$60.00
134	119	OpenAI o1-pro	1061	±20	680	7.5%	5.2%	33 tps	72.8s	200K	$150.00	$600.00
135	119	Gemini 2.5 Flash Lite Thinking	1061	±4	9.8K	6.2%	1.0%	118 tps	4.4s	1M	$0.03	$0.13
136	151	GLM 4.5 FP8	1060	±18	610	8.3%	<0.1%	59 tps	1.2s	131K	$0.41	$1.65
137	119	Seed 2.0 Lite (Medium)	1058	±20	525	3.7%	6.6%	33 tps	1.6s	256K	$0.25	$2.00
138	119	LongCat Flash Chat	1058	±12	2.7K	5.9%	0.8%	85 tps	0.9s	131K	$0.14	$0.68
139	151	OpenAI Codex Mini	1057	±5	9.8K	3.3%	<0.1%	46 tps	2.1s	200K	$1.50	$6.00
140	119	GPT-5.1 Codex Mini (Medium)	1057	±15	1.9K	4.9%	4.6%	69 tps	4.1s	400K	$0.25	$2.00
141	119	GPT-5.1 Codex Mini (High)	1054	±15	2.2K	3.9%	5.9%	70 tps	4.6s	400K	$0.25	$2.00
142	151	GLM 4.5 X	1051	±16	645	5.8%	<0.1%	48 tps	2.8s	131K	$2.20	$8.90
143	128	ERNIE 4.5 300B A47B	1049	±4	13.5K	3.9%	4.7%	23 tps	2.3s	123K	$0.28	$1.10
144	164	Arcee AI Maestro Reasoning	1046	±7	3.8K	4.6%	<0.1%	85 tps	0.3s	131K	$0.90	$3.30
145	128	Cogito v2.1 671B	1044	±19	1.2K	4.6%	0.8%	85 tps	0.5s	128K	$1.25	$1.25
146	128	Qwen3 32B	1044	±19	850	6.6%	3.9%	30 tps	3.1s	41K	$0.12	$0.42
147	164	Grok 4 0709 EU	1043	±11	1.3K	5.7%	<0.1%	33 tps	8.2s	128K	$3.00	$15.00
148	128	GLM 4.5 AirX	1042	±15	1.1K	6.9%	3.3%	75 tps	1.2s	131K	$1.10	$4.50
149	128	Kimi K2 Thinking	1042	±10	3.3K	5.1%	4.2%	61 tps	5.9s	262K	$0.24	$1.03
150	128	OpenAI o4-mini	1042	±5	8.5K	6.4%	1.4%	97 tps	7.0s	128K	$1.10	$4.40
151	164	EXAONE Deep 32B	1040	±14	880	1.7%	<0.1%	24 tps	N/A	33K	$0	$0
152	128	Gemini 3.1 Flash Lite Preview Thinking	1039	±16	1.4K	4.2%	1.7%	75 tps	4.7s	1M	$0.25	$1.50
153	135	Qwen3 Next 80B A3B Thinking	1035	±5	6.2K	7.4%	0.6%	175 tps	1.3s	256K	$0.21	$2.26
154	135	Gemini 2.5 Flash Lite Thinking Preview 0925	1035	±7	5.8K	6.8%	1.5%	152 tps	3.0s	1M	$0.10	$0.40
155	135	Gemini 3.1 Flash Lite Preview	1034	±21	980	4.4%	1.0%	8 tps	1.2s	1M	$0.25	$1.50
156	135	DeepSeek V3.2 Speciale	1030	±10	2.3K	6.1%	6.0%	43 tps	1.4s	131K	$0.84	$1.52
157	135	Gemini 2.0 Flash Lite	1029	±5	14.7K	9.5%	<0.1%	42 tps	0.5s	1M	$0.08	$0.30
158	174	Claude Haiku 3.5	1028	±6	6.4K	4.9%	0.8%	40 tps	2.8s	200K	$0.80	$4.00
159	135	Amazon Nova 2 Lite	1026	±10	3.6K	6.0%	1.0%	137 tps	0.6s	300K	$0.35	$2.95
160	144	DeepSeek V3.1 Nex N1	1021	±19	565	5.0%	3.4%	24 tps	7.2s	131K	$0.14	$0.50
161	144	OpenAI o3	1020	±7	5.9K	4.0%	0.9%	85 tps	6.8s	128K	$7.33	$29.33
162	144	Gemini 2.0 Flash	1018	±7	8.2K	3.8%	<0.1%	76 tps	0.5s	1M	$0.14	$0.56
163	189	GLM 4.5 Air	1016	±6	7.1K	6.9%	<0.1%	22 tps	1.4s	131K	$0.10	$0.38
164	148	Qwen3 VL 235B A22B Thinking	1009	±6	4.6K	8.3%	4.3%	47 tps	3.0s	127K	$0.47	$3.31
165	148	Qwen3 Coder Plus	1007	±22	610	4.7%	5.1%	56 tps	2.3s	128K	$1.80	$9.80
166	195	GPT-5 Mini High	1002	±9	3K	7.7%	<0.1%	33 tps	3.9s	400K	$0.25	$2.00
167	148	Qwen 2.5 VL 32B Instruct	1001	±21	865	4.9%	6.3%	43 tps	3.2s	128K	$0.35	$0.62
168	148	Qwen3 235B A22B Thinking 2507	1000	±10	2.8K	4.4%	2.5%	53 tps	1.6s	131K	$0.59	$5.70
169	148	OpenAI o3-mini-high	999	±5	8.3K	4.1%	2.4%	231 tps	10.5s	200K	$1.10	$4.40
170	148	OpenAI o3-mini	999	±4	15K	5.5%	0.8%	143 tps	3.3s	200K	$1.10	$4.40
171	148	OpenAI o4-mini-high	995	±7	13.6K	6.2%	1.9%	117 tps	15.9s	200K	$1.10	$4.40
172	148	Seed 1.6 250615	995	±21	1.6K	6.0%	3.1%	46 tps	2.2s	256K	$0.25	$2.00
173	195	Arcee AI Virtuoso-Large	994	±8	3K	5.7%	<0.1%	64 tps	0.5s	131K	$0.75	$1.20
174	195	Claude Haiku 3	992	±11	2.8K	3.0%	0.4%	62 tps	0.5s	200K	$0.25	$1.25
175	159	GPT-5 Nano	989	±6	4.6K	8.0%	3.2%	113 tps	20.9s	400K	$0.05	$0.40
176	159	OpenAI o3-mini-low	988	±6	12.2K	6.4%	0.7%	139 tps	1.5s	200K	$1.10	$4.40
177	159	Grok Code Fast 1	987	±9	2.5K	6.0%	5.9%	294 tps	0.5s	256K	$0.20	$1.50
178	159	GLM 4.6V	986	±8	3K	5.5%	6.4%	21 tps	1.8s	128K	$0.38	$0.90
179	195	Cypher Alpha	985	±20	735	8.7%	<0.1%	4 tps	N/A	1M	$0	$0
180	195	GLM 4.6 FP8	982	±17	1.2K	11.7%	<0.1%	56 tps	1.8s	200K	$0.40	$1.75
181	159	Kimi K2 0711	981	±6	7K	4.5%	1.6%	29 tps	1.3s	131K	$0.72	$2.60
182	159	Seed 2.0 Mini (Medium)	981	±35	570	5.8%	11.9%	33 tps	1.7s	256K	$0.15	$0.60
183	167	DeepSeek V3.1 Thinking	976	±9	5.2K	9.5%	7.1%	18 tps	1.8s	131K	$0.23	$0.75
184	211	Grok 4 (Low Reasoning)	975	±21	520	2.8%	<0.1%	18 tps	9.5s	256K	$0	$0
185	167	Nemotron 3 Nano	974	±46	580	6.5%	1.3%	216 tps	0.8s	256K	$0.05	$4.94
186	211	Arcee AI Coder-Large	972	±15	985	4.4%	<0.1%	60 tps	1.6s	33K	$0.50	$0.80
187	219	Arcee Coder Large	971	±7	3.6K	2.6%	<0.1%	54 tps	1.3s	33K	$0.50	$0.80
188	167	Mistral Small 3.2 24B	970	±13	4.6K	4.9%	2.8%	141 tps	0.7s	33K	$0.02	$0.08
189	167	Llama 4 Scout	965	±5	17.5K	5.3%	0.6%	88 tps	5.1s	131K	$0.18	$0.46
190	167	Devstral Medium	962	±11	3.5K	5.2%	1.5%	77 tps	0.6s	131K	$0.40	$2.00
191	167	Qwen 2.5 72B	960	±15	1.4K	4.5%	1.2%	96 tps	1.2s	131K	$0.14	$0.26
192	179	Qwen3 30B A3B Thinking 2507	953	±10	3.5K	4.7%	0.5%	124 tps	1.2s	131K	$0.16	$1.70
193	230	Magistral Medium	952	±16	1.3K	10.8%	<0.1%	95 tps	0.5s	41K	$2.00	$5.00
194	179	Switchpoint Router	949	±10	2.7K	3.6%	1.7%	71 tps	4.9s	131K	$0.85	$3.40
195	179	Qwen3 8B	948	±9	4.2K	8.2%	2.4%	61 tps	1.4s	41K	$0.02	$0.07
196	179	Ministral 14B 3.0	948	±16	805	8.5%	2.0%	119 tps	0.5s	128K	$0.20	$0.20
197	179	Grok 3 Mini Fast	943	±7	9K	7.0%	1.6%	44 tps	0.5s	131K	$0.60	$4.00
198	179	ERNIE 4.5 21B A3B	943	±28	540	6.9%	2.3%	78 tps	1.5s	120K	$0.05	$0.19
199	179	ERNIE 4.5 VL 424B A47B	942	±18	725	6.5%	4.9%	36 tps	3.5s	123K	$0.42	$1.25
200	179	NVIDIA Llama 3.3 Nemotron Super 49B v1.5	941	±19	1.4K	6.9%	2.0%	50 tps	0.6s	131K	$0.09	$0.33
201	230	Jamba 1.7 Mini	936	±24	1K	8.4%	<0.1%	84 tps	0.9s	256K	$0.20	$0.40
202	230	Dobby Unhinged Llama 3.3 70B	935	±19	860	2.8%	<0.1%	41 tps	0.4s	128K	$0.90	$0.90
203	230	R1 1776	935	±9	3.3K	4.2%	<0.1%	61 tps	1.0s	128K	$2.00	$8.00
204	189	Llama 3.3 70B	933	±10	3K	6.6%	0.3%	500 tps	0.5s	8K	$0.48	$0.66
205	245	Llama 3.1 70B Instruct Turbo	933	±11	4.1K	3.8%	<0.1%	110 tps	0.8s	128K	$0.88	$0.88
206	189	Grok 3 Mini	927	±6	9.9K	6.4%	1.2%	43 tps	0.5s	131K	$0.30	$0.50
207	189	Jamba 1.6 Large	924	±9	3.3K	3.8%	2.0%	59 tps	1.2s	256K	$1.33	$5.33
208	245	Grok 3 Mini Beta	922	±14	1.8K	1.9%	<0.1%	75 tps	0.5s	131K	$0.45	$2.25
209	245	GLM Z1 32B	921	±10	1.9K	10.1%	<0.1%	18 tps	9.3s	33K	$0.09	$0.11
210	245	GPT-5 Nano Minimal	920	±13	1.4K	10.8%	<0.1%	88 tps	0.8s	400K	$0.05	$0.40
211	245	Solar Pro 2 250710 (Reasoning)	919	±10	2.6K	3.9%	<0.1%	9 tps	N/A	66K	$0.50	$0.50
212	189	Llama 3.3 Swallow 70B Instruct	919	±8	3.5K	5.5%	1.4%	153 tps	1.3s	131K	$0.13	$0.39
213	189	Jamba 1.7 Large	917	±16	975	8.0%	1.3%	58 tps	1.0s	256K	$1.33	$5.33
214	189	Devstral Small	916	±17	1.4K	5.0%	2.4%	180 tps	0.6s	131K	$0.10	$0.30
215	189	Rnj-1 Instruct	915	±21	970	6.7%	0.6%	103 tps	0.3s	33K	$0.15	$0.15
216	189	Seed 1.6 Flash 250715	913	±16	1.2K	5.7%	2.5%	108 tps	1.6s	256K	$0.07	$0.30
217	245	Solar Pro 3 (Reasoning)	913	±18	595	4.8%	3.2%	118 tps	1.2s	131K	$0.15	$0.60
218	189	Inception Mercury Coder Small Beta	912	±20	610	3.2%	1.7%	270 tps	1.4s	32K	$0.25	$1.00
219	264	YouTube	910	±13	2K	5.5%	<0.1%	34 tps	2.7s	32K	$0.99	$0.99
220	201	Magistral Small 2506	908	±11	4.3K	3.1%	1.6%	156 tps	0.5s	40K	$0.37	$1.10
221	201	GPT-3.5 Turbo	908	±15	1.2K	2.5%	1.3%	74 tps	0.9s	16K	$0.75	$1.75
222	264	Fauna Fox	908	±10	3.4K	8.2%	<0.1%	194 tps	0.3s	128K	$0.04	$0.15
223	201	Llama 3 8B	904	±10	3.2K	3.5%	6.0%	85 tps	0.7s	8K	$0.12	$0.16
224	201	Mistral Small 3.2 24B Instruct	903	±20	850	8.6%	1.9%	113 tps	1.1s	131K	$0.02	$0.08
225	264	DeepSeek R1T Chimera	901	±9	2.9K	6.7%	<0.1%	46 tps	1.1s	164K	$0.09	$0.36
226	264	Grok 2	901	±7	2.3K	2.7%	<0.1%	55 tps	1.1s	131K	$2.00	$10.00
227	201	GPT-4o mini	900	±14	2.8K	5.3%	2.1%	71 tps	1.7s	128K	$0.15	$0.60
228	201	Moonshot V1 Auto	899	±22	930	4.1%	1.2%	54 tps	1.5s	8K	$2.00	$5.00
229	201	Amazon Nova Pro 1.0	894	±10	5.7K	4.0%	0.9%	96 tps	0.7s	300K	$0.80	$1.70
230	264	Exaone 3.5 32B Instruct	893	±21	650	3.0%	<0.1%	17 tps	N/A	33K	$0	$0
231	280	Venice Uncensored	891	±29	615	6.1%	<0.1%	59 tps	3.9s	33K	$0	$0
232	280	Gemini 1.5 Pro	887	±8	2.3K	2.3%	<0.1%	15 tps	0.0s	2M	$0.78	$3.13
233	210	Magistral Medium 2509	883	±16	2.6K	9.5%	4.0%	58 tps	0.9s	131K	$2.00	$5.00
234	280	AFM 4.5B Preview	882	±16	2.5K	3.1%	<0.1%	32 tps	0.0s	66K	$0	$0
235	210	Gemma 3n E4B	882	±7	6K	4.5%	2.0%	30 tps	0.5s	8K	$0.01	$0.02
236	280	Refuel LLM 2 Small	881	±7	4.2K	3.9%	<0.1%	116 tps	0.5s	8K	$0.20	$0.20
237	210	Qwen3 4B	880	±8	5.1K	9.6%	1.9%	94 tps	1.5s	128K	$0.01	$0.01
238	280	Magistral Small 2507	880	±19	730	13.1%	<0.1%	148 tps	0.4s	41K	$0.50	$1.50
239	210	Moonshot V1 128k	879	±19	1.1K	4.6%	1.4%	54 tps	1.5s	131K	$2.00	$5.00
240	210	Inception Mercury	878	±5	6.9K	3.7%	0.4%	257 tps	1.1s	32K	$0.25	$1.00
241	210	DeepSeek R1T2 Chimera	876	±10	2.1K	5.9%	3.0%	28 tps	1.8s	164K	$0.13	$0.45
242	210	Mistral Medium 3	875	±23	485	6.7%	2.4%	47 tps	0.8s	33K	$0.40	$2.00
243	210	Solar Mini 250422	874	±17	1.3K	5.9%	1.8%	90 tps	1.7s	33K	$0.15	$0.15
244	210	GLM 4.7 Flash	871	±28	610	4.7%	5.8%	61 tps	2.8s	128K	$0.07	$0.39
245	210	Mixtral 8x22B	871	±22	1.3K	5.0%	1.2%	140 tps	0.6s	64K	$2.00	$6.00
246	293	Devstral Small 2505	871	±15	1.7K	6.2%	<0.1%	141 tps	1.3s	33K	$0.03	$0.09
247	293	AFM 4.5B	869	±7	4.4K	8.9%	<0.1%	81 tps	0.3s	66K	$0.05	$0.20
248	293	Claude Sonnet 3	869	±17	900	1.6%	<0.1%	35 tps	1.0s	200K	$3.00	$15.00
249	210	Krutrim Spectre V2	868	±16	1.3K	3.6%	<0.1%	33 tps	3.1s	4K	$0.19	$0.19
250	210	GLM 4 32B	868	±12	2.9K	4.9%	2.6%	40 tps	1.6s	33K	$0.14	$0.14
251	210	Gemma 3 12B	867	±11	2.5K	4.9%	4.2%	73 tps	0.8s	131K	$0.05	$0.12
252	210	Moonshot V1 8k	863	±13	915	5.2%	1.0%	55 tps	1.5s	8K	$0.20	$2.00
253	210	Qwen 2.5 14B Instruct	861	±16	2.4K	5.7%	2.4%	40 tps	1.6s	1M	$0.40	$1.61
254	312	DeepSeek-R1 0528 Qwen3 8B	856	±8	4.9K	6.5%	<0.1%	45 tps	2.4s	128K	$0.05	$0.09
255	210	Ministral 3B 2512	854	±57	515	8.0%	2.8%	339 tps	0.6s	131K	$0.10	$0.10
256	234	Jamba 1.5 Large	851	±9	2.9K	4.0%	1.7%	48 tps	0.9s	256K	$1.50	$6.00
257	312	Wikipedia	846	±7	9.8K	4.9%	<0.1%	47 tps	2.1s	32K	$0	$0
258	324	MAI-DS-R1	842	±7	3.5K	11.7%	<0.1%	73 tps	3.2s	64K	$0.10	$0.40
259	234	GPT-3.5 Turbo 16k	838	±10	2.7K	3.6%	<0.1%	22 tps	0.6s	16K	$3.00	$4.00
260	324	Cogito V2 671B	838	±17	1.6K	5.9%	<0.1%	41 tps	0.6s	164K	$1.25	$1.25
261	234	ERNIE 4.5 21B A3B Thinking	838	±23	1.1K	6.9%	1.8%	87 tps	1.5s	120K	$0.07	$0.28
262	240	GLM 4.5 Flash	834	±37	520	8.8%	12.2%	15 tps	2.2s	131K	$0	$0
263	324	NVIDIA Llama 3.1 Nemotron Ultra 253B v1	832	±16	2.2K	4.1%	<0.1%	40 tps	0.8s	128K	$0.30	$0.90
264	240	LFM2 2.6B	826	±26	810	10.0%	6.7%	184 tps	0.4s	33K	$0.01	$0.02
265	240	Krutrim 2	825	±10	2.3K	2.3%	12.5%	33 tps	2.1s	128K	$1.00	$1.00
266	240	Moonshot V1 32k	820	±17	950	3.1%	1.4%	53 tps	1.4s	33K	$1.00	$3.00
267	240	LFM2 8B A1B	818	±18	825	11.3%	<0.1%	142 tps	0.3s	33K	$0.01	$0.02
268	337	GLM 4.1V 9B Thinking	813	±16	1.1K	4.2%	<0.1%	69 tps	1.3s	66K	$0.04	$0.14
269	337	Qwen 2 72B Instruct	805	±19	1K	3.3%	<0.1%	3 tps	N/A	33K	$0.90	$0.90
270	346	Magistral Medium (Thinking)	804	±10	2.2K	5.7%	<0.1%	67 tps	0.8s	41K	$2.00	$5.00
271	252	Magistral Small 2509	802	±18	1.8K	7.5%	2.7%	116 tps	0.6s	131K	$0.50	$1.50
272	252	WizardLM-2 8x22B	801	±12	1.9K	3.1%	11.6%	11 tps	2.5s	66K	$0.77	$0.77
273	252	Hermes 4 405B FP8	797	±21	815	8.4%	3.5%	31 tps	0.9s	131K	$0.52	$1.73
274	346	Magistral Medium 2507	795	±25	665	14.2%	<0.1%	86 tps	0.7s	41K	$2.00	$5.00
275	252	Mercury Coder	793	±27	510	3.8%	<0.1%	247 tps	2.2s	32K	$0.25	$1.00
276	252	GPT-3.5 Turbo Instruct	787	±9	2K	2.7%	<0.1%	46 tps	1.2s	4K	$1.50	$2.00
277	252	Mistral Large	785	±16	1.1K	5.8%	1.5%	54 tps	0.7s	33K	$2.00	$6.00
278	252	Hermes 4 70B	781	±29	460	8.9%	1.1%	67 tps	0.6s	131K	$0.12	$0.39
279	262	Baichuan-M2-32B	770	±30	740	10.8%	<0.1%	32 tps	3.3s	131K	$0.07	$0.07
280	354	OLMo 3 7B Think	763	±21	770	7.8%	4.2%	77 tps	0.4s	66K	$0.12	$0.20
281	262	Open Mistral 7B	762	±18	1.3K	4.7%	0.7%	176 tps	0.4s	33K	$0.25	$0.25
282	361	DeepSeek-R1 Distill Qwen 14B	756	±16	1.9K	6.3%	<0.1%	44 tps	1.7s	64K	$0.63	$0.63
283	361	Seed Coder 8B Instruct	751	±22	605	2.4%	<0.1%	35 tps	N/A	32K	$0.99	$0.99
284	262	Qwen 2.5 VL 72B Instruct	746	±20	2.1K	6.0%	5.3%	25 tps	3.7s	128K	$1.01	$2.79
285	269	Inflection 3 Productivity	737	±24	1.5K	5.0%	0.6%	50 tps	3.2s	8K	$2.50	$10.00
286	361	Meridian	734	±39	965	9.8%	<0.1%	92 tps	1.2s	131K	$0	$0
287	361	Zenith	730	±28	850	9.6%	<0.1%	36 tps	1.8s	131K	$0	$0
288	374	Mistral Nemo 12B Celeste V1.9	725	±18	1.1K	3.5%	<0.1%	6 tps	10.2s	8K	$0.80	$1.20
289	374	Solar Pro 250422	720	±19	530	6.2%	<0.1%	13 tps	0.6s	33K	$0	$0
290	269	Inflection 3 Pi	719	±18	1.5K	4.1%	1.1%	33 tps	3.4s	8K	$2.50	$10.00
291	269	DeepHermes 3 Mistral 24B Preview	706	±30	715	5.9%	2.5%	50 tps	1.0s	33K	$0.06	$0.25
292	374	Dolphin 3.0 R1 Mistral 24B	701	±16	890	7.8%	<0.1%	13 tps	0.1s	33K	$0.03	$0.09
293	276	DeepSeek-R1 Distill Qwen 32B	696	±20	2K	5.5%	6.2%	22 tps	1.8s	131K	$0.37	$0.39
294	383	ArliAI QwQ 32B Arliai RpR V1	686	±40	635	9.3%	<0.1%	34 tps	1.8s	33K	$0.02	$0.07
295	276	MiniMax M1	686	±13	3.8K	5.3%	<0.1%	31 tps	2.8s	1M	$0.55	$2.20
296	386	MiMo 7B RL	655	±13	1.2K	3.5%	<0.1%	31 tps	0.4s	32K	$0.49	$0.49
297	386	Dolphin 2.9.2 Mixtral 8x22B	652	±19	1.1K	2.6%	<0.1%	20 tps	1.5s	16K	$0.90	$0.90
298	386	Shisa V2 Llama 3.3 70B	623	±24	585	9.3%	<0.1%	8 tps	2.0s	33K	$0.03	$0.09
299	279	UI-TARS 1.5 7B	610	±40	530	11.7%	4.0%	75 tps	0.9s	128K	$0.10	$0.20
300	390	ERNIE 4.5 0.3B	602	±40	685	11.0%	<0.1%	85 tps	2.2s	120K	$0	$0
301	390	DeepSeek-R1 Distill Llama 8B	595	±19	1.2K	5.6%	<0.1%	17 tps	N/A	32K	$0.04	$0.04
302	279	Hunyuan A13B Instruct	588	±22	1.6K	9.2%	2.3%	67 tps	2.0s	33K	$0.01	$0.01
303	399	Mistral Nemo 12B Inferor v0.0	454	±28	565	1.7%	<0.1%	83 tps	0.8s	16K	$0.80	$1.20
304	402	QwQ 32B RpR v1	406	±35	1K	10.9%	<0.1%	34 tps	3.3s	33K	$0.02	$0.07
305	404	Seed Coder 8B Reasoning	329	±41	700	4.1%	<0.1%	25 tps	N/A	32K	$0.99	$0.99

Show Less