Leaderboard | Text

Models

Choose model family

Claude by Anthropic

Mistral by Mistral AI

Choose topic

All topics Facts and Information Creative Writing and Ideation Logic and Problem-Solving Task Completion Coding

Language

Choose language

All languages English Chinese Arabic Spanish Indonesian Japanese

More filters

Show inactive models

Hide models that are no longer actively available on Yupp.

Turns

Filter model performance by the number of turns in a conversation.

All Single turn Multiple turns

Open license models

Filter the leaderboard to only show models that have an open license.

All selected Open license Proprietary license

1364

GPT-5.4

1342

Claude Opus 4.6 (Thinking)

1316

Grok 4.20 Beta Non-reasoning

1289

GPT-5.1 (High)

1288

GPT-5.1

1274

Claude Opus 4.6

1270

Gemini 3.1 Pro

1260

GPT-5.2 Instant

1256

Claude Sonnet 4.6 (Thinking)

1222

Gemini 3 Pro

1216

Grok 4.20 Beta Reasoning

1212

Claude Sonnet 4.6

1211

Qwen3 VL 235B A22B Instruct

1208

GPT-5 Chat

1207

Grok 4.1 Fast Non-Reasoning

Last updated about 1 month ago

Rank	Overall	Name	VIBE Score	Confidence Interval	Votes	Downvote %	Abort %	Speed	Latency	Context	Cost (Input)	Cost (Output)
1	2	GPT-5.4	1364	±7	2.3K	1.1%	2.6%	55 tps	0.8s	1M	$2.50	$15.00
2	1	Claude Opus 4.6 (Thinking)	1342	±5	5.7K	0.9%	2.5%	56 tps	1.6s	200K	$5.00	$25.00
3	22	Grok 4.20 Beta Non-reasoning	1316	±13	630	3.8%	1.1%	151 tps	0.6s	2M	$2.00	$6.00
4	8	GPT-5.1 (High)	1289	±2	23K	1.4%	3.2%	76 tps	6.9s	400K	$1.25	$10.00
5	8	GPT-5.1	1288	±2	19.7K	1.3%	2.3%	71 tps	1.4s	400K	$1.42	$11.33
6	2	Claude Opus 4.6	1274	±4	7.1K	1.4%	2.1%	48 tps	1.7s	200K	$5.00	$25.00
7	6	Gemini 3.1 Pro	1270	±5	12.3K	1.1%	3.5%	35 tps	4.1s	1M	$2.00	$12.00
8	10	GPT-5.2 Instant	1260	±3	27.1K	0.8%	1.7%	52 tps	2.0s	400K	$1.75	$14.00
9	5	Claude Sonnet 4.6 (Thinking)	1256	±5	5.8K	1.4%	4.7%	57 tps	1.1s	200K	$3.00	$15.00
10	10	Gemini 3 Pro	1222	±3	44.5K	1.1%	2.1%	50 tps	3.6s	1M	$2.00	$12.00
11	17	Grok 4.20 Beta Reasoning	1216	±7	2.1K	1.7%	1.1%	77 tps	4.5s	2M	$2.00	$5.50
12	4	Claude Sonnet 4.6	1212	±5	6K	1.1%	1.6%	47 tps	1.2s	200K	$3.00	$15.00
13	29	Qwen3 VL 235B A22B Instruct	1211	±3	10.2K	2.5%	3.1%	75 tps	1.9s	129K	$0.37	$1.81
14	22	GPT-5 Chat	1208	±2	58K	1.4%	1.3%	95 tps	0.9s	400K	$1.25	$10.00
15	26	Grok 4.1 Fast Non-Reasoning	1207	±3	20.1K	1.7%	0.9%	101 tps	0.5s	2M	$0.20	$0.50
16	13	GPT-5.3 Instant	1206	±4	5.5K	1.0%	0.9%	63 tps	0.8s	400K	$1.75	$14.00
17	29	Nova Experimental Chat 12-10	1206	±3	9K	1.2%	2.4%	84 tps	12.9s	98K	$0	$0
18	33	Grok 4.20 Multi Agent Beta	1197	±7	1.7K	1.8%	1.2%	56 tps	8.8s	2M	$2.00	$6.00
19	14	Gemini 3 Flash Preview Thinking	1195	±3	19.7K	1.0%	1.6%	3 tps	6.2s	1M	$0.50	$3.00
20	14	Gemini 3 Pro (Low)	1195	±3	20.3K	1.1%	2.4%	51 tps	3.5s	1M	$2.00	$12.00
21	16	GPT-5.2	1193	±2	16.3K	0.9%	4.1%	18 tps	2.7s	400K	$1.75	$14.00
22	37	Qwen3 Omni 30B A3B Thinking	1188	±5	5.3K	1.2%	3.7%	67 tps	1.2s	66K	$0.97	$1.79
23	32	Gemini 2.5 Pro High	1175	±1	27.6K	2.0%	1.5%	48 tps	2.3s	1M	$1.25	$10.00
24	17	Gemini 3 Flash Preview	1173	±3	12.8K	0.7%	1.3%	138 tps	1.4s	1M	$0.50	$3.00
25	17	GPT-5.2 (High)	1168	±2	31.4K	1.1%	6.7%	18 tps	16.3s	400K	$1.75	$14.00
26	33	Qwen3 30B A3B Instruct 2507	1167	±2	24.4K	1.7%	1.2%	55 tps	1.3s	131K	$0.13	$0.72
27	44	Grok 4.1 Fast Reasoning	1160	±2	23.1K	1.8%	1.5%	58 tps	7.3s	2M	$0.20	$0.50
28	62	Qwen3 Omni 30B A3B Instruct	1157	±6	2.3K	1.9%	3.9%	65 tps	1.2s	66K	$0.35	$0.97
29	26	GPT-5 (High)	1156	±3	12.3K	2.3%	4.5%	81 tps	35.9s	400K	$1.25	$10.00
30	52	Grok 4 Fast Non-Reasoning	1156	±2	16.7K	2.2%	1.5%	93 tps	0.6s	2M	$0.27	$0.67
31	44	Gemini 2.5 Pro	1153	±2	38.9K	1.8%	2.3%	45 tps	2.6s	1M	$1.25	$10.00
32	44	DeepSeek V3.1 Terminus Chat	1152	±2	14.5K	1.8%	3.4%	27 tps	1.5s	131K	$0.86	$1.80
33	40	DeepSeek V3.2	1152	±3	16.5K	1.1%	1.4%	83 tps	5.1s	131K	$0.43	$1.09
34	42	Qwen3 Max Instruct Preview	1151	±2	26.4K	2.0%	1.1%	31 tps	1.7s	256K	$1.43	$6.61
35	22	GLM 5	1149	±4	6.4K	1.2%	3.4%	36 tps	2.7s	200K	$0.72	$2.55
36	10	Claude Sonnet 4.5 (Thinking)	1148	±2	27.2K	2.5%	1.9%	44 tps	1.1s	200K	$3.00	$15.00
37	7	Claude Opus 4.5 (Thinking)	1147	±4	21.9K	1.6%	1.8%	49 tps	1.4s	200K	$5.00	$25.00
38	40	Qwen3 235B A22B Instruct 2507	1147	±2	24.5K	1.4%	6.8%	13 tps	1.9s	262K	$0.13	$0.52
39	42	GPT-5.2 (Extra High)	1147	±2	15.6K	1.4%	13.2%	17 tps	20.5s	400K	$1.75	$14.00
40	29	MiniMax M2.7	1142	±13	700	1.4%	3.0%	34 tps	2.5s	205K	$0.30	$1.20
41	48	Grok 4 Fast Reasoning	1142	±3	14.5K	2.0%	2.1%	102 tps	3.1s	2M	$0.30	$0.75
42	17	GPT-5.4 mini	1141	±14	545	1.8%	0.8%	148 tps	0.5s	400K	$0.75	$4.50
43	56	DeepSeek V3.1 Turbo	1134	±3	9.5K	1.2%	0.9%	173 tps	1.3s	164K	$2.00	$3.75
44	56	MiniMax M2.1 Lightning	1129	±5	3.6K	1.4%	1.7%	52 tps	2.1s	205K	$0.30	$2.40
45	71	DeepSeek V3.1	1125	±4	4.4K	1.1%	0.8%	197 tps	0.4s	164K	$0.55	$1.60
46	60	MiniMax M2.1	1124	±3	24.4K	1.0%	2.1%	66 tps	2.6s	205K	$0.30	$1.20
47	26	Claude Haiku 4.5 (Extended Thinking)	1121	±3	14.1K	1.8%	1.4%	115 tps	0.7s	200K	$1.00	$5.00
48	60	Gemini 2.5 Flash Preview 0925	1118	±3	14.4K	2.2%	1.2%	5 tps	0.9s	1M	$0.13	$0.97
49	52	GPT-5	1117	±2	31.1K	1.7%	3.1%	78 tps	23.1s	400K	$1.25	$9.67
50	81	OpenAI o3-pro	1116	±5	3.2K	2.8%	5.2%	22 tps	70.8s	200K	$20.00	$80.00
51	68	Grok 4	1110	±1	98.8K	0.9%	3.9%	29 tps	11.1s	256K	$3.00	$15.00
52	17	Claude Opus 4.5	1110	±4	12.9K	2.2%	1.5%	45 tps	1.5s	200K	$5.00	$25.00
53	62	MiniMax M2	1110	±3	17.2K	2.5%	2.2%	39 tps	2.3s	205K	$0.21	$0.85
54	71	Qwen3.5 397B A17B	1107	±6	5.1K	1.6%	4.3%	57 tps	1.4s	256K	$0.52	$3.00
55	86	DeepSeek V3.1 Nex N1	1107	±8	1.5K	1.3%	3.4%	24 tps	7.2s	131K	$0.14	$0.50
56	79	Qwen3 Max Thinking Preview	1106	±4	13.3K	2.0%	3.1%	40 tps	2.1s	256K	$1.20	$6.00
57	101	DeepSeek V3 (Turbo)	1105	±5	3.7K	1.5%	1.5%	32 tps	1.5s	64K	$0.40	$1.30
58	56	Gemini 3.1 Flash Lite Preview Thinking	1105	±8	2K	1.7%	1.7%	75 tps	4.7s	1M	$0.25	$1.50
59	68	GLM 4.7	1105	±3	21K	1.0%	5.8%	40 tps	1.5s	200K	$0.77	$1.73
60	86	Amazon Nova 2 Lite	1099	±4	10.5K	2.7%	1.0%	137 tps	0.6s	300K	$0.35	$2.95
61	68	Qwen Plus (Aug'24)	1098	±2	50.5K	1.1%	1.4%	53 tps	1.3s	30K	$0.40	$1.20
62	101	GPT-5 (Low)	1097	±7	1.5K	1.0%	1.8%	75 tps	8.2s	400K	$1.25	$10.00
63	62	GPT-5.1 Instant	1096	±3	14.9K	1.5%	1.3%	50 tps	1.9s	400K	$1.25	$10.00
64	84	GPT-5 Mini Minimal	1094	±3	4.9K	3.0%	1.2%	63 tps	1.4s	400K	$0.25	$2.00
65	95	Kimi K2 Thinking	1092	±4	5.4K	2.0%	4.2%	61 tps	5.9s	262K	$0.24	$1.03
66	37	Claude Sonnet 4.5	1092	±2	25.2K	2.2%	1.4%	41 tps	1.3s	200K	$1.80	$9.00
67	71	MiniMax M2.5 FP8	1092	±10	2.1K	1.6%	3.6%	33 tps	1.7s	205K	$0.45	$1.75
68	81	GPT-4o	1091	±2	23.5K	0.7%	1.0%	49 tps	2.4s	128K	$3.71	$12.57
69	71	Seed 1.8 251228	1090	±3	14.9K	1.5%	3.7%	41 tps	2.1s	256K	$0.25	$2.00
70	52	Claude Haiku 4.5	1089	±3	20.4K	2.1%	1.1%	100 tps	0.9s	200K	$1.00	$5.00
71	71	Gemini 2.5 Flash Lite Preview 0925	1087	±2	15.1K	2.5%	1.2%	209 tps	0.7s	1M	$0.25	$0.35
72	86	DeepSeek V3.1 Chat	1087	±3	10.7K	1.8%	2.8%	21 tps	1.6s	131K	$0.38	$1.00
73	71	GPT-5 Mini	1087	±3	11.3K	2.1%	2.6%	66 tps	14.2s	400K	$0.25	$2.00
74	95	Qwen3 32B	1085	±5	2.6K	1.5%	3.9%	30 tps	3.1s	41K	$0.12	$0.42
75	93	Qwen Max	1084	±2	54.8K	0.9%	1.5%	49 tps	1.5s	33K	$1.60	$6.40
76	93	DeepSeek V3 0324 Turbo	1081	±3	50.9K	1.4%	6.3%	12 tps	2.4s	164K	$0.73	$1.79
77	133	Nemotron 3 Nano	1076	±8	1.6K	1.9%	1.3%	216 tps	0.8s	256K	$0.05	$4.94
78	65	GLM 4.6	1075	±3	11.7K	2.8%	5.4%	39 tps	1.5s	200K	$0.42	$1.66
79	121	NVIDIA Llama 3.3 Nemotron Super 49B v1.5	1074	±6	3.5K	2.2%	2.0%	50 tps	0.6s	131K	$0.09	$0.33
80	71	Gemini 3.1 Flash Lite Preview	1073	±11	1.3K	2.2%	1.0%	8 tps	1.2s	1M	$0.25	$1.50
81	111	LongCat Flash Chat	1071	±4	3.8K	1.9%	0.8%	85 tps	0.9s	131K	$0.14	$0.68
82	106	DeepSeek V3 0324	1067	±2	37.1K	1.0%	5.8%	12 tps	2.7s	164K	$0.38	$0.93
83	113	GLM 4.5 AirX	1067	±5	3.5K	1.8%	3.3%	75 tps	1.2s	131K	$1.10	$4.50
84	101	Gemini 2.5 Flash Lite	1066	±2	36K	1.7%	1.3%	210 tps	0.7s	1M	$0.10	$0.40
85	129	DeepSeek V3.1 Thinking	1063	±4	9.3K	2.2%	7.1%	18 tps	1.8s	131K	$0.23	$0.75
86	124	Qwen3 235B A22B Thinking 2507	1061	±4	3.6K	1.2%	2.5%	53 tps	1.6s	131K	$0.59	$5.70
87	95	Gemini 2.5 Flash	1060	±2	97.6K	1.0%	1.3%	2 tps	3.7s	1M	$0.30	$2.50
88	153	Apriel 1.5 15B Thinker	1059	±8	1.5K	2.5%	2.4%	146 tps	0.4s	131K	$0	$0
89	119	GLM 4.7 FP8	1057	±6	2.2K	1.6%	6.9%	40 tps	1.3s	200K	$0.30	$1.20
90	71	Gemini 2.5 Flash Thinking	1054	±4	7.9K	1.4%	2.2%	88 tps	6.4s	1M	$0.30	$2.50
91	143	Solar Pro 2 251215	1053	±9	755	1.3%	1.8%	107 tps	1.5s	66K	$0.15	$0.60
92	95	Gemini 2.5 Flash Lite Thinking Preview 0925	1052	±2	9.4K	2.4%	1.5%	152 tps	3.0s	1M	$0.10	$0.40
93	113	GLM 4.5	1050	±2	12.3K	1.6%	3.7%	46 tps	1.4s	131K	$0.43	$1.63
94	106	Grok 3	1049	±2	56K	1.4%	1.5%	53 tps	0.6s	1M	$3.67	$18.33
95	119	ERNIE 4.5 300B A47B	1049	±2	44.6K	1.0%	4.7%	23 tps	2.3s	123K	$0.28	$1.10
96	113	Gemini 2.5 Flash Lite Thinking	1048	±3	12.2K	2.2%	1.0%	118 tps	4.4s	1M	$0.03	$0.13
97	113	Mistral Medium	1044	±2	33.2K	1.3%	1.8%	48 tps	0.6s	33K	$1.48	$4.55
98	86	Seed 2.0 Lite (Medium)	1043	±9	1.2K	2.0%	6.6%	33 tps	1.6s	256K	$0.25	$2.00
99	84	MiniMax M2.5	1038	±11	1.5K	2.0%	1.4%	70 tps	1.9s	205K	$0.28	$1.20
100	124	Kimi K2 0905 Turbo	1037	±3	18.8K	2.4%	0.7%	373 tps	0.5s	262K	$1.70	$6.50
101	106	Claude Sonnet 3.5 v2	1035	±4	16.6K	1.0%	<0.1%	46 tps	1.4s	200K	$3.00	$15.00
102	148	Qwen3 30B A3B Thinking 2507	1035	±4	4K	1.4%	0.5%	124 tps	1.2s	131K	$0.16	$1.70
103	118	GPT-4.1 mini	1031	±2	57.7K	1.3%	1.1%	67 tps	0.9s	1M	$0.34	$1.60
104	153	Ministral 14B 3.0	1031	±6	2.3K	3.1%	2.0%	119 tps	0.5s	128K	$0.20	$0.20
105	111	Grok 3 Fast	1030	±3	12K	1.1%	1.7%	52 tps	2.4s	131K	$5.00	$25.00
106	126	Qwen3 VL 235B A22B Thinking	1027	±4	7.3K	2.9%	4.3%	47 tps	3.0s	127K	$0.47	$3.31
107	133	DeepSeek V3.2 Speciale	1027	±5	5.9K	2.2%	6.0%	43 tps	1.4s	131K	$0.84	$1.52
108	165	Qwen3 4B	1027	±4	9.4K	3.3%	1.9%	94 tps	1.5s	128K	$0.01	$0.01
109	86	Claude Sonnet 4	1026	±2	88.9K	1.5%	1.8%	49 tps	1.3s	200K	$3.00	$15.00
110	143	Mistral Medium 3	1023	±9	1.2K	1.7%	2.4%	47 tps	0.8s	33K	$0.40	$2.00
111	161	Qwen3 8B	1020	±5	6.1K	2.6%	2.4%	61 tps	1.4s	41K	$0.02	$0.07
112	143	Seed 1.6 250615	1018	±4	3.6K	1.6%	3.1%	46 tps	2.2s	256K	$0.25	$2.00
113	148	OpenAI o3	1018	±6	4.2K	1.8%	0.9%	85 tps	6.8s	128K	$7.33	$29.33
114	133	Kimi K2 0905	1016	±4	9.2K	2.1%	4.0%	30 tps	1.4s	262K	$0.63	$2.39
115	157	Qwen3 Next 80B A3B Thinking	1015	±3	12.3K	2.3%	0.6%	175 tps	1.3s	256K	$0.21	$2.26
116	133	GPT-4.1 nano	1014	±2	52.1K	1.3%	0.6%	175 tps	0.5s	1M	$0.10	$0.40
117	101	Qwen3.5 35B A3B	1011	±15	1.1K	1.4%	2.1%	116 tps	2.1s	256K	$0.63	$1.13
118	179	Baichuan-M2-32B	1011	±8	1.4K	2.7%	<0.1%	32 tps	3.3s	131K	$0.07	$0.07
119	139	Seed 2.0 Mini (Medium)	1010	±10	1.3K	2.6%	11.9%	33 tps	1.7s	256K	$0.15	$0.60
120	148	OpenAI o4-mini-high	1009	±2	19.5K	2.1%	1.9%	117 tps	15.9s	200K	$1.10	$4.40
121	175	MiMo V2 Flash	1009	±10	645	3.7%	7.2%	24 tps	1.9s	262K	$0.07	$0.23
122	129	Qwen3 Max Thinking	1007	±5	6.9K	1.4%	13.5%	32 tps	2.3s	256K	$1.20	$6.00
123	139	OpenAI o4-mini	1007	±3	13.6K	2.2%	1.4%	97 tps	7.0s	128K	$1.10	$4.40
124	165	ERNIE 4.5 21B A3B	1006	±7	1.4K	1.8%	2.3%	78 tps	1.5s	120K	$0.05	$0.19
125	186	Mistral Small 3.2 24B Instruct	1006	±7	1.6K	3.4%	1.9%	113 tps	1.1s	131K	$0.02	$0.08
126	139	GLM 4.6V	1005	±3	7.4K	1.4%	6.4%	21 tps	1.8s	128K	$0.38	$0.90
127	194	GLM 4.5 Flash	1005	±11	1.1K	2.3%	12.2%	15 tps	2.2s	131K	$0	$0
128	143	Gemini 2.0 Flash	1004	±3	23.8K	0.9%	<0.1%	76 tps	0.5s	1M	$0.14	$0.56
129	170	Devstral Small 2507	1002	±8	980	2.0%	2.2%	186 tps	0.5s	131K	$0.10	$0.30
130	246	Amazon Nova Micro 1.0	1000	±23	630	2.3%	4.1%	193 tps	0.6s	128K	$0.04	$0.07
131	165	DeepSeek R1T2 Chimera	998	±5	5.6K	1.7%	3.0%	28 tps	1.8s	164K	$0.13	$0.45
132	186	Jamba 1.7 Large	994	±9	2.1K	2.5%	1.3%	58 tps	1.0s	256K	$1.33	$5.33
133	143	Gemini 2.0 Flash Lite	994	±3	55.3K	2.8%	<0.1%	42 tps	0.5s	1M	$0.08	$0.30
134	170	Devstral Medium	992	±4	10.6K	0.9%	1.5%	77 tps	0.6s	131K	$0.40	$2.00
135	160	Llama 4 Scout	990	±2	55K	1.5%	0.6%	88 tps	5.1s	131K	$0.18	$0.46
136	157	GPT-5 Nano	989	±3	6.6K	3.1%	3.2%	113 tps	20.9s	400K	$0.05	$0.40
137	170	Kimi K2 0711	987	±3	19K	1.1%	1.6%	29 tps	1.3s	131K	$0.72	$2.60
138	48	Claude Sonnet 4 (Thinking)	986	±3	8.7K	1.8%	1.5%	52 tps	1.5s	200K	$3.00	$13.67
139	157	Cogito v2.1 671B	986	±4	3.6K	1.2%	0.8%	85 tps	0.5s	128K	$1.25	$1.25
140	170	Mistral Small 3.2 24B	986	±3	13K	1.1%	2.8%	141 tps	0.7s	33K	$0.02	$0.08
141	179	Amazon Nova Pro 1.0	971	±2	22.3K	0.8%	0.9%	96 tps	0.7s	300K	$0.80	$1.70
142	179	Qwen 2.5 72B	970	±4	5.3K	1.0%	1.2%	96 tps	1.2s	131K	$0.14	$0.26
143	179	Inception Mercury	967	±3	24.4K	0.9%	0.4%	257 tps	1.1s	32K	$0.25	$1.00
144	186	Gemma 3n E4B	965	±4	22.2K	1.2%	2.0%	30 tps	0.5s	8K	$0.01	$0.02
145	186	Jamba 1.6 Large	957	±3	15.3K	0.9%	2.0%	59 tps	1.2s	256K	$1.33	$5.33
146	153	OpenAI o1	954	±4	3.9K	1.4%	4.2%	92 tps	5.5s	200K	$15.00	$60.00
147	179	GLM 4.7 Flash	949	±6	4K	1.9%	5.8%	61 tps	2.8s	128K	$0.07	$0.39
148	229	ERNIE 4.5 21B A3B Thinking	947	±9	1.7K	2.3%	1.8%	87 tps	1.5s	120K	$0.07	$0.28
149	194	Magistral Small 2506	945	±4	15.6K	1.0%	1.6%	156 tps	0.5s	40K	$0.37	$1.10
150	194	Llama 3.3 70B	943	±4	9.1K	2.7%	0.3%	500 tps	0.5s	8K	$0.48	$0.66
151	209	Qwen 2.5 14B Instruct	941	±6	8.3K	1.4%	2.4%	40 tps	1.6s	1M	$0.40	$1.61
152	201	Llama 3 8B	941	±3	12.1K	0.9%	6.0%	85 tps	0.7s	8K	$0.12	$0.16
153	179	Switchpoint Router	936	±4	8.2K	1.0%	1.7%	71 tps	4.9s	131K	$0.85	$3.40
154	201	ERNIE 4.5 VL 424B A47B	936	±12	805	5.3%	4.9%	36 tps	3.5s	123K	$0.42	$1.25
155	214	Krutrim 2	933	±3	10.7K	0.7%	12.5%	33 tps	2.1s	128K	$1.00	$1.00
156	186	Grok 3 Mini	931	±4	23K	1.4%	1.2%	43 tps	0.5s	131K	$0.30	$0.50
157	225	GPT-3.5 Turbo 16k	929	±3	9.2K	0.6%	<0.1%	22 tps	0.6s	16K	$3.00	$4.00
158	209	Llama 3.3 Swallow 70B Instruct	928	±3	9.7K	1.1%	1.4%	153 tps	1.3s	131K	$0.13	$0.39
159	209	GPT-3.5 Turbo	928	±4	5.8K	0.6%	1.3%	74 tps	0.9s	16K	$0.75	$1.75
160	186	Grok 3 Mini Fast	927	±2	21.1K	1.5%	1.6%	44 tps	0.5s	131K	$0.60	$4.00
161	175	OpenAI o3-mini-low	925	±3	18K	2.6%	0.7%	139 tps	1.5s	200K	$1.10	$4.40
162	222	Jamba 1.5 Large	924	±4	13K	1.0%	1.7%	48 tps	0.9s	256K	$1.50	$6.00
163	214	Moonshot V1 128k	922	±5	4.4K	0.9%	1.4%	54 tps	1.5s	131K	$2.00	$5.00
164	209	Seed 1.6 Flash 250715	921	±5	2.5K	1.9%	2.5%	108 tps	1.6s	256K	$0.07	$0.30
165	177	OpenAI o3-mini	921	±3	19.4K	2.3%	0.8%	143 tps	3.3s	200K	$1.10	$4.40
166	214	Gemma 3 12B	920	±4	9K	1.3%	4.2%	73 tps	0.8s	131K	$0.05	$0.12
167	201	Devstral Small	917	±4	5.1K	1.3%	2.4%	180 tps	0.6s	131K	$0.10	$0.30
168	194	INTELLECT-3	909	±14	570	2.6%	1.5%	114 tps	0.6s	131K	$0.20	$1.10
169	240	GPT-3.5 Turbo Instruct	903	±3	7K	0.6%	<0.1%	46 tps	1.2s	4K	$1.50	$2.00
170	229	Moonshot V1 Auto	898	±8	3.8K	1.0%	1.2%	54 tps	1.5s	8K	$2.00	$5.00
171	246	Hermes 4 70B	897	±10	1K	1.9%	1.1%	67 tps	0.6s	131K	$0.12	$0.39
172	274	DeepSeek-R1 Distill Qwen 32B	896	±10	1.4K	2.1%	6.2%	22 tps	1.8s	131K	$0.37	$0.39
173	235	GLM 4 32B	894	±3	10.8K	1.2%	2.6%	40 tps	1.6s	33K	$0.14	$0.14
174	246	WizardLM-2 8x22B	894	±3	9.3K	0.8%	11.6%	11 tps	2.5s	66K	$0.77	$0.77
175	240	Moonshot V1 8k	893	±6	3.8K	0.9%	1.0%	55 tps	1.5s	8K	$0.20	$2.00
176	229	Krutrim Spectre V2	893	±3	6.8K	1.1%	<0.1%	33 tps	3.1s	4K	$0.19	$0.19
177	240	Hermes 4 405B FP8	891	±11	1.6K	3.0%	3.5%	31 tps	0.9s	131K	$0.52	$1.73
178	201	GPT-4o mini	891	±4	7K	1.9%	2.1%	71 tps	1.7s	128K	$0.15	$0.60
179	229	Magistral Medium 2509	889	±5	4.4K	3.3%	4.0%	58 tps	0.9s	131K	$2.00	$5.00
180	222	Rnj-1 Instruct	888	±8	2.4K	4.5%	0.6%	103 tps	0.3s	33K	$0.15	$0.15
181	246	Mixtral 8x22B	886	±6	4.7K	1.1%	1.2%	140 tps	0.6s	64K	$2.00	$6.00
182	265	Ministral 3B 2512	876	±9	1.3K	3.4%	2.8%	339 tps	0.6s	131K	$0.10	$0.10
183	240	Moonshot V1 32k	872	±4	3.8K	0.8%	1.4%	53 tps	1.4s	33K	$1.00	$3.00
184	265	Inflection 3 Productivity	858	±4	6.5K	0.8%	0.6%	50 tps	3.2s	8K	$2.50	$10.00
185	256	Solar Mini 250422	856	±8	3.2K	2.0%	1.8%	90 tps	1.7s	33K	$0.15	$0.15
186	260	Open Mistral 7B	849	±6	4.8K	1.2%	0.7%	176 tps	0.4s	33K	$0.25	$0.25
187	214	Qwen 2.5 VL 32B Instruct	847	±16	840	4.0%	6.3%	43 tps	3.2s	128K	$0.35	$0.62
188	284	MiniMax M1	843	±5	2.7K	1.6%	<0.1%	31 tps	2.8s	1M	$0.55	$2.20
189	260	Apriel 1.6 15B Thinker	840	±12	855	2.3%	2.6%	92 tps	0.4s	131K	$0	$0
190	214	OpenAI o3-mini-high	839	±6	3.6K	1.6%	2.4%	231 tps	10.5s	200K	$1.10	$4.40
191	271	Inflection 3 Pi	837	±4	6.8K	0.9%	1.1%	33 tps	3.4s	8K	$2.50	$10.00
192	274	DeepHermes 3 Mistral 24B Preview	824	±9	995	3.4%	2.5%	50 tps	1.0s	33K	$0.06	$0.25
193	271	Mistral Large	818	±6	4.3K	1.6%	1.5%	54 tps	0.7s	33K	$2.00	$6.00
194	265	LFM2 2.6B	816	±8	1.7K	5.2%	6.7%	184 tps	0.4s	33K	$0.01	$0.02
195	265	Qwen 2.5 VL 72B Instruct	808	±12	1.3K	5.5%	5.3%	25 tps	3.7s	128K	$1.01	$2.79
196	265	Magistral Small 2509	786	±11	1.7K	3.7%	2.7%	116 tps	0.6s	131K	$0.50	$1.50
197	274	C4AI Aya Expanse 8B	778	±15	885	2.7%	0.9%	61 tps	0.4s	8K	$0.50	$1.50
198	285	Hunyuan A13B Instruct	777	±5	4.1K	2.4%	2.3%	67 tps	2.0s	33K	$0.01	$0.01
199	274	MiniMax M2-her	767	±11	880	1.7%	<0.1%	108 tps	0.7s	205K	$0.30	$1.20
200	274	LFM2 8B A1B	757	±9	1.9K	4.8%	<0.1%	142 tps	0.3s	33K	$0.01	$0.02
201	274	Moonshot V1 128k Vision	649	±31	515	6.4%	3.1%	44 tps	3.8s	131K	$2.00	$5.00
202	289	UI-TARS 1.5 7B	646	±17	915	4.2%	4.0%	75 tps	0.9s	128K	$0.10	$0.20
203	291	LFM2.5 1.2B Thinking	508	±26	545	5.2%	2.6%	258 tps	0.4s	33K	$0	$0

Show Less