Leaderboard | Coding

Models

Choose model family

Claude by Anthropic

Mistral by Mistral AI

More filters

Show inactive models

Hide models that are no longer actively available on Yupp.

Turns

Filter model performance by the number of turns in a conversation.

All Single turn Multiple turns

Open license models

Filter the leaderboard to only show models that have an open license.

All selected Open license Proprietary license

1020

OpenAI o3

1018

Gemini 2.0 Flash

1016

GLM 4.5 Air

1009

Qwen3 VL 235B A22B Thinking

1007

Qwen3 Coder Plus

1002

GPT-5 Mini High

1001

Qwen 2.5 VL 32B Instruct

1000

Qwen3 235B A22B Thinking 2507

999

OpenAI o3-mini-high

999

OpenAI o3-mini

995

OpenAI o4-mini-high

995

Seed 1.6 250615

994

Arcee AI Virtuoso-Large

992

Claude Haiku 3

989

GPT-5 Nano

Last updated about 1 month ago

Rank	Overall	Name	VIBE Score	Confidence Interval	Votes	Downvote %	Abort %	Speed	Latency	Context	Cost (Input)	Cost (Output)
161	144	OpenAI o3	1020	±7	5.9K	4.0%	0.9%	85 tps	6.8s	128K	$7.33	$29.33
162	144	Gemini 2.0 Flash	1018	±7	8.2K	3.8%	<0.1%	76 tps	0.5s	1M	$0.14	$0.56
163	189	GLM 4.5 Air	1016	±6	7.1K	6.9%	<0.1%	22 tps	1.4s	131K	$0.10	$0.38
164	148	Qwen3 VL 235B A22B Thinking	1009	±6	4.6K	8.3%	4.3%	47 tps	3.0s	127K	$0.47	$3.31
165	148	Qwen3 Coder Plus	1007	±22	610	4.7%	5.1%	56 tps	2.3s	128K	$1.80	$9.80
166	195	GPT-5 Mini High	1002	±9	3K	7.7%	<0.1%	33 tps	3.9s	400K	$0.25	$2.00
167	148	Qwen 2.5 VL 32B Instruct	1001	±21	865	4.9%	6.3%	43 tps	3.2s	128K	$0.35	$0.62
168	148	Qwen3 235B A22B Thinking 2507	1000	±10	2.8K	4.4%	2.5%	53 tps	1.6s	131K	$0.59	$5.70
169	148	OpenAI o3-mini-high	999	±5	8.3K	4.1%	2.4%	231 tps	10.5s	200K	$1.10	$4.40
170	148	OpenAI o3-mini	999	±4	15K	5.5%	0.8%	143 tps	3.3s	200K	$1.10	$4.40
171	148	OpenAI o4-mini-high	995	±7	13.6K	6.2%	1.9%	117 tps	15.9s	200K	$1.10	$4.40
172	148	Seed 1.6 250615	995	±21	1.6K	6.0%	3.1%	46 tps	2.2s	256K	$0.25	$2.00
173	195	Arcee AI Virtuoso-Large	994	±8	3K	5.7%	<0.1%	64 tps	0.5s	131K	$0.75	$1.20
174	195	Claude Haiku 3	992	±11	2.8K	3.0%	0.4%	62 tps	0.5s	200K	$0.25	$1.25
175	159	GPT-5 Nano	989	±6	4.6K	8.0%	3.2%	113 tps	20.9s	400K	$0.05	$0.40
176	159	OpenAI o3-mini-low	988	±6	12.2K	6.4%	0.7%	139 tps	1.5s	200K	$1.10	$4.40
177	159	Grok Code Fast 1	987	±9	2.5K	6.0%	5.9%	294 tps	0.5s	256K	$0.20	$1.50
178	159	GLM 4.6V	986	±8	3K	5.5%	6.4%	21 tps	1.8s	128K	$0.38	$0.90
179	195	Cypher Alpha	985	±20	735	8.7%	<0.1%	4 tps	N/A	1M	$0	$0
180	195	GLM 4.6 FP8	982	±17	1.2K	11.7%	<0.1%	56 tps	1.8s	200K	$0.40	$1.75
181	159	Kimi K2 0711	981	±6	7K	4.5%	1.6%	29 tps	1.3s	131K	$0.72	$2.60
182	159	Seed 2.0 Mini (Medium)	981	±35	570	5.8%	11.9%	33 tps	1.7s	256K	$0.15	$0.60
183	167	DeepSeek V3.1 Thinking	976	±9	5.2K	9.5%	7.1%	18 tps	1.8s	131K	$0.23	$0.75
184	211	Grok 4 (Low Reasoning)	975	±21	520	2.8%	<0.1%	18 tps	9.5s	256K	$0	$0
185	167	Nemotron 3 Nano	974	±46	580	6.5%	1.3%	216 tps	0.8s	256K	$0.05	$4.94
186	211	Arcee AI Coder-Large	972	±15	985	4.4%	<0.1%	60 tps	1.6s	33K	$0.50	$0.80
187	219	Arcee Coder Large	971	±7	3.6K	2.6%	<0.1%	54 tps	1.3s	33K	$0.50	$0.80
188	167	Mistral Small 3.2 24B	970	±13	4.6K	4.9%	2.8%	141 tps	0.7s	33K	$0.02	$0.08
189	167	Llama 4 Scout	965	±5	17.5K	5.3%	0.6%	88 tps	5.1s	131K	$0.18	$0.46
190	167	Devstral Medium	962	±11	3.5K	5.2%	1.5%	77 tps	0.6s	131K	$0.40	$2.00
191	167	Qwen 2.5 72B	960	±15	1.4K	4.5%	1.2%	96 tps	1.2s	131K	$0.14	$0.26
192	179	Qwen3 30B A3B Thinking 2507	953	±10	3.5K	4.7%	0.5%	124 tps	1.2s	131K	$0.16	$1.70
193	230	Magistral Medium	952	±16	1.3K	10.8%	<0.1%	95 tps	0.5s	41K	$2.00	$5.00
194	179	Switchpoint Router	949	±10	2.7K	3.6%	1.7%	71 tps	4.9s	131K	$0.85	$3.40
195	179	Qwen3 8B	948	±9	4.2K	8.2%	2.4%	61 tps	1.4s	41K	$0.02	$0.07
196	179	Ministral 14B 3.0	948	±16	805	8.5%	2.0%	119 tps	0.5s	128K	$0.20	$0.20
197	179	Grok 3 Mini Fast	943	±7	9K	7.0%	1.6%	44 tps	0.5s	131K	$0.60	$4.00
198	179	ERNIE 4.5 21B A3B	943	±28	540	6.9%	2.3%	78 tps	1.5s	120K	$0.05	$0.19
199	179	ERNIE 4.5 VL 424B A47B	942	±18	725	6.5%	4.9%	36 tps	3.5s	123K	$0.42	$1.25
200	179	NVIDIA Llama 3.3 Nemotron Super 49B v1.5	941	±19	1.4K	6.9%	2.0%	50 tps	0.6s	131K	$0.09	$0.33

5of8

View All (305 models)