Leaderboard | Coding

Models

Choose model family

Claude by Anthropic

Mistral by Mistral AI

More filters

Show inactive models

Hide models that are no longer actively available on Yupp.

Turns

Filter model performance by the number of turns in a conversation.

All Single turn Multiple turns

Open license models

Filter the leaderboard to only show models that have an open license.

All selected Open license Proprietary license

411

Phi 4 Mini Reasoning

564

Qwen 2.5 VL 3B Instruct

574

Hunyuan A13B Instruct

600

Phi 4 Reasoning

618

MythoMax L2 13B

620

UI-TARS 1.5 7B

629

Phi 4 Mini Instruct

653

MiniMax M1

672

DeepSeek-R1 Distill Qwen 32B

677

DeepHermes 3 Mistral 24B Preview

686

Goliath 120B

721

Inflection 3 Productivity

732

Hermes 4 405B Reasoning FP8

739

Hermes 3 405B Instruct

744

Inflection 3 Pi

Last updated about 1 month ago

Rank	Overall	Name	VIBE Score	Confidence Interval	Votes	Downvote %	Abort %	Speed	Latency	Context	Cost (Input)	Cost (Output)
1	286	Phi 4 Mini Reasoning	411	±18	2.9K	12.7%	9.7%	30 tps	0.9s	128K	$0.07	$0.30
2	284	Qwen 2.5 VL 3B Instruct	564	±27	3.4K	4.9%	3.0%	44 tps	2.5s	128K	$0.21	$0.63
3	279	Hunyuan A13B Instruct	574	±20	1.5K	9.3%	2.3%	67 tps	2.0s	33K	$0.01	$0.01
4	279	Phi 4 Reasoning	600	±11	1.9K	5.0%	21.0%	29 tps	1.0s	33K	$0.06	$0.25
5	279	MythoMax L2 13B	618	±20	2.3K	5.8%	1.2%	22 tps	1.1s	4K	$0.18	$0.18
6	279	UI-TARS 1.5 7B	620	±40	485	11.8%	4.0%	75 tps	0.9s	128K	$0.10	$0.20
7	279	Phi 4 Mini Instruct	629	±26	1K	6.9%	7.4%	40 tps	1.1s	128K	$0.07	$0.30
8	276	MiniMax M1	653	±16	2.9K	6.1%	<0.1%	31 tps	2.8s	1M	$0.55	$2.20
9	276	DeepSeek-R1 Distill Qwen 32B	672	±17	1.6K	5.4%	6.2%	22 tps	1.8s	131K	$0.37	$0.39
10	269	DeepHermes 3 Mistral 24B Preview	677	±31	635	5.9%	2.5%	50 tps	1.0s	33K	$0.06	$0.25
11	262	Goliath 120B	686	±28	625	5.3%	2.7%	21 tps	2.2s	6K	$6.56	$9.38
12	269	Inflection 3 Productivity	721	±20	1.5K	4.8%	0.6%	50 tps	3.2s	8K	$2.50	$10.00
13	262	Hermes 4 405B Reasoning FP8	732	±24	2.1K	14.5%	3.6%	32 tps	0.8s	131K	$1.00	$3.00
14	276	Hermes 3 405B Instruct	739	±23	1.4K	3.9%	2.3%	20 tps	1.1s	131K	$0.80	$0.80
15	269	Inflection 3 Pi	744	±19	1.5K	4.2%	1.1%	33 tps	3.4s	8K	$2.50	$10.00
16	262	Qwen 2.5 VL 72B Instruct	748	±18	1.8K	5.7%	5.3%	25 tps	3.7s	128K	$1.01	$2.79
17	269	Command R+	753	±16	1.5K	4.9%	2.8%	36 tps	0.7s	128K	$2.08	$9.45
18	269	Mixtral 8x22B Instruct	754	±25	1.3K	4.8%	1.8%	142 tps	0.7s	66K	$0.45	$0.45
19	269	Pixtral 12B	758	±27	2.5K	5.7%	2.2%	101 tps	1.2s	131K	$0.08	$0.08
20	269	Gemma 3 4B	762	±13	3.3K	4.6%	1.3%	138 tps	0.7s	131K	$0.02	$0.04
21	262	Baichuan-M2-32B	769	±32	705	11.3%	<0.1%	32 tps	3.3s	131K	$0.07	$0.07
22	252	Mistral Large	771	±25	1K	5.1%	1.5%	54 tps	0.7s	33K	$2.00	$6.00
23	262	Command R	777	±18	2K	3.8%	5.8%	54 tps	0.6s	128K	$0.30	$0.99
24	234	ERNIE 4.5 21B A3B Thinking	779	±27	895	7.3%	1.8%	87 tps	1.5s	120K	$0.07	$0.28
25	262	Open Mistral 7B	788	±19	1.3K	4.8%	0.7%	176 tps	0.4s	33K	$0.25	$0.25
26	262	Mistral Small	789	±16	1.1K	4.6%	1.7%	142 tps	0.6s	32K	$0.43	$1.30
27	240	GLM 4.5 Flash	796	±49	490	8.4%	12.2%	15 tps	2.2s	131K	$0	$0
28	240	LFM2 2.6B	796	±22	645	10.4%	6.7%	184 tps	0.4s	33K	$0.01	$0.02
29	240	DeepSeek-R1 Distill Llama 70B	798	±14	2.7K	5.5%	3.6%	27 tps	1.6s	32K	$0.73	$0.95
30	252	GPT-3.5 Turbo Instruct	802	±15	2K	2.7%	<0.1%	46 tps	1.2s	4K	$1.50	$2.00
31	252	Gemma 3 1B	807	±16	1.9K	5.9%	0.6%	176 tps	1.0s	33K	$0.06	$0.10
32	210	GLM 4.7 Flash	822	±30	490	3.9%	5.8%	61 tps	2.8s	128K	$0.07	$0.39
33	240	Ministral 8B	823	±23	2.2K	5.4%	1.4%	177 tps	0.4s	128K	$0.14	$0.14
34	252	Ministral 3B	824	±18	2.3K	4.9%	0.8%	248 tps	0.4s	131K	$0.08	$0.08
35	210	Gemma 3n E4B	827	±10	4.4K	4.7%	2.0%	30 tps	0.5s	8K	$0.01	$0.02
36	252	Magistral Small 2509	827	±27	1.5K	7.3%	2.7%	116 tps	0.6s	131K	$0.50	$1.50
37	252	WizardLM-2 8x22B	827	±15	1.6K	1.8%	11.6%	11 tps	2.5s	66K	$0.77	$0.77
38	252	Phi 4	829	±16	1.6K	3.3%	5.1%	28 tps	1.3s	128K	$0.10	$0.32
39	240	C4AI Aya Expanse 32B	833	±9	3.5K	3.1%	1.5%	43 tps	0.5s	128K	$0.50	$1.50
40	210	Ministral 3B 2512	836	±60	505	7.3%	2.8%	339 tps	0.6s	131K	$0.10	$0.10

1of7

View All (273 models)