Leaderboard | Coding

Models

Choose model family

Claude by Anthropic

Mistral by Mistral AI

More filters

Show inactive models

Hide models that are no longer actively available on Yupp.

Turns

Filter model performance by the number of turns in a conversation.

All Single turn Multiple turns

Open license models

Filter the leaderboard to only show models that have an open license.

All selected Open license Proprietary license

823

Ministral 8B

822

GLM 4.7 Flash

807

Gemma 3 1B

802

GPT-3.5 Turbo Instruct

798

DeepSeek-R1 Distill Llama 70B

796

LFM2 2.6B

796

GLM 4.5 Flash

789

Mistral Small

788

Open Mistral 7B

779

ERNIE 4.5 21B A3B Thinking

777

Command R

771

Mistral Large

769

Baichuan-M2-32B

762

Gemma 3 4B

758

Pixtral 12B

Last updated about 1 month ago

Rank	Overall	Name	VIBE Score	Confidence Interval	Votes	Downvote %	Abort %	Speed	Latency	Context	Cost (Input)	Cost (Output)
241	240	Ministral 8B	823	±23	2.2K	5.4%	1.4%	177 tps	0.4s	128K	$0.14	$0.14
242	210	GLM 4.7 Flash	822	±30	490	3.9%	5.8%	61 tps	2.8s	128K	$0.07	$0.39
243	252	Gemma 3 1B	807	±16	1.9K	5.9%	0.6%	176 tps	1.0s	33K	$0.06	$0.10
244	252	GPT-3.5 Turbo Instruct	802	±15	2K	2.7%	<0.1%	46 tps	1.2s	4K	$1.50	$2.00
245	240	DeepSeek-R1 Distill Llama 70B	798	±14	2.7K	5.5%	3.6%	27 tps	1.6s	32K	$0.73	$0.95
246	240	LFM2 2.6B	796	±22	645	10.4%	6.7%	184 tps	0.4s	33K	$0.01	$0.02
247	240	GLM 4.5 Flash	796	±49	490	8.4%	12.2%	15 tps	2.2s	131K	$0	$0
248	262	Mistral Small	789	±16	1.1K	4.6%	1.7%	142 tps	0.6s	32K	$0.43	$1.30
249	262	Open Mistral 7B	788	±19	1.3K	4.8%	0.7%	176 tps	0.4s	33K	$0.25	$0.25
250	234	ERNIE 4.5 21B A3B Thinking	779	±27	895	7.3%	1.8%	87 tps	1.5s	120K	$0.07	$0.28
251	262	Command R	777	±18	2K	3.8%	5.8%	54 tps	0.6s	128K	$0.30	$0.99
252	252	Mistral Large	771	±25	1K	5.1%	1.5%	54 tps	0.7s	33K	$2.00	$6.00
253	262	Baichuan-M2-32B	769	±32	705	11.3%	<0.1%	32 tps	3.3s	131K	$0.07	$0.07
254	269	Gemma 3 4B	762	±13	3.3K	4.6%	1.3%	138 tps	0.7s	131K	$0.02	$0.04
255	269	Pixtral 12B	758	±27	2.5K	5.7%	2.2%	101 tps	1.2s	131K	$0.08	$0.08
256	269	Mixtral 8x22B Instruct	754	±25	1.3K	4.8%	1.8%	142 tps	0.7s	66K	$0.45	$0.45
257	269	Command R+	753	±16	1.5K	4.9%	2.8%	36 tps	0.7s	128K	$2.08	$9.45
258	262	Qwen 2.5 VL 72B Instruct	748	±18	1.8K	5.7%	5.3%	25 tps	3.7s	128K	$1.01	$2.79
259	269	Inflection 3 Pi	744	±19	1.5K	4.2%	1.1%	33 tps	3.4s	8K	$2.50	$10.00
260	276	Hermes 3 405B Instruct	739	±23	1.4K	3.9%	2.3%	20 tps	1.1s	131K	$0.80	$0.80
261	262	Hermes 4 405B Reasoning FP8	732	±24	2.1K	14.5%	3.6%	32 tps	0.8s	131K	$1.00	$3.00
262	269	Inflection 3 Productivity	721	±20	1.5K	4.8%	0.6%	50 tps	3.2s	8K	$2.50	$10.00
263	262	Goliath 120B	686	±28	625	5.3%	2.7%	21 tps	2.2s	6K	$6.56	$9.38
264	269	DeepHermes 3 Mistral 24B Preview	677	±31	635	5.9%	2.5%	50 tps	1.0s	33K	$0.06	$0.25
265	276	DeepSeek-R1 Distill Qwen 32B	672	±17	1.6K	5.4%	6.2%	22 tps	1.8s	131K	$0.37	$0.39
266	276	MiniMax M1	653	±16	2.9K	6.1%	<0.1%	31 tps	2.8s	1M	$0.55	$2.20
267	279	Phi 4 Mini Instruct	629	±26	1K	6.9%	7.4%	40 tps	1.1s	128K	$0.07	$0.30
268	279	UI-TARS 1.5 7B	620	±40	485	11.8%	4.0%	75 tps	0.9s	128K	$0.10	$0.20
269	279	MythoMax L2 13B	618	±20	2.3K	5.8%	1.2%	22 tps	1.1s	4K	$0.18	$0.18
270	279	Phi 4 Reasoning	600	±11	1.9K	5.0%	21.0%	29 tps	1.0s	33K	$0.06	$0.25
271	279	Hunyuan A13B Instruct	574	±20	1.5K	9.3%	2.3%	67 tps	2.0s	33K	$0.01	$0.01
272	284	Qwen 2.5 VL 3B Instruct	564	±27	3.4K	4.9%	3.0%	44 tps	2.5s	128K	$0.21	$0.63
273	286	Phi 4 Mini Reasoning	411	±18	2.9K	12.7%	9.7%	30 tps	0.9s	128K	$0.07	$0.30

7of7

View All (273 models)