Leaderboard | Coding

Models

Choose model family

Claude by Anthropic

Mistral by Mistral AI

More filters

Show inactive models

Hide models that are no longer actively available on Yupp.

Turns

Filter model performance by the number of turns in a conversation.

All Single turn Multiple turns

Open license models

Filter the leaderboard to only show models that have an open license.

All selected Open license Proprietary license

329

Seed Coder 8B Reasoning

406

QwQ 32B RpR v1

447

Phi 4 Mini Reasoning

454

Mistral Nemo 12B Inferor v0.0

463

CodeLlama 7B Instruct Solidity

481

DeepSeek-R1 Distill Qwen 1.5B

523

Qwen 2.5 VL 3B Instruct

573

Phi 4 Reasoning

588

Hunyuan A13B Instruct

595

DeepSeek-R1 Distill Llama 8B

599

Phi 4 Mini Instruct

600

MythoMax L2 13B

601

Llema 7B

602

ERNIE 4.5 0.3B

610

UI-TARS 1.5 7B

Last updated about 1 month ago

Rank	Overall	Name	VIBE Score	Confidence Interval	Votes	Downvote %	Abort %	Speed	Latency	Context	Cost (Input)	Cost (Output)
1	404	Seed Coder 8B Reasoning	329	±41	700	4.1%	<0.1%	25 tps	N/A	32K	$0.99	$0.99
2	402	QwQ 32B RpR v1	406	±35	1K	10.9%	<0.1%	34 tps	3.3s	33K	$0.02	$0.07
3	286	Phi 4 Mini Reasoning	447	±15	3.4K	12.0%	9.7%	30 tps	0.9s	128K	$0.07	$0.30
4	399	Mistral Nemo 12B Inferor v0.0	454	±28	565	1.7%	<0.1%	83 tps	0.8s	16K	$0.80	$1.20
5	284	CodeLlama 7B Instruct Solidity	463	±54	485	8.5%	3.6%	33 tps	0.7s	16K	$0.80	$1.20
6	399	DeepSeek-R1 Distill Qwen 1.5B	481	±19	730	5.2%	<0.1%	20 tps	0.0s	131K	$0.18	$0.18
7	284	Qwen 2.5 VL 3B Instruct	523	±25	4.1K	6.1%	3.0%	44 tps	2.5s	128K	$0.21	$0.63
8	279	Phi 4 Reasoning	573	±17	2.1K	5.5%	21.0%	29 tps	1.0s	33K	$0.06	$0.25
9	279	Hunyuan A13B Instruct	588	±22	1.6K	9.2%	2.3%	67 tps	2.0s	33K	$0.01	$0.01
10	390	DeepSeek-R1 Distill Llama 8B	595	±19	1.2K	5.6%	<0.1%	17 tps	N/A	32K	$0.04	$0.04
11	279	Phi 4 Mini Instruct	599	±21	1K	7.1%	7.4%	40 tps	1.1s	128K	$0.07	$0.30
12	279	MythoMax L2 13B	600	±21	2.3K	5.8%	1.2%	22 tps	1.1s	4K	$0.18	$0.18
13	390	Llema 7B	601	±21	850	4.5%	<0.1%	1 tps	15.0s	4K	$0.80	$1.20
14	390	ERNIE 4.5 0.3B	602	±40	685	11.0%	<0.1%	85 tps	2.2s	120K	$0	$0
15	279	UI-TARS 1.5 7B	610	±40	530	11.7%	4.0%	75 tps	0.9s	128K	$0.10	$0.20
16	386	Shisa V2 Llama 3.3 70B	623	±24	585	9.3%	<0.1%	8 tps	2.0s	33K	$0.03	$0.09
17	386	DeepSeek-R1 Distill Qwen 7B	633	±19	565	5.0%	<0.1%	0 tps	N/A	131K	$0.05	$0.10
18	386	Dolphin 2.9.2 Mixtral 8x22B	652	±19	1.1K	2.6%	<0.1%	20 tps	1.5s	16K	$0.90	$0.90
19	386	MiMo 7B RL	655	±13	1.2K	3.5%	<0.1%	31 tps	0.4s	32K	$0.49	$0.49
20	276	MiniMax M1	686	±13	3.8K	5.3%	<0.1%	31 tps	2.8s	1M	$0.55	$2.20
21	383	ArliAI QwQ 32B Arliai RpR V1	686	±40	635	9.3%	<0.1%	34 tps	1.8s	33K	$0.02	$0.07
22	276	DeepSeek-R1 Distill Qwen 32B	696	±20	2K	5.5%	6.2%	22 tps	1.8s	131K	$0.37	$0.39
23	374	Phi 4 Multimodal Instruct	697	±16	2.1K	6.8%	<0.1%	17 tps	1.4s	128K	$0.03	$0.05
24	374	Dolphin 3.0 R1 Mistral 24B	701	±16	890	7.8%	<0.1%	13 tps	0.1s	33K	$0.03	$0.09
25	276	Hermes 3 405B Instruct	702	±20	1.4K	4.1%	2.3%	20 tps	1.1s	131K	$0.80	$0.80
26	269	DeepHermes 3 Mistral 24B Preview	706	±30	715	5.9%	2.5%	50 tps	1.0s	33K	$0.06	$0.25
27	374	Mythalion 13B	709	±10	1.1K	1.3%	<0.1%	63 tps	0.5s	4K	$0.56	$1.13
28	269	Inflection 3 Pi	719	±18	1.5K	4.1%	1.1%	33 tps	3.4s	8K	$2.50	$10.00
29	374	Solar Pro 250422	720	±19	530	6.2%	<0.1%	13 tps	0.6s	33K	$0	$0
30	269	Pixtral 12B	722	±21	3K	6.3%	2.2%	101 tps	1.2s	131K	$0.08	$0.08
31	374	Mistral Nemo 12B Celeste V1.9	725	±18	1.1K	3.5%	<0.1%	6 tps	10.2s	8K	$0.80	$1.20
32	361	Zenith	730	±28	850	9.6%	<0.1%	36 tps	1.8s	131K	$0	$0
33	361	Meridian	734	±39	965	9.8%	<0.1%	92 tps	1.2s	131K	$0	$0
34	361	Command	734	±18	765	4.4%	<0.1%	25 tps	N/A	4K	$0.83	$1.33
35	269	Inflection 3 Productivity	737	±24	1.5K	5.0%	0.6%	50 tps	3.2s	8K	$2.50	$10.00
36	269	Command R+	738	±15	1.6K	5.6%	2.8%	36 tps	0.7s	128K	$2.08	$9.45
37	269	Mixtral 8x22B Instruct	738	±17	1.4K	5.6%	1.8%	142 tps	0.7s	66K	$0.45	$0.45
38	269	Gemma 3 4B	742	±10	3.3K	4.7%	1.3%	138 tps	0.7s	131K	$0.02	$0.04
39	262	Qwen 2.5 VL 72B Instruct	746	±20	2.1K	6.0%	5.3%	25 tps	3.7s	128K	$1.01	$2.79
40	361	Seed Coder 8B Instruct	751	±22	605	2.4%	<0.1%	35 tps	N/A	32K	$0.99	$0.99

1of11

View All (404 models)