Leaderboard | Coding

Models

Choose model family

Claude by Anthropic

Mistral by Mistral AI

More filters

Show inactive models

Hide models that are no longer actively available on Yupp.

Turns

Filter model performance by the number of turns in a conversation.

All Single turn Multiple turns

Open license models

Filter the leaderboard to only show models that have an open license.

All selected Open license Proprietary license

447

Phi 4 Mini Reasoning

463

CodeLlama 7B Instruct Solidity

481

DeepSeek-R1 Distill Qwen 1.5B

523

Qwen 2.5 VL 3B Instruct

573

Phi 4 Reasoning

599

Phi 4 Mini Instruct

600

MythoMax L2 13B

601

Llema 7B

633

DeepSeek-R1 Distill Qwen 7B

697

Phi 4 Multimodal Instruct

702

Hermes 3 405B Instruct

709

Mythalion 13B

722

Pixtral 12B

734

Command

738

Command R+

Last updated about 1 month ago

Rank	Overall	Name	VIBE Score	Confidence Interval	Votes	Downvote %	Abort %	Speed	Latency	Context	Cost (Input)	Cost (Output)
1	286	Phi 4 Mini Reasoning	447	±15	3.4K	12.0%	9.7%	30 tps	0.9s	128K	$0.07	$0.30
2	284	CodeLlama 7B Instruct Solidity	463	±54	485	8.5%	3.6%	33 tps	0.7s	16K	$0.80	$1.20
3	399	DeepSeek-R1 Distill Qwen 1.5B	481	±19	730	5.2%	<0.1%	20 tps	0.0s	131K	$0.18	$0.18
4	284	Qwen 2.5 VL 3B Instruct	523	±25	4.1K	6.1%	3.0%	44 tps	2.5s	128K	$0.21	$0.63
5	279	Phi 4 Reasoning	573	±17	2.1K	5.5%	21.0%	29 tps	1.0s	33K	$0.06	$0.25
6	279	Phi 4 Mini Instruct	599	±21	1K	7.1%	7.4%	40 tps	1.1s	128K	$0.07	$0.30
7	279	MythoMax L2 13B	600	±21	2.3K	5.8%	1.2%	22 tps	1.1s	4K	$0.18	$0.18
8	390	Llema 7B	601	±21	850	4.5%	<0.1%	1 tps	15.0s	4K	$0.80	$1.20
9	386	DeepSeek-R1 Distill Qwen 7B	633	±19	565	5.0%	<0.1%	0 tps	N/A	131K	$0.05	$0.10
10	374	Phi 4 Multimodal Instruct	697	±16	2.1K	6.8%	<0.1%	17 tps	1.4s	128K	$0.03	$0.05
11	276	Hermes 3 405B Instruct	702	±20	1.4K	4.1%	2.3%	20 tps	1.1s	131K	$0.80	$0.80
12	374	Mythalion 13B	709	±10	1.1K	1.3%	<0.1%	63 tps	0.5s	4K	$0.56	$1.13
13	269	Pixtral 12B	722	±21	3K	6.3%	2.2%	101 tps	1.2s	131K	$0.08	$0.08
14	361	Command	734	±18	765	4.4%	<0.1%	25 tps	N/A	4K	$0.83	$1.33
15	269	Command R+	738	±15	1.6K	5.6%	2.8%	36 tps	0.7s	128K	$2.08	$9.45
16	269	Mixtral 8x22B Instruct	738	±17	1.4K	5.6%	1.8%	142 tps	0.7s	66K	$0.45	$0.45
17	269	Gemma 3 4B	742	±10	3.3K	4.7%	1.3%	138 tps	0.7s	131K	$0.02	$0.04
18	262	Goliath 120B	754	±24	745	5.7%	2.7%	21 tps	2.2s	6K	$6.56	$9.38
19	262	Hermes 4 405B Reasoning FP8	759	±11	2.7K	12.8%	3.6%	32 tps	0.8s	131K	$1.00	$3.00
20	262	Mistral Small	770	±12	1.2K	4.5%	1.7%	142 tps	0.6s	32K	$0.43	$1.30
21	262	Command R	778	±18	2.2K	4.9%	5.8%	54 tps	0.6s	128K	$0.30	$0.99
22	252	Phi 4	798	±16	1.7K	3.4%	5.1%	28 tps	1.3s	128K	$0.10	$0.32
23	252	Gemma 3 1B	802	±11	2K	6.1%	0.6%	176 tps	1.0s	33K	$0.06	$0.10
24	252	Ministral 3B	806	±16	2.3K	5.1%	0.8%	248 tps	0.4s	131K	$0.08	$0.08
25	240	Gemma 2 27B	815	±17	1.5K	4.1%	1.4%	44 tps	1.4s	8K	$0.80	$0.80
26	240	C4AI Aya Expanse 32B	821	±7	3.8K	4.0%	1.5%	43 tps	0.5s	128K	$0.50	$1.50
27	240	Ministral 8B	825	±17	2.2K	5.5%	1.4%	177 tps	0.4s	128K	$0.14	$0.14
28	240	Sky T1 32B Preview	829	±14	2.4K	4.5%	7.8%	73 tps	0.6s	16K	$0.12	$0.18
29	240	Qwen 2.5 7B	831	±17	2K	5.1%	3.7%	40 tps	1.9s	131K	$0.08	$0.27
30	240	Mixtral-8x7B Instruct v0.1	832	±23	1.3K	4.6%	1.3%	54 tps	0.4s	33K	$0.60	$0.60
31	324	OLMo 2 0425 1B Instruct	833	±21	560	2.6%	<0.1%	68 tps	0.0s	4K	$0	$0
32	324	Typhoon 2 70B Instruct	835	±15	1.4K	4.0%	<0.1%	19 tps	0.1s	8K	$0.88	$0.88
33	240	DeepSeek-R1 Distill Llama 70B	835	±9	3.4K	5.2%	3.6%	27 tps	1.6s	32K	$0.73	$0.95
34	234	Command R 7B	849	±15	3.3K	4.8%	1.1%	76 tps	0.4s	128K	$0.04	$0.15
35	234	Llama 3.3 70B Instruct Turbo	851	±19	1.2K	6.0%	2.0%	78 tps	1.0s	131K	$0.88	$0.88
36	234	Gemma 3 27B IT	853	±10	2.3K	3.9%	2.0%	60 tps	0.8s	128K	$0.17	$0.29
37	210	Mixtral 8x7B Instruct	854	±16	1.4K	4.4%	0.2%	79 tps	0.7s	33K	$0.23	$0.31
38	210	Mixtral 8x7B	855	±18	1.3K	5.1%	2.2%	142 tps	0.6s	33K	$0.23	$0.23
39	210	Gemma 3 27B	856	±27	1.1K	6.9%	1.8%	35 tps	1.1s	66K	$0.06	$0.10
40	312	Command Light	856	±16	1.1K	4.9%	<0.1%	23 tps	N/A	4K	$0.10	$0.20

1of3

View All (99 models)