Leaderboard | Coding

Models

Choose model family

Claude by Anthropic

Mistral by Mistral AI

More filters

Show inactive models

Hide models that are no longer actively available on Yupp.

Turns

Filter model performance by the number of turns in a conversation.

All Single turn Multiple turns

Open license models

Filter the leaderboard to only show models that have an open license.

All selected Open license Proprietary license

1291

Kimi K2.5

1231

Qwen3 Next 80B A3B Instruct

1228

MiniMax M2.5 Lightning

1216

Qwen3.5 122B A17B

1211

Qwen3.5 27B

1210

Kimi K2.5 Instant

1192

Kimi K2 Thinking Turbo

1178

DeepSeek V3.2 Thinking

1165

gpt-oss-120b

1134

Grok 3 Beta

1131

Mistral Large 3

1107

DeepSeek V3.2 Exp Chat

1102

Step 3.5 Flash

1093

Qwen3 235B A22B

1089

DeepSeek V3.2 Exp Thinking

Last updated about 1 month ago

Rank	Overall	Name	VIBE Score	Confidence Interval	Votes	Downvote %	Abort %	Speed	Latency	Context	Cost (Input)	Cost (Output)
1	19	Kimi K2.5	1291	±11	16.5K	3.4%	6.5%	33 tps	1.7s	262K	$0.34	$2.57
2	31	Qwen3 Next 80B A3B Instruct	1231	±5	8.8K	5.8%	0.6%	84 tps	1.1s	256K	$0.20	$1.42
3	31	MiniMax M2.5 Lightning	1228	±14	1.7K	3.2%	1.5%	51 tps	2.0s	205K	$0.60	$2.40
4	36	Qwen3.5 122B A17B	1216	±15	1.9K	3.1%	1.5%	82 tps	1.4s	256K	$0.40	$3.20
5	36	Qwen3.5 27B	1211	±16	910	4.7%	3.7%	55 tps	2.6s	256K	$0.30	$2.40
6	36	Kimi K2.5 Instant	1210	±8	1.8K	3.2%	2.9%	32 tps	3.0s	262K	$0.50	$3.00
7	49	Kimi K2 Thinking Turbo	1192	±6	20.3K	3.4%	2.0%	75 tps	1.4s	262K	$1.15	$8.00
8	60	DeepSeek V3.2 Thinking	1178	±9	23.3K	4.0%	9.0%	30 tps	2.6s	131K	$0.28	$0.42
9	69	gpt-oss-120b	1165	±5	19.2K	5.0%	0.7%	213 tps	0.5s	131K	$0.11	$0.50
10	97	Grok 3 Beta	1134	±9	2K	0.8%	<0.1%	58 tps	0.8s	131K	$3.00	$15.00
11	77	Mistral Large 3	1131	±8	5.4K	5.8%	2.1%	51 tps	1.0s	256K	$0.50	$1.50
12	90	DeepSeek V3.2 Exp Chat	1107	±4	5.5K	6.1%	2.6%	29 tps	1.5s	131K	$0.27	$0.39
13	90	Step 3.5 Flash	1102	±24	810	3.6%	2.2%	109 tps	0.6s	256K	$0.05	$0.15
14	98	Qwen3 235B A22B	1093	±6	4.5K	8.0%	5.3%	71 tps	0.9s	41K	$0.23	$0.63
15	98	DeepSeek V3.2 Exp Thinking	1089	±7	5.9K	3.5%	7.2%	26 tps	3.0s	131K	$0.28	$0.42
16	112	Kimi K2 Fast	1073	±5	35K	6.4%	0.8%	365 tps	0.5s	131K	$1.00	$3.00
17	112	gpt-oss-20b	1066	±6	7.7K	7.1%	0.5%	216 tps	0.5s	131K	$0.06	$0.26
18	119	DeepSeek V3.1 Terminus Thinking	1061	±9	2.9K	9.4%	5.9%	27 tps	1.8s	131K	$0.56	$1.68
19	151	Llama 3 8B Turbo	1059	±24	600	1.6%	<0.1%	97 tps	0.1s	8K	$0.12	$0.13
20	119	Qwen3 32B Fast	1052	±6	11.4K	5.2%	11.6%	30 tps	3.1s	41K	$0.10	$0.25
21	164	Llama 3 70B Turbo	1037	±6	4.3K	1.0%	<0.1%	31 tps	0.0s	8K	$0.73	$0.83
22	135	QwQ 32B	1035	±4	11.6K	6.4%	5.4%	41 tps	2.1s	16K	$0.43	$0.56
23	174	Qwen 2.5 72B Turbo	1035	±22	670	5.0%	<0.1%	84 tps	0.8s	131K	$0.60	$0.60
24	135	Qwen3 VL 30B A3B Instruct	1034	±15	1K	6.7%	1.8%	80 tps	2.6s	129K	$0.18	$0.67
25	135	DeepSeek V3	1032	±5	17.6K	3.7%	0.9%	69 tps	1.1s	64K	$0.59	$1.49
26	144	Command A	1024	±4	22.4K	4.8%	2.2%	42 tps	0.8s	256K	$2.00	$7.33
27	148	Nemotron 3 Nano (Thinking)	1012	±13	2K	6.7%	2.0%	200 tps	0.5s	256K	$0	$0
28	189	K2 Think	1005	±16	1.4K	5.6%	<0.1%	418 tps	2.8s	N/A	$0	$0
29	148	DeepSeek-R1 Turbo	1003	±9	2.5K	5.6%	2.6%	29 tps	1.8s	64K	$2.85	$4.75
30	148	Qwen3 30B A3B	994	±8	6.3K	6.9%	5.1%	163 tps	1.0s	41K	$0.06	$0.21
31	159	Mistral Small 3.1 24B Instruct	980	±11	2.9K	4.3%	7.5%	15 tps	2.4s	131K	$0.06	$0.18
32	159	DeepSeek-R1 0528	979	±6	5.5K	3.5%	1.3%	93 tps	0.5s	64K	$1.60	$3.67
33	167	Qwen 2.5 32B Instruct	972	±7	4.1K	6.5%	2.5%	48 tps	1.0s	131K	$0.21	$0.25
34	167	Llama 4 Maverick	971	±5	21K	5.0%	1.2%	88 tps	2.4s	1M	$0.23	$0.83
35	167	Pixtral Large	969	±14	3.5K	3.9%	2.5%	57 tps	1.3s	128K	$1.50	$4.50
36	167	Qwen3 VL 30B A3B Thinking	967	±11	1.9K	8.9%	4.5%	84 tps	2.9s	127K	$0.20	$1.47
37	167	Qwen3 14B	962	±8	5.3K	8.4%	1.7%	109 tps	0.8s	41K	$0.04	$0.15
38	167	Llama 3.1 8B Turbo	958	±14	2.2K	2.0%	2.1%	650 tps	0.5s	128K	$0.13	$0.14
39	230	NVIDIA Llama 3.3 Nemotron Super 49B v1	942	±9	3.6K	2.3%	<0.1%	13 tps	N/A	131K	$0.07	$0.20
40	179	DeepSeek-R1	939	±6	6.4K	4.3%	0.8%	133 tps	0.6s	64K	$0.91	$3.07
41	179	DeepSeek Prover v2	935	±10	1.3K	3.0%	5.2%	14 tps	1.3s	164K	$0.40	$1.56
42	189	Codestral	931	±19	855	6.0%	5.2%	151 tps	0.9s	262K	$0.15	$0.45
43	245	NVIDIA Llama 3.1 Nemotron 70B	928	±7	5.3K	2.0%	<0.1%	9 tps	0.1s	128K	$0.33	$0.39
44	189	Mistral Small 3.1	925	±14	2.4K	4.0%	7.4%	13 tps	2.6s	32K	$0.17	$0.28
45	189	Open Mistral Nemo	918	±21	1.7K	4.5%	1.5%	171 tps	0.5s	131K	$0.15	$0.15
46	264	Arcee AI Spotlight	910	±8	4.6K	4.3%	<0.1%	121 tps	0.4s	131K	$0.18	$0.18
47	264	OLMo 3 32B Think	910	±25	470	6.0%	<0.1%	84 tps	0.6s	66K	$0.15	$0.50
48	264	Llama 3.1 405B Instruct Turbo	896	±11	2K	3.9%	<0.1%	26 tps	0.8s	131K	$3.50	$3.50
49	264	Arcee AI Virtuoso-Medium	896	±12	2K	2.6%	<0.1%	3 tps	N/A	131K	$0.50	$0.80
50	201	GLM 4.6V Flash	892	±10	2.5K	7.6%	3.7%	64 tps	2.1s	128K	$0.04	$0.40
51	280	Arcee AI Blitz	889	±8	3K	2.1%	<0.1%	6 tps	N/A	33K	$0.45	$0.75
52	201	Llama 3.2 11B Instruct	885	±15	2.1K	4.1%	1.5%	152 tps	0.5s	8K	$0.16	$0.16
53	210	Mistral Small 3 24B Instruct	880	±10	1.7K	3.6%	2.6%	77 tps	0.6s	33K	$0.07	$0.14
54	210	Mistral Nemo	875	±15	915	2.7%	<0.1%	112 tps	0.4s	131K	$0.07	$0.13
55	210	Qwen 2.5 7B Turbo	870	±25	615	6.1%	0.5%	125 tps	0.4s	131K	$0.30	$0.30
56	210	Hermes 2 Pro Llama 3 8B	864	±21	1.8K	2.5%	<0.1%	76 tps	1.0s	131K	$0.08	$0.09
57	210	Mistral Small 24B Instruct	864	±16	1.5K	4.1%	1.5%	84 tps	0.4s	33K	$0.80	$0.80
58	293	Hermes 2 Mixtral 8x7B DPO	863	±17	1.2K	1.3%	<0.1%	1 tps	N/A	33K	$0.60	$0.60
59	312	Yi Large	858	±12	1.5K	<0.1%	<0.1%	34 tps	N/A	33K	$1.50	$1.50
60	312	Command Light	856	±16	1.1K	4.9%	<0.1%	23 tps	N/A	4K	$0.10	$0.20
61	210	Gemma 3 27B	856	±27	1.1K	6.9%	1.8%	35 tps	1.1s	66K	$0.06	$0.10
62	210	Mixtral 8x7B	855	±18	1.3K	5.1%	2.2%	142 tps	0.6s	33K	$0.23	$0.23
63	210	Mixtral 8x7B Instruct	854	±16	1.4K	4.4%	0.2%	79 tps	0.7s	33K	$0.23	$0.31
64	234	Gemma 3 27B IT	853	±10	2.3K	3.9%	2.0%	60 tps	0.8s	128K	$0.17	$0.29
65	234	Llama 3.3 70B Instruct Turbo	851	±19	1.2K	6.0%	2.0%	78 tps	1.0s	131K	$0.88	$0.88
66	234	Command R 7B	849	±15	3.3K	4.8%	1.1%	76 tps	0.4s	128K	$0.04	$0.15
67	240	DeepSeek-R1 Distill Llama 70B	835	±9	3.4K	5.2%	3.6%	27 tps	1.6s	32K	$0.73	$0.95
68	324	Typhoon 2 70B Instruct	835	±15	1.4K	4.0%	<0.1%	19 tps	0.1s	8K	$0.88	$0.88
69	324	OLMo 2 0425 1B Instruct	833	±21	560	2.6%	<0.1%	68 tps	0.0s	4K	$0	$0
70	240	Mixtral-8x7B Instruct v0.1	832	±23	1.3K	4.6%	1.3%	54 tps	0.4s	33K	$0.60	$0.60
71	240	Qwen 2.5 7B	831	±17	2K	5.1%	3.7%	40 tps	1.9s	131K	$0.08	$0.27
72	240	Sky T1 32B Preview	829	±14	2.4K	4.5%	7.8%	73 tps	0.6s	16K	$0.12	$0.18
73	240	Ministral 8B	825	±17	2.2K	5.5%	1.4%	177 tps	0.4s	128K	$0.14	$0.14
74	240	C4AI Aya Expanse 32B	821	±7	3.8K	4.0%	1.5%	43 tps	0.5s	128K	$0.50	$1.50
75	240	Gemma 2 27B	815	±17	1.5K	4.1%	1.4%	44 tps	1.4s	8K	$0.80	$0.80
76	252	Ministral 3B	806	±16	2.3K	5.1%	0.8%	248 tps	0.4s	131K	$0.08	$0.08
77	252	Gemma 3 1B	802	±11	2K	6.1%	0.6%	176 tps	1.0s	33K	$0.06	$0.10
78	252	Phi 4	798	±16	1.7K	3.4%	5.1%	28 tps	1.3s	128K	$0.10	$0.32
79	262	Command R	778	±18	2.2K	4.9%	5.8%	54 tps	0.6s	128K	$0.30	$0.99
80	262	Mistral Small	770	±12	1.2K	4.5%	1.7%	142 tps	0.6s	32K	$0.43	$1.30
81	262	Hermes 4 405B Reasoning FP8	759	±11	2.7K	12.8%	3.6%	32 tps	0.8s	131K	$1.00	$3.00
82	262	Goliath 120B	754	±24	745	5.7%	2.7%	21 tps	2.2s	6K	$6.56	$9.38
83	269	Gemma 3 4B	742	±10	3.3K	4.7%	1.3%	138 tps	0.7s	131K	$0.02	$0.04
84	269	Mixtral 8x22B Instruct	738	±17	1.4K	5.6%	1.8%	142 tps	0.7s	66K	$0.45	$0.45
85	269	Command R+	738	±15	1.6K	5.6%	2.8%	36 tps	0.7s	128K	$2.08	$9.45
86	361	Command	734	±18	765	4.4%	<0.1%	25 tps	N/A	4K	$0.83	$1.33
87	269	Pixtral 12B	722	±21	3K	6.3%	2.2%	101 tps	1.2s	131K	$0.08	$0.08
88	374	Mythalion 13B	709	±10	1.1K	1.3%	<0.1%	63 tps	0.5s	4K	$0.56	$1.13
89	276	Hermes 3 405B Instruct	702	±20	1.4K	4.1%	2.3%	20 tps	1.1s	131K	$0.80	$0.80
90	374	Phi 4 Multimodal Instruct	697	±16	2.1K	6.8%	<0.1%	17 tps	1.4s	128K	$0.03	$0.05
91	386	DeepSeek-R1 Distill Qwen 7B	633	±19	565	5.0%	<0.1%	0 tps	N/A	131K	$0.05	$0.10
92	390	Llema 7B	601	±21	850	4.5%	<0.1%	1 tps	15.0s	4K	$0.80	$1.20
93	279	MythoMax L2 13B	600	±21	2.3K	5.8%	1.2%	22 tps	1.1s	4K	$0.18	$0.18
94	279	Phi 4 Mini Instruct	599	±21	1K	7.1%	7.4%	40 tps	1.1s	128K	$0.07	$0.30
95	279	Phi 4 Reasoning	573	±17	2.1K	5.5%	21.0%	29 tps	1.0s	33K	$0.06	$0.25
96	284	Qwen 2.5 VL 3B Instruct	523	±25	4.1K	6.1%	3.0%	44 tps	2.5s	128K	$0.21	$0.63
97	399	DeepSeek-R1 Distill Qwen 1.5B	481	±19	730	5.2%	<0.1%	20 tps	0.0s	131K	$0.18	$0.18
98	284	CodeLlama 7B Instruct Solidity	463	±54	485	8.5%	3.6%	33 tps	0.7s	16K	$0.80	$1.20
99	286	Phi 4 Mini Reasoning	447	±15	3.4K	12.0%	9.7%	30 tps	0.9s	128K	$0.07	$0.30

Show Less