Leaderboard | Coding

Models

Choose model family

Claude by Anthropic

Mistral by Mistral AI

More filters

Show inactive models

Hide models that are no longer actively available on Yupp.

Turns

Filter model performance by the number of turns in a conversation.

All Single turn Multiple turns

Open license models

Filter the leaderboard to only show models that have an open license.

All selected Open license Proprietary license

893

GPT-4o mini

891

Mistral Small 3.2 24B Instruct

888

GLM 4 32B

888

Hermes 2 Pro Llama 3 8B

887

Gemma 3 12B

885

Mixtral 8x22B

883

Hermes 4 405B FP8

881

Qwen 2.5 14B Instruct

878

DeepSeek R1T2 Chimera

878

Mistral Nemo

877

Gemma 3 27B

876

Llama 3.3 70B

875

Gemma 3 27B IT

869

Sky T1 32B Preview

869

GPT-3.5 Turbo 16k

Last updated about 1 month ago

Rank	Overall	Name	VIBE Score	Confidence Interval	Votes	Downvote %	Abort %	Speed	Latency	Context	Cost (Input)	Cost (Output)
201	201	GPT-4o mini	893	±16	2.3K	5.4%	2.1%	71 tps	1.7s	128K	$0.15	$0.60
202	201	Mistral Small 3.2 24B Instruct	891	±24	805	8.5%	1.9%	113 tps	1.1s	131K	$0.02	$0.08
203	210	GLM 4 32B	888	±15	2.6K	4.0%	2.6%	40 tps	1.6s	33K	$0.14	$0.14
204	210	Hermes 2 Pro Llama 3 8B	888	±12	1.7K	2.2%	<0.1%	76 tps	1.0s	131K	$0.08	$0.09
205	210	Gemma 3 12B	887	±14	2.5K	4.8%	4.2%	73 tps	0.8s	131K	$0.05	$0.12
206	210	Mixtral 8x22B	885	±32	1.2K	4.3%	1.2%	140 tps	0.6s	64K	$2.00	$6.00
207	252	Hermes 4 405B FP8	883	±20	530	8.6%	3.5%	31 tps	0.9s	131K	$0.52	$1.73
208	210	Qwen 2.5 14B Instruct	881	±19	2.2K	5.2%	2.4%	40 tps	1.6s	1M	$0.40	$1.61
209	210	DeepSeek R1T2 Chimera	878	±11	1.8K	5.9%	3.0%	28 tps	1.8s	164K	$0.13	$0.45
210	210	Mistral Nemo	878	±23	890	2.7%	<0.1%	112 tps	0.4s	131K	$0.07	$0.13
211	210	Gemma 3 27B	877	±37	1K	6.8%	1.8%	35 tps	1.1s	66K	$0.06	$0.10
212	189	Llama 3.3 70B	876	±21	1.4K	8.4%	0.3%	500 tps	0.5s	8K	$0.48	$0.66
213	234	Gemma 3 27B IT	875	±11	2.3K	4.1%	2.0%	60 tps	0.8s	128K	$0.17	$0.29
214	240	Sky T1 32B Preview	869	±17	2.1K	3.6%	7.8%	73 tps	0.6s	16K	$0.12	$0.18
215	234	GPT-3.5 Turbo 16k	869	±11	2.7K	3.6%	<0.1%	22 tps	0.6s	16K	$3.00	$4.00
216	210	Mixtral 8x7B	868	±16	1.3K	4.9%	2.2%	142 tps	0.6s	33K	$0.23	$0.23
217	189	Jamba 1.7 Large	868	±28	810	8.0%	1.3%	58 tps	1.0s	256K	$1.33	$5.33
218	210	Mixtral 8x7B Instruct	867	±17	1.3K	3.8%	0.2%	79 tps	0.7s	33K	$0.23	$0.31
219	189	Seed 1.6 Flash 250715	864	±23	960	6.3%	2.5%	108 tps	1.6s	256K	$0.07	$0.30
220	234	Jamba 1.5 Large	862	±14	2.6K	3.4%	1.7%	48 tps	0.9s	256K	$1.50	$6.00
221	234	Command R 7B	861	±14	3.1K	4.4%	1.1%	76 tps	0.4s	128K	$0.04	$0.15
222	201	GLM 4.6V Flash	860	±23	1.9K	7.9%	3.7%	64 tps	2.1s	128K	$0.04	$0.40
223	210	Moonshot V1 8k	859	±18	890	4.8%	1.0%	55 tps	1.5s	8K	$0.20	$2.00
224	240	LFM2 8B A1B	858	±18	550	12.0%	<0.1%	142 tps	0.3s	33K	$0.01	$0.02
225	240	Qwen 2.5 7B	858	±15	2K	5.2%	3.7%	40 tps	1.9s	131K	$0.08	$0.27
226	210	Qwen3 4B	858	±13	3.7K	10.7%	1.9%	94 tps	1.5s	128K	$0.01	$0.01
227	210	Solar Mini 250422	856	±17	1.2K	5.7%	1.8%	90 tps	1.7s	33K	$0.15	$0.15
228	240	Krutrim 2	851	±14	2.1K	0.7%	12.5%	33 tps	2.1s	128K	$1.00	$1.00
229	189	Rnj-1 Instruct	846	±27	565	7.4%	0.6%	103 tps	0.3s	33K	$0.15	$0.15
230	240	Moonshot V1 32k	845	±23	905	3.2%	1.4%	53 tps	1.4s	33K	$1.00	$3.00
231	240	Mixtral-8x7B Instruct v0.1	840	±19	1.2K	4.0%	1.3%	54 tps	0.4s	33K	$0.60	$0.60
232	240	Gemma 2 27B	839	±15	1.5K	3.9%	1.4%	44 tps	1.4s	8K	$0.80	$0.80
233	234	Llama 3.3 70B Instruct Turbo	836	±16	1.1K	6.1%	2.0%	78 tps	1.0s	131K	$0.88	$0.88
234	210	Ministral 3B 2512	836	±60	505	7.3%	2.8%	339 tps	0.6s	131K	$0.10	$0.10
235	240	C4AI Aya Expanse 32B	833	±9	3.5K	3.1%	1.5%	43 tps	0.5s	128K	$0.50	$1.50
236	252	Phi 4	829	±16	1.6K	3.3%	5.1%	28 tps	1.3s	128K	$0.10	$0.32
237	252	WizardLM-2 8x22B	827	±15	1.6K	1.8%	11.6%	11 tps	2.5s	66K	$0.77	$0.77
238	252	Magistral Small 2509	827	±27	1.5K	7.3%	2.7%	116 tps	0.6s	131K	$0.50	$1.50
239	210	Gemma 3n E4B	827	±10	4.4K	4.7%	2.0%	30 tps	0.5s	8K	$0.01	$0.02
240	252	Ministral 3B	824	±18	2.3K	4.9%	0.8%	248 tps	0.4s	131K	$0.08	$0.08

6of7

View All (273 models)