Leaderboard | Coding

Models

Choose model family

Claude by Anthropic

Mistral by Mistral AI

More filters

Show inactive models

Hide models that are no longer actively available on Yupp.

Turns

Filter model performance by the number of turns in a conversation.

All Single turn Multiple turns

Open license models

Filter the leaderboard to only show models that have an open license.

All selected Open license Proprietary license

762

Open Mistral 7B

756

DeepSeek-R1 Distill Qwen 14B

751

Seed Coder 8B Instruct

746

Qwen 2.5 VL 72B Instruct

737

Inflection 3 Productivity

734

Meridian

730

Zenith

725

Mistral Nemo 12B Celeste V1.9

720

Solar Pro 250422

719

Inflection 3 Pi

706

DeepHermes 3 Mistral 24B Preview

701

Dolphin 3.0 R1 Mistral 24B

696

DeepSeek-R1 Distill Qwen 32B

686

ArliAI QwQ 32B Arliai RpR V1

686

MiniMax M1

Last updated about 1 month ago

Rank	Overall	Name	VIBE Score	Confidence Interval	Votes	Downvote %	Abort %	Speed	Latency	Context	Cost (Input)	Cost (Output)
281	262	Open Mistral 7B	762	±18	1.3K	4.7%	0.7%	176 tps	0.4s	33K	$0.25	$0.25
282	361	DeepSeek-R1 Distill Qwen 14B	756	±16	1.9K	6.3%	<0.1%	44 tps	1.7s	64K	$0.63	$0.63
283	361	Seed Coder 8B Instruct	751	±22	605	2.4%	<0.1%	35 tps	N/A	32K	$0.99	$0.99
284	262	Qwen 2.5 VL 72B Instruct	746	±20	2.1K	6.0%	5.3%	25 tps	3.7s	128K	$1.01	$2.79
285	269	Inflection 3 Productivity	737	±24	1.5K	5.0%	0.6%	50 tps	3.2s	8K	$2.50	$10.00
286	361	Meridian	734	±39	965	9.8%	<0.1%	92 tps	1.2s	131K	$0	$0
287	361	Zenith	730	±28	850	9.6%	<0.1%	36 tps	1.8s	131K	$0	$0
288	374	Mistral Nemo 12B Celeste V1.9	725	±18	1.1K	3.5%	<0.1%	6 tps	10.2s	8K	$0.80	$1.20
289	374	Solar Pro 250422	720	±19	530	6.2%	<0.1%	13 tps	0.6s	33K	$0	$0
290	269	Inflection 3 Pi	719	±18	1.5K	4.1%	1.1%	33 tps	3.4s	8K	$2.50	$10.00
291	269	DeepHermes 3 Mistral 24B Preview	706	±30	715	5.9%	2.5%	50 tps	1.0s	33K	$0.06	$0.25
292	374	Dolphin 3.0 R1 Mistral 24B	701	±16	890	7.8%	<0.1%	13 tps	0.1s	33K	$0.03	$0.09
293	276	DeepSeek-R1 Distill Qwen 32B	696	±20	2K	5.5%	6.2%	22 tps	1.8s	131K	$0.37	$0.39
294	383	ArliAI QwQ 32B Arliai RpR V1	686	±40	635	9.3%	<0.1%	34 tps	1.8s	33K	$0.02	$0.07
295	276	MiniMax M1	686	±13	3.8K	5.3%	<0.1%	31 tps	2.8s	1M	$0.55	$2.20
296	386	MiMo 7B RL	655	±13	1.2K	3.5%	<0.1%	31 tps	0.4s	32K	$0.49	$0.49
297	386	Dolphin 2.9.2 Mixtral 8x22B	652	±19	1.1K	2.6%	<0.1%	20 tps	1.5s	16K	$0.90	$0.90
298	386	Shisa V2 Llama 3.3 70B	623	±24	585	9.3%	<0.1%	8 tps	2.0s	33K	$0.03	$0.09
299	279	UI-TARS 1.5 7B	610	±40	530	11.7%	4.0%	75 tps	0.9s	128K	$0.10	$0.20
300	390	ERNIE 4.5 0.3B	602	±40	685	11.0%	<0.1%	85 tps	2.2s	120K	$0	$0
301	390	DeepSeek-R1 Distill Llama 8B	595	±19	1.2K	5.6%	<0.1%	17 tps	N/A	32K	$0.04	$0.04
302	279	Hunyuan A13B Instruct	588	±22	1.6K	9.2%	2.3%	67 tps	2.0s	33K	$0.01	$0.01
303	399	Mistral Nemo 12B Inferor v0.0	454	±28	565	1.7%	<0.1%	83 tps	0.8s	16K	$0.80	$1.20
304	402	QwQ 32B RpR v1	406	±35	1K	10.9%	<0.1%	34 tps	3.3s	33K	$0.02	$0.07
305	404	Seed Coder 8B Reasoning	329	±41	700	4.1%	<0.1%	25 tps	N/A	32K	$0.99	$0.99

8of8

View All (305 models)