Leaderboard | Coding

Models

Choose model family

Claude by Anthropic

Mistral by Mistral AI

More filters

Show inactive models

Hide models that are no longer actively available on Yupp.

Turns

Filter model performance by the number of turns in a conversation.

All Single turn Multiple turns

Open license models

Filter the leaderboard to only show models that have an open license.

All selected Open license Proprietary license

883

Magistral Medium 2509

894

Amazon Nova Pro 1.0

899

Moonshot V1 Auto

900

GPT-4o mini

903

Mistral Small 3.2 24B Instruct

904

Llama 3 8B

908

GPT-3.5 Turbo

908

Magistral Small 2506

912

Inception Mercury Coder Small Beta

913

Seed 1.6 Flash 250715

915

Rnj-1 Instruct

916

Devstral Small

917

Jamba 1.7 Large

919

Llama 3.3 Swallow 70B Instruct

924

Jamba 1.6 Large

Last updated about 1 month ago

Rank	Overall	Name	VIBE Score	Confidence Interval	Votes	Downvote %	Abort %	Speed	Latency	Context	Cost (Input)	Cost (Output)
41	210	Magistral Medium 2509	883	±16	2.6K	9.5%	4.0%	58 tps	0.9s	131K	$2.00	$5.00
42	201	Amazon Nova Pro 1.0	894	±10	5.7K	4.0%	0.9%	96 tps	0.7s	300K	$0.80	$1.70
43	201	Moonshot V1 Auto	899	±22	930	4.1%	1.2%	54 tps	1.5s	8K	$2.00	$5.00
44	201	GPT-4o mini	900	±14	2.8K	5.3%	2.1%	71 tps	1.7s	128K	$0.15	$0.60
45	201	Mistral Small 3.2 24B Instruct	903	±20	850	8.6%	1.9%	113 tps	1.1s	131K	$0.02	$0.08
46	201	Llama 3 8B	904	±10	3.2K	3.5%	6.0%	85 tps	0.7s	8K	$0.12	$0.16
47	201	GPT-3.5 Turbo	908	±15	1.2K	2.5%	1.3%	74 tps	0.9s	16K	$0.75	$1.75
48	201	Magistral Small 2506	908	±11	4.3K	3.1%	1.6%	156 tps	0.5s	40K	$0.37	$1.10
49	189	Inception Mercury Coder Small Beta	912	±20	610	3.2%	1.7%	270 tps	1.4s	32K	$0.25	$1.00
50	189	Seed 1.6 Flash 250715	913	±16	1.2K	5.7%	2.5%	108 tps	1.6s	256K	$0.07	$0.30
51	189	Rnj-1 Instruct	915	±21	970	6.7%	0.6%	103 tps	0.3s	33K	$0.15	$0.15
52	189	Devstral Small	916	±17	1.4K	5.0%	2.4%	180 tps	0.6s	131K	$0.10	$0.30
53	189	Jamba 1.7 Large	917	±16	975	8.0%	1.3%	58 tps	1.0s	256K	$1.33	$5.33
54	189	Llama 3.3 Swallow 70B Instruct	919	±8	3.5K	5.5%	1.4%	153 tps	1.3s	131K	$0.13	$0.39
55	189	Jamba 1.6 Large	924	±9	3.3K	3.8%	2.0%	59 tps	1.2s	256K	$1.33	$5.33
56	189	Grok 3 Mini	927	±6	9.9K	6.4%	1.2%	43 tps	0.5s	131K	$0.30	$0.50
57	189	Llama 3.3 70B	933	±10	3K	6.6%	0.3%	500 tps	0.5s	8K	$0.48	$0.66
58	179	NVIDIA Llama 3.3 Nemotron Super 49B v1.5	941	±19	1.4K	6.9%	2.0%	50 tps	0.6s	131K	$0.09	$0.33
59	179	ERNIE 4.5 VL 424B A47B	942	±18	725	6.5%	4.9%	36 tps	3.5s	123K	$0.42	$1.25
60	179	ERNIE 4.5 21B A3B	943	±28	540	6.9%	2.3%	78 tps	1.5s	120K	$0.05	$0.19
61	179	Grok 3 Mini Fast	943	±7	9K	7.0%	1.6%	44 tps	0.5s	131K	$0.60	$4.00
62	179	Ministral 14B 3.0	948	±16	805	8.5%	2.0%	119 tps	0.5s	128K	$0.20	$0.20
63	179	Qwen3 8B	948	±9	4.2K	8.2%	2.4%	61 tps	1.4s	41K	$0.02	$0.07
64	179	Switchpoint Router	949	±10	2.7K	3.6%	1.7%	71 tps	4.9s	131K	$0.85	$3.40
65	179	Qwen3 30B A3B Thinking 2507	953	±10	3.5K	4.7%	0.5%	124 tps	1.2s	131K	$0.16	$1.70
66	167	Qwen 2.5 72B	960	±15	1.4K	4.5%	1.2%	96 tps	1.2s	131K	$0.14	$0.26
67	167	Devstral Medium	962	±11	3.5K	5.2%	1.5%	77 tps	0.6s	131K	$0.40	$2.00
68	167	Llama 4 Scout	965	±5	17.5K	5.3%	0.6%	88 tps	5.1s	131K	$0.18	$0.46
69	167	Mistral Small 3.2 24B	970	±13	4.6K	4.9%	2.8%	141 tps	0.7s	33K	$0.02	$0.08
70	167	Nemotron 3 Nano	974	±46	580	6.5%	1.3%	216 tps	0.8s	256K	$0.05	$4.94
71	167	DeepSeek V3.1 Thinking	976	±9	5.2K	9.5%	7.1%	18 tps	1.8s	131K	$0.23	$0.75
72	159	Seed 2.0 Mini (Medium)	981	±35	570	5.8%	11.9%	33 tps	1.7s	256K	$0.15	$0.60
73	159	Kimi K2 0711	981	±6	7K	4.5%	1.6%	29 tps	1.3s	131K	$0.72	$2.60
74	159	GLM 4.6V	986	±8	3K	5.5%	6.4%	21 tps	1.8s	128K	$0.38	$0.90
75	159	Grok Code Fast 1	987	±9	2.5K	6.0%	5.9%	294 tps	0.5s	256K	$0.20	$1.50
76	159	OpenAI o3-mini-low	988	±6	12.2K	6.4%	0.7%	139 tps	1.5s	200K	$1.10	$4.40
77	159	GPT-5 Nano	989	±6	4.6K	8.0%	3.2%	113 tps	20.9s	400K	$0.05	$0.40
78	148	Seed 1.6 250615	995	±21	1.6K	6.0%	3.1%	46 tps	2.2s	256K	$0.25	$2.00
79	148	OpenAI o4-mini-high	995	±7	13.6K	6.2%	1.9%	117 tps	15.9s	200K	$1.10	$4.40
80	148	OpenAI o3-mini	999	±4	15K	5.5%	0.8%	143 tps	3.3s	200K	$1.10	$4.40

2of6

View All (210 models)