Leaderboard | Coding

Models

Choose model family

Claude by Anthropic

Mistral by Mistral AI

More filters

Show inactive models

Hide models that are no longer actively available on Yupp.

Turns

Filter model performance by the number of turns in a conversation.

All Single turn Multiple turns

Open license models

Filter the leaderboard to only show models that have an open license.

All selected Open license Proprietary license

913

Seed 1.6 Flash 250715

912

Inception Mercury Coder Small Beta

908

Magistral Small 2506

908

GPT-3.5 Turbo

904

Llama 3 8B

903

Mistral Small 3.2 24B Instruct

900

GPT-4o mini

899

Moonshot V1 Auto

894

Amazon Nova Pro 1.0

883

Magistral Medium 2509

882

Gemma 3n E4B

880

Qwen3 4B

879

Moonshot V1 128k

878

Inception Mercury

876

DeepSeek R1T2 Chimera

Last updated about 1 month ago

Rank	Overall	Name	VIBE Score	Confidence Interval	Votes	Downvote %	Abort %	Speed	Latency	Context	Cost (Input)	Cost (Output)
161	189	Seed 1.6 Flash 250715	913	±16	1.2K	5.7%	2.5%	108 tps	1.6s	256K	$0.07	$0.30
162	189	Inception Mercury Coder Small Beta	912	±20	610	3.2%	1.7%	270 tps	1.4s	32K	$0.25	$1.00
163	201	Magistral Small 2506	908	±11	4.3K	3.1%	1.6%	156 tps	0.5s	40K	$0.37	$1.10
164	201	GPT-3.5 Turbo	908	±15	1.2K	2.5%	1.3%	74 tps	0.9s	16K	$0.75	$1.75
165	201	Llama 3 8B	904	±10	3.2K	3.5%	6.0%	85 tps	0.7s	8K	$0.12	$0.16
166	201	Mistral Small 3.2 24B Instruct	903	±20	850	8.6%	1.9%	113 tps	1.1s	131K	$0.02	$0.08
167	201	GPT-4o mini	900	±14	2.8K	5.3%	2.1%	71 tps	1.7s	128K	$0.15	$0.60
168	201	Moonshot V1 Auto	899	±22	930	4.1%	1.2%	54 tps	1.5s	8K	$2.00	$5.00
169	201	Amazon Nova Pro 1.0	894	±10	5.7K	4.0%	0.9%	96 tps	0.7s	300K	$0.80	$1.70
170	210	Magistral Medium 2509	883	±16	2.6K	9.5%	4.0%	58 tps	0.9s	131K	$2.00	$5.00
171	210	Gemma 3n E4B	882	±7	6K	4.5%	2.0%	30 tps	0.5s	8K	$0.01	$0.02
172	210	Qwen3 4B	880	±8	5.1K	9.6%	1.9%	94 tps	1.5s	128K	$0.01	$0.01
173	210	Moonshot V1 128k	879	±19	1.1K	4.6%	1.4%	54 tps	1.5s	131K	$2.00	$5.00
174	210	Inception Mercury	878	±5	6.9K	3.7%	0.4%	257 tps	1.1s	32K	$0.25	$1.00
175	210	DeepSeek R1T2 Chimera	876	±10	2.1K	5.9%	3.0%	28 tps	1.8s	164K	$0.13	$0.45
176	210	Mistral Medium 3	875	±23	485	6.7%	2.4%	47 tps	0.8s	33K	$0.40	$2.00
177	210	Solar Mini 250422	874	±17	1.3K	5.9%	1.8%	90 tps	1.7s	33K	$0.15	$0.15
178	210	GLM 4.7 Flash	871	±28	610	4.7%	5.8%	61 tps	2.8s	128K	$0.07	$0.39
179	210	Mixtral 8x22B	871	±22	1.3K	5.0%	1.2%	140 tps	0.6s	64K	$2.00	$6.00
180	210	Krutrim Spectre V2	868	±16	1.3K	3.6%	<0.1%	33 tps	3.1s	4K	$0.19	$0.19
181	210	GLM 4 32B	868	±12	2.9K	4.9%	2.6%	40 tps	1.6s	33K	$0.14	$0.14
182	210	Gemma 3 12B	867	±11	2.5K	4.9%	4.2%	73 tps	0.8s	131K	$0.05	$0.12
183	210	Moonshot V1 8k	863	±13	915	5.2%	1.0%	55 tps	1.5s	8K	$0.20	$2.00
184	210	Qwen 2.5 14B Instruct	861	±16	2.4K	5.7%	2.4%	40 tps	1.6s	1M	$0.40	$1.61
185	210	Ministral 3B 2512	854	±57	515	8.0%	2.8%	339 tps	0.6s	131K	$0.10	$0.10
186	234	Jamba 1.5 Large	851	±9	2.9K	4.0%	1.7%	48 tps	0.9s	256K	$1.50	$6.00
187	234	GPT-3.5 Turbo 16k	838	±10	2.7K	3.6%	<0.1%	22 tps	0.6s	16K	$3.00	$4.00
188	234	ERNIE 4.5 21B A3B Thinking	838	±23	1.1K	6.9%	1.8%	87 tps	1.5s	120K	$0.07	$0.28
189	240	GLM 4.5 Flash	834	±37	520	8.8%	12.2%	15 tps	2.2s	131K	$0	$0
190	240	LFM2 2.6B	826	±26	810	10.0%	6.7%	184 tps	0.4s	33K	$0.01	$0.02
191	240	Krutrim 2	825	±10	2.3K	2.3%	12.5%	33 tps	2.1s	128K	$1.00	$1.00
192	240	Moonshot V1 32k	820	±17	950	3.1%	1.4%	53 tps	1.4s	33K	$1.00	$3.00
193	240	LFM2 8B A1B	818	±18	825	11.3%	<0.1%	142 tps	0.3s	33K	$0.01	$0.02
194	252	Magistral Small 2509	802	±18	1.8K	7.5%	2.7%	116 tps	0.6s	131K	$0.50	$1.50
195	252	WizardLM-2 8x22B	801	±12	1.9K	3.1%	11.6%	11 tps	2.5s	66K	$0.77	$0.77
196	252	Hermes 4 405B FP8	797	±21	815	8.4%	3.5%	31 tps	0.9s	131K	$0.52	$1.73
197	252	Mercury Coder	793	±27	510	3.8%	<0.1%	247 tps	2.2s	32K	$0.25	$1.00
198	252	GPT-3.5 Turbo Instruct	787	±9	2K	2.7%	<0.1%	46 tps	1.2s	4K	$1.50	$2.00
199	252	Mistral Large	785	±16	1.1K	5.8%	1.5%	54 tps	0.7s	33K	$2.00	$6.00
200	252	Hermes 4 70B	781	±29	460	8.9%	1.1%	67 tps	0.6s	131K	$0.12	$0.39

5of6

View All (210 models)