Leaderboard | Coding

Models

Choose model family

Claude by Anthropic

Mistral by Mistral AI

More filters

Show inactive models

Hide models that are no longer actively available on Yupp.

Turns

Filter model performance by the number of turns in a conversation.

All Single turn Multiple turns

Open license models

Filter the leaderboard to only show models that have an open license.

All selected Open license Proprietary license

908

Magistral Small 2506

908

GPT-3.5 Turbo

904

Llama 3 8B

903

Mistral Small 3.2 24B Instruct

900

GPT-4o mini

899

Moonshot V1 Auto

894

Amazon Nova Pro 1.0

892

GLM 4.6V Flash

885

Llama 3.2 11B Instruct

883

Magistral Medium 2509

882

Gemma 3n E4B

880

Qwen3 4B

880

Mistral Small 3 24B Instruct

879

Moonshot V1 128k

878

Inception Mercury

Last updated about 1 month ago

Rank	Overall	Name	VIBE Score	Confidence Interval	Votes	Downvote %	Abort %	Speed	Latency	Context	Cost (Input)	Cost (Output)
201	201	Magistral Small 2506	908	±11	4.3K	3.1%	1.6%	156 tps	0.5s	40K	$0.37	$1.10
202	201	GPT-3.5 Turbo	908	±15	1.2K	2.5%	1.3%	74 tps	0.9s	16K	$0.75	$1.75
203	201	Llama 3 8B	904	±10	3.2K	3.5%	6.0%	85 tps	0.7s	8K	$0.12	$0.16
204	201	Mistral Small 3.2 24B Instruct	903	±20	850	8.6%	1.9%	113 tps	1.1s	131K	$0.02	$0.08
205	201	GPT-4o mini	900	±14	2.8K	5.3%	2.1%	71 tps	1.7s	128K	$0.15	$0.60
206	201	Moonshot V1 Auto	899	±22	930	4.1%	1.2%	54 tps	1.5s	8K	$2.00	$5.00
207	201	Amazon Nova Pro 1.0	894	±10	5.7K	4.0%	0.9%	96 tps	0.7s	300K	$0.80	$1.70
208	201	GLM 4.6V Flash	892	±10	2.5K	7.6%	3.7%	64 tps	2.1s	128K	$0.04	$0.40
209	201	Llama 3.2 11B Instruct	885	±15	2.1K	4.1%	1.5%	152 tps	0.5s	8K	$0.16	$0.16
210	210	Magistral Medium 2509	883	±16	2.6K	9.5%	4.0%	58 tps	0.9s	131K	$2.00	$5.00
211	210	Gemma 3n E4B	882	±7	6K	4.5%	2.0%	30 tps	0.5s	8K	$0.01	$0.02
212	210	Qwen3 4B	880	±8	5.1K	9.6%	1.9%	94 tps	1.5s	128K	$0.01	$0.01
213	210	Mistral Small 3 24B Instruct	880	±10	1.7K	3.6%	2.6%	77 tps	0.6s	33K	$0.07	$0.14
214	210	Moonshot V1 128k	879	±19	1.1K	4.6%	1.4%	54 tps	1.5s	131K	$2.00	$5.00
215	210	Inception Mercury	878	±5	6.9K	3.7%	0.4%	257 tps	1.1s	32K	$0.25	$1.00
216	210	DeepSeek R1T2 Chimera	876	±10	2.1K	5.9%	3.0%	28 tps	1.8s	164K	$0.13	$0.45
217	210	Mistral Medium 3	875	±23	485	6.7%	2.4%	47 tps	0.8s	33K	$0.40	$2.00
218	210	Mistral Nemo	875	±15	915	2.7%	<0.1%	112 tps	0.4s	131K	$0.07	$0.13
219	210	Solar Mini 250422	874	±17	1.3K	5.9%	1.8%	90 tps	1.7s	33K	$0.15	$0.15
220	210	GLM 4.7 Flash	871	±28	610	4.7%	5.8%	61 tps	2.8s	128K	$0.07	$0.39
221	210	Mixtral 8x22B	871	±22	1.3K	5.0%	1.2%	140 tps	0.6s	64K	$2.00	$6.00
222	210	Qwen 2.5 7B Turbo	870	±25	615	6.1%	0.5%	125 tps	0.4s	131K	$0.30	$0.30
223	210	Krutrim Spectre V2	868	±16	1.3K	3.6%	<0.1%	33 tps	3.1s	4K	$0.19	$0.19
224	210	GLM 4 32B	868	±12	2.9K	4.9%	2.6%	40 tps	1.6s	33K	$0.14	$0.14
225	210	Gemma 3 12B	867	±11	2.5K	4.9%	4.2%	73 tps	0.8s	131K	$0.05	$0.12
226	210	Hermes 2 Pro Llama 3 8B	864	±21	1.8K	2.5%	<0.1%	76 tps	1.0s	131K	$0.08	$0.09
227	210	Mistral Small 24B Instruct	864	±16	1.5K	4.1%	1.5%	84 tps	0.4s	33K	$0.80	$0.80
228	210	Moonshot V1 8k	863	±13	915	5.2%	1.0%	55 tps	1.5s	8K	$0.20	$2.00
229	210	Qwen 2.5 14B Instruct	861	±16	2.4K	5.7%	2.4%	40 tps	1.6s	1M	$0.40	$1.61
230	210	Gemma 3 27B	856	±27	1.1K	6.9%	1.8%	35 tps	1.1s	66K	$0.06	$0.10
231	210	Mixtral 8x7B	855	±18	1.3K	5.1%	2.2%	142 tps	0.6s	33K	$0.23	$0.23
232	210	Ministral 3B 2512	854	±57	515	8.0%	2.8%	339 tps	0.6s	131K	$0.10	$0.10
233	210	Mixtral 8x7B Instruct	854	±16	1.4K	4.4%	0.2%	79 tps	0.7s	33K	$0.23	$0.31
234	234	Gemma 3 27B IT	853	±10	2.3K	3.9%	2.0%	60 tps	0.8s	128K	$0.17	$0.29
235	234	Jamba 1.5 Large	851	±9	2.9K	4.0%	1.7%	48 tps	0.9s	256K	$1.50	$6.00
236	234	Llama 3.3 70B Instruct Turbo	851	±19	1.2K	6.0%	2.0%	78 tps	1.0s	131K	$0.88	$0.88
237	234	Command R 7B	849	±15	3.3K	4.8%	1.1%	76 tps	0.4s	128K	$0.04	$0.15
238	234	GPT-3.5 Turbo 16k	838	±10	2.7K	3.6%	<0.1%	22 tps	0.6s	16K	$3.00	$4.00
239	234	ERNIE 4.5 21B A3B Thinking	838	±23	1.1K	6.9%	1.8%	87 tps	1.5s	120K	$0.07	$0.28
240	240	DeepSeek-R1 Distill Llama 70B	835	±9	3.4K	5.2%	3.6%	27 tps	1.6s	32K	$0.73	$0.95

6of8

View All (286 models)