Leaderboard | Coding

Models

Choose model family

Claude by Anthropic

Mistral by Mistral AI

More filters

Show inactive models

Hide models that are no longer actively available on Yupp.

Turns

Filter model performance by the number of turns in a conversation.

All Single turn Multiple turns

Open license models

Filter the leaderboard to only show models that have an open license.

All selected Open license Proprietary license

891

Venice Uncensored

889

Arcee AI Blitz

887

Gemini 1.5 Pro

885

Llama 3.2 11B Instruct

883

Magistral Medium 2509

882

AFM 4.5B Preview

882

Gemma 3n E4B

881

Refuel LLM 2 Small

880

Qwen3 4B

880

Magistral Small 2507

880

Mistral Small 3 24B Instruct

879

Moonshot V1 128k

878

Inception Mercury

876

DeepSeek R1T2 Chimera

875

Mistral Medium 3

Last updated about 1 month ago

Rank	Overall	Name	VIBE Score	Confidence Interval	Votes	Downvote %	Abort %	Speed	Latency	Context	Cost (Input)	Cost (Output)
281	280	Venice Uncensored	891	±29	615	6.1%	<0.1%	59 tps	3.9s	33K	$0	$0
282	280	Arcee AI Blitz	889	±8	3K	2.1%	<0.1%	6 tps	N/A	33K	$0.45	$0.75
283	280	Gemini 1.5 Pro	887	±8	2.3K	2.3%	<0.1%	15 tps	0.0s	2M	$0.78	$3.13
284	201	Llama 3.2 11B Instruct	885	±15	2.1K	4.1%	1.5%	152 tps	0.5s	8K	$0.16	$0.16
285	210	Magistral Medium 2509	883	±16	2.6K	9.5%	4.0%	58 tps	0.9s	131K	$2.00	$5.00
286	280	AFM 4.5B Preview	882	±16	2.5K	3.1%	<0.1%	32 tps	0.0s	66K	$0	$0
287	210	Gemma 3n E4B	882	±7	6K	4.5%	2.0%	30 tps	0.5s	8K	$0.01	$0.02
288	280	Refuel LLM 2 Small	881	±7	4.2K	3.9%	<0.1%	116 tps	0.5s	8K	$0.20	$0.20
289	210	Qwen3 4B	880	±8	5.1K	9.6%	1.9%	94 tps	1.5s	128K	$0.01	$0.01
290	280	Magistral Small 2507	880	±19	730	13.1%	<0.1%	148 tps	0.4s	41K	$0.50	$1.50
291	210	Mistral Small 3 24B Instruct	880	±10	1.7K	3.6%	2.6%	77 tps	0.6s	33K	$0.07	$0.14
292	210	Moonshot V1 128k	879	±19	1.1K	4.6%	1.4%	54 tps	1.5s	131K	$2.00	$5.00
293	210	Inception Mercury	878	±5	6.9K	3.7%	0.4%	257 tps	1.1s	32K	$0.25	$1.00
294	210	DeepSeek R1T2 Chimera	876	±10	2.1K	5.9%	3.0%	28 tps	1.8s	164K	$0.13	$0.45
295	210	Mistral Medium 3	875	±23	485	6.7%	2.4%	47 tps	0.8s	33K	$0.40	$2.00
296	210	Mistral Nemo	875	±15	915	2.7%	<0.1%	112 tps	0.4s	131K	$0.07	$0.13
297	210	Solar Mini 250422	874	±17	1.3K	5.9%	1.8%	90 tps	1.7s	33K	$0.15	$0.15
298	210	GLM 4.7 Flash	871	±28	610	4.7%	5.8%	61 tps	2.8s	128K	$0.07	$0.39
299	210	Mixtral 8x22B	871	±22	1.3K	5.0%	1.2%	140 tps	0.6s	64K	$2.00	$6.00
300	293	Devstral Small 2505	871	±15	1.7K	6.2%	<0.1%	141 tps	1.3s	33K	$0.03	$0.09
301	210	Qwen 2.5 7B Turbo	870	±25	615	6.1%	0.5%	125 tps	0.4s	131K	$0.30	$0.30
302	293	AFM 4.5B	869	±7	4.4K	8.9%	<0.1%	81 tps	0.3s	66K	$0.05	$0.20
303	293	Claude Sonnet 3	869	±17	900	1.6%	<0.1%	35 tps	1.0s	200K	$3.00	$15.00
304	210	Krutrim Spectre V2	868	±16	1.3K	3.6%	<0.1%	33 tps	3.1s	4K	$0.19	$0.19
305	210	GLM 4 32B	868	±12	2.9K	4.9%	2.6%	40 tps	1.6s	33K	$0.14	$0.14
306	210	Gemma 3 12B	867	±11	2.5K	4.9%	4.2%	73 tps	0.8s	131K	$0.05	$0.12
307	210	Hermes 2 Pro Llama 3 8B	864	±21	1.8K	2.5%	<0.1%	76 tps	1.0s	131K	$0.08	$0.09
308	210	Mistral Small 24B Instruct	864	±16	1.5K	4.1%	1.5%	84 tps	0.4s	33K	$0.80	$0.80
309	210	Moonshot V1 8k	863	±13	915	5.2%	1.0%	55 tps	1.5s	8K	$0.20	$2.00
310	293	Hermes 2 Mixtral 8x7B DPO	863	±17	1.2K	1.3%	<0.1%	1 tps	N/A	33K	$0.60	$0.60
311	210	Qwen 2.5 14B Instruct	861	±16	2.4K	5.7%	2.4%	40 tps	1.6s	1M	$0.40	$1.61
312	312	Yi Large	858	±12	1.5K	<0.1%	<0.1%	34 tps	N/A	33K	$1.50	$1.50
313	312	DeepSeek-R1 0528 Qwen3 8B	856	±8	4.9K	6.5%	<0.1%	45 tps	2.4s	128K	$0.05	$0.09
314	312	Command Light	856	±16	1.1K	4.9%	<0.1%	23 tps	N/A	4K	$0.10	$0.20
315	210	Gemma 3 27B	856	±27	1.1K	6.9%	1.8%	35 tps	1.1s	66K	$0.06	$0.10
316	210	Mixtral 8x7B	855	±18	1.3K	5.1%	2.2%	142 tps	0.6s	33K	$0.23	$0.23
317	210	Ministral 3B 2512	854	±57	515	8.0%	2.8%	339 tps	0.6s	131K	$0.10	$0.10
318	210	Mixtral 8x7B Instruct	854	±16	1.4K	4.4%	0.2%	79 tps	0.7s	33K	$0.23	$0.31
319	234	Gemma 3 27B IT	853	±10	2.3K	3.9%	2.0%	60 tps	0.8s	128K	$0.17	$0.29
320	234	Jamba 1.5 Large	851	±9	2.9K	4.0%	1.7%	48 tps	0.9s	256K	$1.50	$6.00

8of11

View All (404 models)