Leaderboard | Coding

Models

Choose model family

Claude by Anthropic

Mistral by Mistral AI

More filters

Show inactive models

Hide models that are no longer actively available on Yupp.

Turns

Filter model performance by the number of turns in a conversation.

All Single turn Multiple turns

Open license models

Filter the leaderboard to only show models that have an open license.

All selected Open license Proprietary license

842

MAI-DS-R1

846

Wikipedia

849

Command R 7B

851

Llama 3.3 70B Instruct Turbo

851

Jamba 1.5 Large

853

Gemma 3 27B IT

854

Mixtral 8x7B Instruct

854

Ministral 3B 2512

855

Mixtral 8x7B

856

Gemma 3 27B

856

Command Light

856

DeepSeek-R1 0528 Qwen3 8B

858

Yi Large

861

Qwen 2.5 14B Instruct

863

Hermes 2 Mixtral 8x7B DPO

Last updated about 1 month ago

Rank	Overall	Name	VIBE Score	Confidence Interval	Votes	Downvote %	Abort %	Speed	Latency	Context	Cost (Input)	Cost (Output)
81	324	MAI-DS-R1	842	±7	3.5K	11.7%	<0.1%	73 tps	3.2s	64K	$0.10	$0.40
82	312	Wikipedia	846	±7	9.8K	4.9%	<0.1%	47 tps	2.1s	32K	$0	$0
83	234	Command R 7B	849	±15	3.3K	4.8%	1.1%	76 tps	0.4s	128K	$0.04	$0.15
84	234	Llama 3.3 70B Instruct Turbo	851	±19	1.2K	6.0%	2.0%	78 tps	1.0s	131K	$0.88	$0.88
85	234	Jamba 1.5 Large	851	±9	2.9K	4.0%	1.7%	48 tps	0.9s	256K	$1.50	$6.00
86	234	Gemma 3 27B IT	853	±10	2.3K	3.9%	2.0%	60 tps	0.8s	128K	$0.17	$0.29
87	210	Mixtral 8x7B Instruct	854	±16	1.4K	4.4%	0.2%	79 tps	0.7s	33K	$0.23	$0.31
88	210	Ministral 3B 2512	854	±57	515	8.0%	2.8%	339 tps	0.6s	131K	$0.10	$0.10
89	210	Mixtral 8x7B	855	±18	1.3K	5.1%	2.2%	142 tps	0.6s	33K	$0.23	$0.23
90	210	Gemma 3 27B	856	±27	1.1K	6.9%	1.8%	35 tps	1.1s	66K	$0.06	$0.10
91	312	Command Light	856	±16	1.1K	4.9%	<0.1%	23 tps	N/A	4K	$0.10	$0.20
92	312	DeepSeek-R1 0528 Qwen3 8B	856	±8	4.9K	6.5%	<0.1%	45 tps	2.4s	128K	$0.05	$0.09
93	312	Yi Large	858	±12	1.5K	<0.1%	<0.1%	34 tps	N/A	33K	$1.50	$1.50
94	210	Qwen 2.5 14B Instruct	861	±16	2.4K	5.7%	2.4%	40 tps	1.6s	1M	$0.40	$1.61
95	293	Hermes 2 Mixtral 8x7B DPO	863	±17	1.2K	1.3%	<0.1%	1 tps	N/A	33K	$0.60	$0.60
96	210	Moonshot V1 8k	863	±13	915	5.2%	1.0%	55 tps	1.5s	8K	$0.20	$2.00
97	210	Mistral Small 24B Instruct	864	±16	1.5K	4.1%	1.5%	84 tps	0.4s	33K	$0.80	$0.80
98	210	Hermes 2 Pro Llama 3 8B	864	±21	1.8K	2.5%	<0.1%	76 tps	1.0s	131K	$0.08	$0.09
99	210	Gemma 3 12B	867	±11	2.5K	4.9%	4.2%	73 tps	0.8s	131K	$0.05	$0.12
100	210	GLM 4 32B	868	±12	2.9K	4.9%	2.6%	40 tps	1.6s	33K	$0.14	$0.14
101	210	Krutrim Spectre V2	868	±16	1.3K	3.6%	<0.1%	33 tps	3.1s	4K	$0.19	$0.19
102	293	Claude Sonnet 3	869	±17	900	1.6%	<0.1%	35 tps	1.0s	200K	$3.00	$15.00
103	293	AFM 4.5B	869	±7	4.4K	8.9%	<0.1%	81 tps	0.3s	66K	$0.05	$0.20
104	210	Qwen 2.5 7B Turbo	870	±25	615	6.1%	0.5%	125 tps	0.4s	131K	$0.30	$0.30
105	293	Devstral Small 2505	871	±15	1.7K	6.2%	<0.1%	141 tps	1.3s	33K	$0.03	$0.09
106	210	Mixtral 8x22B	871	±22	1.3K	5.0%	1.2%	140 tps	0.6s	64K	$2.00	$6.00
107	210	GLM 4.7 Flash	871	±28	610	4.7%	5.8%	61 tps	2.8s	128K	$0.07	$0.39
108	210	Solar Mini 250422	874	±17	1.3K	5.9%	1.8%	90 tps	1.7s	33K	$0.15	$0.15
109	210	Mistral Nemo	875	±15	915	2.7%	<0.1%	112 tps	0.4s	131K	$0.07	$0.13
110	210	Mistral Medium 3	875	±23	485	6.7%	2.4%	47 tps	0.8s	33K	$0.40	$2.00
111	210	DeepSeek R1T2 Chimera	876	±10	2.1K	5.9%	3.0%	28 tps	1.8s	164K	$0.13	$0.45
112	210	Inception Mercury	878	±5	6.9K	3.7%	0.4%	257 tps	1.1s	32K	$0.25	$1.00
113	210	Moonshot V1 128k	879	±19	1.1K	4.6%	1.4%	54 tps	1.5s	131K	$2.00	$5.00
114	210	Mistral Small 3 24B Instruct	880	±10	1.7K	3.6%	2.6%	77 tps	0.6s	33K	$0.07	$0.14
115	280	Magistral Small 2507	880	±19	730	13.1%	<0.1%	148 tps	0.4s	41K	$0.50	$1.50
116	210	Qwen3 4B	880	±8	5.1K	9.6%	1.9%	94 tps	1.5s	128K	$0.01	$0.01
117	280	Refuel LLM 2 Small	881	±7	4.2K	3.9%	<0.1%	116 tps	0.5s	8K	$0.20	$0.20
118	210	Gemma 3n E4B	882	±7	6K	4.5%	2.0%	30 tps	0.5s	8K	$0.01	$0.02
119	280	AFM 4.5B Preview	882	±16	2.5K	3.1%	<0.1%	32 tps	0.0s	66K	$0	$0
120	210	Magistral Medium 2509	883	±16	2.6K	9.5%	4.0%	58 tps	0.9s	131K	$2.00	$5.00

3of11

View All (404 models)