Leaderboard | Coding

Models

Choose model family

Claude by Anthropic

Mistral by Mistral AI

More filters

Show inactive models

Hide models that are no longer actively available on Yupp.

Turns

Filter model performance by the number of turns in a conversation.

All Single turn Multiple turns

Open license models

Filter the leaderboard to only show models that have an open license.

All selected Open license Proprietary license

936

Jamba 1.7 Mini

935

Dobby Unhinged Llama 3.3 70B

935

R1 1776

933

Llama 3.3 70B

933

Llama 3.1 70B Instruct Turbo

927

Grok 3 Mini

924

Jamba 1.6 Large

922

Grok 3 Mini Beta

921

GLM Z1 32B

920

GPT-5 Nano Minimal

919

Solar Pro 2 250710 (Reasoning)

919

Llama 3.3 Swallow 70B Instruct

917

Jamba 1.7 Large

916

Devstral Small

915

Rnj-1 Instruct

Last updated about 1 month ago

Rank	Overall	Name	VIBE Score	Confidence Interval	Votes	Downvote %	Abort %	Speed	Latency	Context	Cost (Input)	Cost (Output)
201	230	Jamba 1.7 Mini	936	±24	1K	8.4%	<0.1%	84 tps	0.9s	256K	$0.20	$0.40
202	230	Dobby Unhinged Llama 3.3 70B	935	±19	860	2.8%	<0.1%	41 tps	0.4s	128K	$0.90	$0.90
203	230	R1 1776	935	±9	3.3K	4.2%	<0.1%	61 tps	1.0s	128K	$2.00	$8.00
204	189	Llama 3.3 70B	933	±10	3K	6.6%	0.3%	500 tps	0.5s	8K	$0.48	$0.66
205	245	Llama 3.1 70B Instruct Turbo	933	±11	4.1K	3.8%	<0.1%	110 tps	0.8s	128K	$0.88	$0.88
206	189	Grok 3 Mini	927	±6	9.9K	6.4%	1.2%	43 tps	0.5s	131K	$0.30	$0.50
207	189	Jamba 1.6 Large	924	±9	3.3K	3.8%	2.0%	59 tps	1.2s	256K	$1.33	$5.33
208	245	Grok 3 Mini Beta	922	±14	1.8K	1.9%	<0.1%	75 tps	0.5s	131K	$0.45	$2.25
209	245	GLM Z1 32B	921	±10	1.9K	10.1%	<0.1%	18 tps	9.3s	33K	$0.09	$0.11
210	245	GPT-5 Nano Minimal	920	±13	1.4K	10.8%	<0.1%	88 tps	0.8s	400K	$0.05	$0.40
211	245	Solar Pro 2 250710 (Reasoning)	919	±10	2.6K	3.9%	<0.1%	9 tps	N/A	66K	$0.50	$0.50
212	189	Llama 3.3 Swallow 70B Instruct	919	±8	3.5K	5.5%	1.4%	153 tps	1.3s	131K	$0.13	$0.39
213	189	Jamba 1.7 Large	917	±16	975	8.0%	1.3%	58 tps	1.0s	256K	$1.33	$5.33
214	189	Devstral Small	916	±17	1.4K	5.0%	2.4%	180 tps	0.6s	131K	$0.10	$0.30
215	189	Rnj-1 Instruct	915	±21	970	6.7%	0.6%	103 tps	0.3s	33K	$0.15	$0.15
216	189	Seed 1.6 Flash 250715	913	±16	1.2K	5.7%	2.5%	108 tps	1.6s	256K	$0.07	$0.30
217	245	Solar Pro 3 (Reasoning)	913	±18	595	4.8%	3.2%	118 tps	1.2s	131K	$0.15	$0.60
218	189	Inception Mercury Coder Small Beta	912	±20	610	3.2%	1.7%	270 tps	1.4s	32K	$0.25	$1.00
219	264	YouTube	910	±13	2K	5.5%	<0.1%	34 tps	2.7s	32K	$0.99	$0.99
220	201	Magistral Small 2506	908	±11	4.3K	3.1%	1.6%	156 tps	0.5s	40K	$0.37	$1.10
221	201	GPT-3.5 Turbo	908	±15	1.2K	2.5%	1.3%	74 tps	0.9s	16K	$0.75	$1.75
222	264	Fauna Fox	908	±10	3.4K	8.2%	<0.1%	194 tps	0.3s	128K	$0.04	$0.15
223	201	Llama 3 8B	904	±10	3.2K	3.5%	6.0%	85 tps	0.7s	8K	$0.12	$0.16
224	201	Mistral Small 3.2 24B Instruct	903	±20	850	8.6%	1.9%	113 tps	1.1s	131K	$0.02	$0.08
225	264	DeepSeek R1T Chimera	901	±9	2.9K	6.7%	<0.1%	46 tps	1.1s	164K	$0.09	$0.36
226	264	Grok 2	901	±7	2.3K	2.7%	<0.1%	55 tps	1.1s	131K	$2.00	$10.00
227	201	GPT-4o mini	900	±14	2.8K	5.3%	2.1%	71 tps	1.7s	128K	$0.15	$0.60
228	201	Moonshot V1 Auto	899	±22	930	4.1%	1.2%	54 tps	1.5s	8K	$2.00	$5.00
229	201	Amazon Nova Pro 1.0	894	±10	5.7K	4.0%	0.9%	96 tps	0.7s	300K	$0.80	$1.70
230	264	Exaone 3.5 32B Instruct	893	±21	650	3.0%	<0.1%	17 tps	N/A	33K	$0	$0
231	280	Venice Uncensored	891	±29	615	6.1%	<0.1%	59 tps	3.9s	33K	$0	$0
232	280	Gemini 1.5 Pro	887	±8	2.3K	2.3%	<0.1%	15 tps	0.0s	2M	$0.78	$3.13
233	210	Magistral Medium 2509	883	±16	2.6K	9.5%	4.0%	58 tps	0.9s	131K	$2.00	$5.00
234	280	AFM 4.5B Preview	882	±16	2.5K	3.1%	<0.1%	32 tps	0.0s	66K	$0	$0
235	210	Gemma 3n E4B	882	±7	6K	4.5%	2.0%	30 tps	0.5s	8K	$0.01	$0.02
236	280	Refuel LLM 2 Small	881	±7	4.2K	3.9%	<0.1%	116 tps	0.5s	8K	$0.20	$0.20
237	210	Qwen3 4B	880	±8	5.1K	9.6%	1.9%	94 tps	1.5s	128K	$0.01	$0.01
238	280	Magistral Small 2507	880	±19	730	13.1%	<0.1%	148 tps	0.4s	41K	$0.50	$1.50
239	210	Moonshot V1 128k	879	±19	1.1K	4.6%	1.4%	54 tps	1.5s	131K	$2.00	$5.00
240	210	Inception Mercury	878	±5	6.9K	3.7%	0.4%	257 tps	1.1s	32K	$0.25	$1.00

6of8

View All (305 models)