Leaderboard | Coding

Choose model family

Claude by Anthropic

Mistral by Mistral AI

More filters

Show inactive models

Hide models that are no longer actively available on Yupp.

Turns

Filter model performance by the number of turns in a conversation.

All Single turn Multiple turns

Open license models

Filter the leaderboard to only show models that have an open license.

All selected Open license Proprietary license

1059

Llama 3 8B Turbo

1037

Llama 3 70B Turbo

971

Llama 4 Maverick

965

Llama 4 Scout

958

Llama 3.1 8B Turbo

942

NVIDIA Llama 3.3 Nemotron Super 49B v1

941

NVIDIA Llama 3.3 Nemotron Super 49B v1.5

935

Dobby Unhinged Llama 3.3 70B

933

Llama 3.3 70B

933

Llama 3.1 70B Instruct Turbo

928

NVIDIA Llama 3.1 Nemotron 70B

919

Llama 3.3 Swallow 70B Instruct

904

Llama 3 8B

896

Llama 3.1 405B Instruct Turbo

885

Llama 3.2 11B Instruct

Last updated about 1 month ago

Rank	Overall	Name	VIBE Score	Confidence Interval	Votes	Downvote %	Abort %	Speed	Latency	Context	Cost (Input)	Cost (Output)
1	151	Llama 3 8B Turbo	1059	±24	600	1.6%	<0.1%	97 tps	0.1s	8K	$0.12	$0.13
2	164	Llama 3 70B Turbo	1037	±6	4.3K	1.0%	<0.1%	31 tps	0.0s	8K	$0.73	$0.83
3	167	Llama 4 Maverick	971	±5	21K	5.0%	1.2%	88 tps	2.4s	1M	$0.23	$0.83
4	167	Llama 4 Scout	965	±5	17.5K	5.3%	0.6%	88 tps	5.1s	131K	$0.18	$0.46
5	167	Llama 3.1 8B Turbo	958	±14	2.2K	2.0%	2.1%	650 tps	0.5s	128K	$0.13	$0.14
6	230	NVIDIA Llama 3.3 Nemotron Super 49B v1	942	±9	3.6K	2.3%	<0.1%	13 tps	N/A	131K	$0.07	$0.20
7	179	NVIDIA Llama 3.3 Nemotron Super 49B v1.5	941	±19	1.4K	6.9%	2.0%	50 tps	0.6s	131K	$0.09	$0.33
8	230	Dobby Unhinged Llama 3.3 70B	935	±19	860	2.8%	<0.1%	41 tps	0.4s	128K	$0.90	$0.90
9	189	Llama 3.3 70B	933	±10	3K	6.6%	0.3%	500 tps	0.5s	8K	$0.48	$0.66
10	245	Llama 3.1 70B Instruct Turbo	933	±11	4.1K	3.8%	<0.1%	110 tps	0.8s	128K	$0.88	$0.88
11	245	NVIDIA Llama 3.1 Nemotron 70B	928	±7	5.3K	2.0%	<0.1%	9 tps	0.1s	128K	$0.33	$0.39
12	189	Llama 3.3 Swallow 70B Instruct	919	±8	3.5K	5.5%	1.4%	153 tps	1.3s	131K	$0.13	$0.39
13	201	Llama 3 8B	904	±10	3.2K	3.5%	6.0%	85 tps	0.7s	8K	$0.12	$0.16
14	264	Llama 3.1 405B Instruct Turbo	896	±11	2K	3.9%	<0.1%	26 tps	0.8s	131K	$3.50	$3.50
15	201	Llama 3.2 11B Instruct	885	±15	2.1K	4.1%	1.5%	152 tps	0.5s	8K	$0.16	$0.16
16	210	Hermes 2 Pro Llama 3 8B	864	±21	1.8K	2.5%	<0.1%	76 tps	1.0s	131K	$0.08	$0.09
17	234	Llama 3.3 70B Instruct Turbo	851	±19	1.2K	6.0%	2.0%	78 tps	1.0s	131K	$0.88	$0.88
18	240	DeepSeek-R1 Distill Llama 70B	835	±9	3.4K	5.2%	3.6%	27 tps	1.6s	32K	$0.73	$0.95
19	324	NVIDIA Llama 3.1 Nemotron Ultra 253B v1	832	±16	2.2K	4.1%	<0.1%	40 tps	0.8s	128K	$0.30	$0.90
20	386	Shisa V2 Llama 3.3 70B	623	±24	585	9.3%	<0.1%	8 tps	2.0s	33K	$0.03	$0.09
21	390	DeepSeek-R1 Distill Llama 8B	595	±19	1.2K	5.6%	<0.1%	17 tps	N/A	32K	$0.04	$0.04