Leaderboard | Coding

Choose model family

Claude by Anthropic

Mistral by Mistral AI

More filters

Show inactive models

Hide models that are no longer actively available on Yupp.

Turns

Filter model performance by the number of turns in a conversation.

All Single turn Multiple turns

Open license models

Filter the leaderboard to only show models that have an open license.

All selected Open license Proprietary license

1239

Grok 4.1 Fast Non-Reasoning

1185

Grok 4 Fast Non-Reasoning

1178

Grok 4.1 Fast Reasoning

1177

Grok 4 Fast Reasoning

1167

Grok 4.20 Beta Reasoning

1129

Grok 4.20 Multi Agent Beta

1125

Grok 4

1102

Grok 3 Fast

1098

Grok 3

1063

Grok 4.20 Beta Non-reasoning

1043

Grok 4 0709 EU

987

Grok Code Fast 1

975

Grok 4 (Low Reasoning)

943

Grok 3 Mini Fast

927

Grok 3 Mini

Last updated about 1 month ago

Rank	Overall	Name	VIBE Score	Confidence Interval	Votes	Downvote %	Abort %	Speed	Latency	Context	Cost (Input)	Cost (Output)
1	31	Grok 4.1 Fast Non-Reasoning	1239	±6	9.4K	5.4%	0.9%	101 tps	0.5s	2M	$0.20	$0.50
2	49	Grok 4 Fast Non-Reasoning	1185	±5	8.1K	7.1%	1.5%	93 tps	0.6s	2M	$0.27	$0.67
3	60	Grok 4.1 Fast Reasoning	1178	±7	39.5K	4.4%	1.5%	58 tps	7.3s	2M	$0.20	$0.50
4	60	Grok 4 Fast Reasoning	1177	±3	14.5K	5.0%	2.1%	102 tps	3.1s	2M	$0.30	$0.75
5	60	Grok 4.20 Beta Reasoning	1167	±22	1.2K	4.1%	1.1%	77 tps	4.5s	2M	$2.00	$5.50
6	77	Grok 4.20 Multi Agent Beta	1129	±19	945	3.6%	1.2%	56 tps	8.8s	2M	$2.00	$6.00
7	77	Grok 4	1125	±3	39.6K	4.4%	3.9%	29 tps	11.1s	256K	$3.00	$15.00
8	90	Grok 3 Fast	1102	±14	2.5K	4.7%	1.7%	52 tps	2.4s	131K	$5.00	$25.00
9	98	Grok 3	1098	±4	19.1K	5.5%	1.5%	53 tps	0.6s	1M	$3.67	$18.33
10	112	Grok 4.20 Beta Non-reasoning	1063	±36	500	4.8%	1.1%	151 tps	0.6s	2M	$2.00	$6.00
11	164	Grok 4 0709 EU	1043	±11	1.3K	5.7%	<0.1%	33 tps	8.2s	128K	$3.00	$15.00
12	159	Grok Code Fast 1	987	±9	2.5K	6.0%	5.9%	294 tps	0.5s	256K	$0.20	$1.50
13	211	Grok 4 (Low Reasoning)	975	±21	520	2.8%	<0.1%	18 tps	9.5s	256K	$0	$0
14	179	Grok 3 Mini Fast	943	±7	9K	7.0%	1.6%	44 tps	0.5s	131K	$0.60	$4.00
15	189	Grok 3 Mini	927	±6	9.9K	6.4%	1.2%	43 tps	0.5s	131K	$0.30	$0.50
16	245	Grok 3 Mini Beta	922	±14	1.8K	1.9%	<0.1%	75 tps	0.5s	131K	$0.45	$2.25
17	264	Grok 2	901	±7	2.3K	2.7%	<0.1%	55 tps	1.1s	131K	$2.00	$10.00