Leaderboard | Coding

Choose model family

Claude by Anthropic

Mistral by Mistral AI

More filters

Show inactive models

Hide models that are no longer actively available on Yupp.

Turns

Filter model performance by the number of turns in a conversation.

All Single turn Multiple turns

Open license models

Filter the leaderboard to only show models that have an open license.

All selected Open license Proprietary license

1418

Gemini 3.1 Pro

1337

Gemini 3 Pro

1291

Gemini 3 Pro (Low)

1286

Gemini 3 Flash Preview Thinking

1205

Gemini 3 Flash Preview

1204

Gemini 2.5 Pro High

1176

Gemini 2.5 Pro

1173

Gemini 2.5 Flash Thinking Preview 0925

1170

Gemini 2.5 Pro Low

1161

Gemini 2.5 Flash Preview

1140

Gemini 2.5 Flash Preview 0925

1136

Gemini 2.5 Flash Preview Thinking

1122

Gemini 2.5 Flash Lite Preview 0925

1121

Gemini 2.5 Pro Preview 0605

1118

Gemini 2.5 Flash Thinking

Last updated about 1 month ago

Rank	Overall	Name	VIBE Score	Confidence Interval	Votes	Downvote %	Abort %	Speed	Latency	Context	Cost (Input)	Cost (Output)
1	7	Gemini 3.1 Pro	1418	±9	22K	2.5%	3.5%	35 tps	4.1s	1M	$2.00	$12.00
2	13	Gemini 3 Pro	1337	±5	59.4K	2.6%	2.1%	50 tps	3.6s	1M	$2.00	$12.00
3	19	Gemini 3 Pro (Low)	1291	±6	11.9K	4.2%	2.4%	51 tps	3.5s	1M	$2.00	$12.00
4	19	Gemini 3 Flash Preview Thinking	1286	±6	32.7K	3.3%	1.6%	3 tps	6.2s	1M	$0.50	$3.00
5	43	Gemini 3 Flash Preview	1205	±11	7.2K	3.7%	1.3%	138 tps	1.4s	1M	$0.50	$3.00
6	43	Gemini 2.5 Pro High	1204	±3	21.1K	5.7%	1.5%	48 tps	2.3s	1M	$1.25	$10.00
7	60	Gemini 2.5 Pro	1176	±3	37.9K	4.8%	2.3%	45 tps	2.6s	1M	$1.25	$10.00
8	75	Gemini 2.5 Flash Thinking Preview 0925	1173	±7	9.2K	6.8%	<0.1%	111 tps	4.7s	1M	$0.30	$2.50
9	75	Gemini 2.5 Pro Low	1170	±4	9.6K	8.1%	<0.1%	89 tps	2.4s	1M	$1.25	$10.00
10	86	Gemini 2.5 Flash Preview	1161	±8	3K	1.1%	<0.1%	138 tps	6.9s	1M	$0.15	$0.60
11	74	Gemini 2.5 Flash Preview 0925	1140	±6	7.6K	6.0%	1.2%	5 tps	0.9s	1M	$0.13	$0.97
12	93	Gemini 2.5 Flash Preview Thinking	1136	±10	1.4K	1.8%	<0.1%	26 tps	1.8s	1M	$0.15	$1.76
13	77	Gemini 2.5 Flash Lite Preview 0925	1122	±7	8.5K	6.6%	1.2%	209 tps	0.7s	1M	$0.25	$0.35
14	97	Gemini 2.5 Pro Preview 0605	1121	±10	1.7K	2.3%	<0.1%	0 tps	3.7s	1M	$1.25	$10.00
15	85	Gemini 2.5 Flash Thinking	1118	±4	13.7K	3.6%	2.2%	88 tps	6.4s	1M	$0.30	$2.50
16	108	Gemini 2.5 Pro Preview 0325	1111	±11	1.5K	3.2%	<0.1%	3 tps	16.6s	1M	$1.25	$10.00
17	90	Gemini 2.5 Flash Lite	1103	±5	21.3K	6.2%	1.3%	210 tps	0.7s	1M	$0.10	$0.40
18	98	Gemini 2.5 Flash	1098	±4	35.9K	3.2%	1.3%	2 tps	3.7s	1M	$0.30	$2.50
19	119	Gemini 2.5 Flash Lite Thinking	1061	±4	9.8K	6.2%	1.0%	118 tps	4.4s	1M	$0.03	$0.13
20	128	Gemini 3.1 Flash Lite Preview Thinking	1039	±16	1.4K	4.2%	1.7%	75 tps	4.7s	1M	$0.25	$1.50
21	135	Gemini 2.5 Flash Lite Thinking Preview 0925	1035	±7	5.8K	6.8%	1.5%	152 tps	3.0s	1M	$0.10	$0.40
22	135	Gemini 3.1 Flash Lite Preview	1034	±21	980	4.4%	1.0%	8 tps	1.2s	1M	$0.25	$1.50
23	135	Gemini 2.0 Flash Lite	1029	±5	14.7K	9.5%	<0.1%	42 tps	0.5s	1M	$0.08	$0.30
24	144	Gemini 2.0 Flash	1018	±7	8.2K	3.8%	<0.1%	76 tps	0.5s	1M	$0.14	$0.56
25	280	Gemini 1.5 Pro	887	±8	2.3K	2.3%	<0.1%	15 tps	0.0s	2M	$0.78	$3.13