Leaderboard | Coding

Choose model family

Claude by Anthropic

Mistral by Mistral AI

More filters

Show inactive models

Hide models that are no longer actively available on Yupp.

Turns

Filter model performance by the number of turns in a conversation.

All Single turn Multiple turns

Open license models

Filter the leaderboard to only show models that have an open license.

All selected Open license Proprietary license

1418

Gemini 3.1 Pro

1337

Gemini 3 Pro

1291

Gemini 3 Pro (Low)

1286

Gemini 3 Flash Preview Thinking

1205

Gemini 3 Flash Preview

1204

Gemini 2.5 Pro High

1176

Gemini 2.5 Pro

1140

Gemini 2.5 Flash Preview 0925

1122

Gemini 2.5 Flash Lite Preview 0925

1118

Gemini 2.5 Flash Thinking

1103

Gemini 2.5 Flash Lite

1098

Gemini 2.5 Flash

1061

Gemini 2.5 Flash Lite Thinking

1039

Gemini 3.1 Flash Lite Preview Thinking

1035

Gemini 2.5 Flash Lite Thinking Preview 0925

Last updated about 1 month ago

Rank	Overall	Name	VIBE Score	Confidence Interval	Votes	Downvote %	Abort %	Speed	Latency	Context	Cost (Input)	Cost (Output)
1	7	Gemini 3.1 Pro	1418	±9	22K	2.5%	3.5%	35 tps	4.1s	1M	$2.00	$12.00
2	13	Gemini 3 Pro	1337	±5	59.4K	2.6%	2.1%	50 tps	3.6s	1M	$2.00	$12.00
3	19	Gemini 3 Pro (Low)	1291	±6	11.9K	4.2%	2.4%	51 tps	3.5s	1M	$2.00	$12.00
4	19	Gemini 3 Flash Preview Thinking	1286	±6	32.7K	3.3%	1.6%	3 tps	6.2s	1M	$0.50	$3.00
5	43	Gemini 3 Flash Preview	1205	±11	7.2K	3.7%	1.3%	138 tps	1.4s	1M	$0.50	$3.00
6	43	Gemini 2.5 Pro High	1204	±3	21.1K	5.7%	1.5%	48 tps	2.3s	1M	$1.25	$10.00
7	60	Gemini 2.5 Pro	1176	±3	37.9K	4.8%	2.3%	45 tps	2.6s	1M	$1.25	$10.00
8	74	Gemini 2.5 Flash Preview 0925	1140	±6	7.6K	6.0%	1.2%	5 tps	0.9s	1M	$0.13	$0.97
9	77	Gemini 2.5 Flash Lite Preview 0925	1122	±7	8.5K	6.6%	1.2%	209 tps	0.7s	1M	$0.25	$0.35
10	85	Gemini 2.5 Flash Thinking	1118	±4	13.7K	3.6%	2.2%	88 tps	6.4s	1M	$0.30	$2.50
11	90	Gemini 2.5 Flash Lite	1103	±5	21.3K	6.2%	1.3%	210 tps	0.7s	1M	$0.10	$0.40
12	98	Gemini 2.5 Flash	1098	±4	35.9K	3.2%	1.3%	2 tps	3.7s	1M	$0.30	$2.50
13	119	Gemini 2.5 Flash Lite Thinking	1061	±4	9.8K	6.2%	1.0%	118 tps	4.4s	1M	$0.03	$0.13
14	128	Gemini 3.1 Flash Lite Preview Thinking	1039	±16	1.4K	4.2%	1.7%	75 tps	4.7s	1M	$0.25	$1.50
15	135	Gemini 2.5 Flash Lite Thinking Preview 0925	1035	±7	5.8K	6.8%	1.5%	152 tps	3.0s	1M	$0.10	$0.40
16	135	Gemini 3.1 Flash Lite Preview	1034	±21	980	4.4%	1.0%	8 tps	1.2s	1M	$0.25	$1.50
17	135	Gemini 2.0 Flash Lite	1029	±5	14.7K	9.5%	<0.1%	42 tps	0.5s	1M	$0.08	$0.30
18	144	Gemini 2.0 Flash	1018	±7	8.2K	3.8%	<0.1%	76 tps	0.5s	1M	$0.14	$0.56