Models
Topics
Language
More

More filters

Show inactive models

Hide models that are no longer actively available on Yupp.

Turns

Filter model performance by the number of turns in a conversation.

Open license models

Filter the leaderboard to only show models that have an open license.

1398
Claude Opus 4.6 (Thinking)
1381
Claude Opus 4.6
1343
GPT-5.4
1314
Claude Sonnet 4.6
1305
Claude Sonnet 4.6 (Thinking)
1264
GPT-5.1
1260
Claude Opus 4.5 (Thinking)
1250
GPT-5.1 (High)
1245
Gemini 3.1 Pro
1232
GPT-5.2 Instant
1228
Claude Sonnet 4.5 (Thinking)
1207
Gemini 3 Pro
1203
GPT-5.4 mini
1199
GPT-5.3 Instant
1196
GPT-5 Chat

Last updated about 1 month ago

RankOverallNameVIBE
Score
Confidence
Interval
VotesDownvote %Abort %SpeedLatencyContextCost
(Input)
Cost
(Output)
11Claude Opus 4.6 (Thinking)1398±416.9K1.4%2.5%56 tps1.6s200K$5.00$25.00
22Claude Opus 4.61381±321.8K1.1%2.1%48 tps1.7s200K$5.00$25.00
32GPT-5.41343±55.8K1.3%2.6%55 tps0.8s1M$2.50$15.00
44Claude Sonnet 4.61314±416.6K1.2%1.6%47 tps1.2s200K$3.00$15.00
55Claude Sonnet 4.6 (Thinking)1305±317.7K2.7%4.7%57 tps1.1s200K$3.00$15.00
68GPT-5.11264±227.6K2.3%2.3%71 tps1.4s400K$1.42$11.33
77Claude Opus 4.5 (Thinking)1260±261K1.8%1.8%49 tps1.4s200K$5.00$25.00
88GPT-5.1 (High)1250±337.8K2.4%3.2%76 tps6.9s400K$1.25$10.00
96Gemini 3.1 Pro1245±326K2.0%3.5%35 tps4.1s1M$2.00$12.00
1010GPT-5.2 Instant1232±239.3K1.6%1.7%52 tps2.0s400K$1.75$14.00
1110Claude Sonnet 4.5 (Thinking)1228±166.2K3.4%1.9%44 tps1.1s200K$3.00$15.00
1210Gemini 3 Pro1207±178K2.2%2.1%50 tps3.6s1M$2.00$12.00
1317GPT-5.4 mini1203±108852.7%0.8%148 tps0.5s400K$0.75$4.50
1413GPT-5.3 Instant1199±69.3K1.7%0.9%63 tps0.8s400K$1.75$14.00
1522GPT-5 Chat1196±175.1K3.4%1.3%95 tps0.9s400K$1.25$10.00
1622Grok 4.20 Beta Non-reasoning1192±111.3K3.1%1.1%151 tps0.6s2M$2.00$6.00
1714Gemini 3 Flash Preview Thinking1190±247K2.3%1.6%3 tps6.2s1M$0.50$3.00
1829Qwen3 VL 235B A22B Instruct1188±313.5K5.2%3.1%75 tps1.9s129K$0.37$1.81
1929Nova Experimental Chat 12-101188±39.8K1.9%2.4%84 tps12.9s98K$0$0
2037Qwen3 Omni 30B A3B Thinking1186±37.5K2.1%3.7%67 tps1.2s66K$0.97$1.79
2133Grok 4.20 Multi Agent Beta1183±92.6K2.0%1.2%56 tps8.8s2M$2.00$6.00
2222GLM 51182±417.3K2.1%3.4%36 tps2.7s200K$0.72$2.55
2314Gemini 3 Pro (Low)1180±328.9K2.2%2.4%51 tps3.5s1M$2.00$12.00
2417GPT-5.2 (High)1180±254.6K1.9%6.7%18 tps16.3s400K$1.75$14.00
2526Grok 4.1 Fast Non-Reasoning1177±225.7K3.0%0.9%101 tps0.5s2M$0.20$0.50
26106GPT-5.4 nano1177±106502.3%0.7%149 tps0.5s400K$0.20$1.25
2726GPT-5 (High)1177±222.1K3.1%4.5%81 tps35.9s400K$1.25$10.00
2816GPT-5.21176±222.6K1.8%4.1%18 tps2.7s400K$1.75$14.00
2917Grok 4.20 Beta Reasoning1175±73.3K1.8%1.1%77 tps4.5s2M$2.00$5.50
3017Claude Opus 4.51173±222.5K2.2%1.5%45 tps1.5s200K$5.00$25.00
3126Claude Haiku 4.5 (Extended Thinking)1173±224.3K3.1%1.4%115 tps0.7s200K$1.00$5.00
3262Qwen3 Omni 30B A3B Instruct1168±53K2.3%3.9%65 tps1.2s66K$0.35$0.97
3329MiniMax M2.71167±81.1K1.8%3.0%34 tps2.5s205K$0.30$1.20
3456MiniMax M2.1 Lightning1165±54.9K1.2%1.7%52 tps2.1s205K$0.30$2.40
3532Gemini 2.5 Pro High1159±242.7K4.5%1.5%48 tps2.3s1M$1.25$10.00
3617Gemini 3 Flash Preview1159±317.8K2.1%1.3%138 tps1.4s1M$0.50$3.00
3733Qwen3 30B A3B Instruct 25071158±231.6K4.1%1.2%55 tps1.3s131K$0.13$0.72
3844DeepSeek V3.1 Terminus Chat1150±317.8K4.2%3.4%27 tps1.5s131K$0.86$1.80
3942Qwen3 Max Instruct Preview1148±236.6K3.5%1.1%31 tps1.7s256K$1.43$6.61
4040Qwen3 235B A22B Instruct 25071147±232.2K4.7%6.8%13 tps1.9s262K$0.13$0.52
4140DeepSeek V3.21144±320.7K1.9%1.4%83 tps5.1s131K$0.43$1.09
4271MiniMax M2.5 FP81141±42.9K1.7%3.6%33 tps1.7s205K$0.45$1.75
4356DeepSeek V3.1 Turbo1140±214.5K2.3%0.9%173 tps1.3s164K$2.00$3.75
4437Claude Sonnet 4.51139±237.7K4.3%1.4%41 tps1.3s200K$1.80$9.00
4548Claude Sonnet 4 (Thinking)1138±230.7K2.6%1.5%52 tps1.5s200K$3.00$13.67
4644Gemini 2.5 Pro1136±168.8K3.9%2.3%45 tps2.6s1M$1.25$10.00
4742GPT-5.2 (Extra High) 1133±320.9K1.9%13.2%17 tps20.5s400K$1.75$14.00
4860MiniMax M2.11129±241.8K2.0%2.1%66 tps2.6s205K$0.30$1.20
4948Grok 4 Fast Reasoning1128±225.9K3.9%2.1%102 tps3.1s2M$0.30$0.75
5052Claude Haiku 4.51128±231.4K3.7%1.1%100 tps0.9s200K$1.00$5.00
5144Grok 4.1 Fast Reasoning1128±257K3.1%1.5%58 tps7.3s2M$0.20$0.50
5252Grok 4 Fast Non-Reasoning1128±321.3K4.7%1.5%93 tps0.6s2M$0.27$0.67
5362MiniMax M21125±233.6K3.5%2.2%39 tps2.3s205K$0.21$0.85
5471DeepSeek V3.11124±36.8K2.0%0.8%197 tps0.4s164K$0.55$1.60
5552GPT-51119±244.3K3.9%3.1%78 tps23.1s400K$1.25$9.67
5695Qwen3 32B1117±63.3K2.8%3.9%30 tps3.1s41K$0.12$0.42
5786DeepSeek V3.1 Nex N11112±62.1K1.7%3.4%24 tps7.2s131K$0.14$0.50
5865GLM 4.61108±325.8K4.3%5.4%39 tps1.5s200K$0.42$1.66
5984MiniMax M2.51105±82.1K1.6%1.4%70 tps1.9s205K$0.28$1.20
6071Seed 1.8 2512281104±319K1.5%3.7%41 tps2.1s256K$0.25$2.00
6186DeepSeek V3.1 Chat1102±313.4K4.1%2.8%21 tps1.6s131K$0.38$1.00
6260Gemini 2.5 Flash Preview 09251102±219.5K4.3%1.2%5 tps0.9s1M$0.13$0.97
6368GLM 4.71101±335.7K2.1%5.8%40 tps1.5s200K$0.77$1.73
6468Grok 41100±1120.3K2.1%3.9%29 tps11.1s256K$3.00$15.00
65101DeepSeek V3 (Turbo)1100±34.8K2.5%1.5%32 tps1.5s64K$0.40$1.30
6686Amazon Nova 2 Lite1099±312.6K3.1%1.0%137 tps0.6s300K$0.35$2.95
6768Qwen Plus (Aug'24)1098±260.9K2.4%1.4%53 tps1.3s30K$0.40$1.20
6862GPT-5.1 Instant1098±221.7K2.4%1.3%50 tps1.9s400K$1.25$10.00
6971Qwen3.5 397B A17B1092±57.2K1.8%4.3%57 tps1.4s256K$0.52$3.00
7079Qwen3 Max Thinking Preview1089±217.8K3.3%3.1%40 tps2.1s256K$1.20$6.00
7181GPT-4o1088±230.3K2.1%1.0%49 tps2.4s128K$3.71$12.57
72133Nemotron 3 Nano1087±51.9K2.5%1.3%216 tps0.8s256K$0.05$4.94
7356Gemini 3.1 Flash Lite Preview Thinking1084±63.6K3.1%1.7%75 tps4.7s1M$0.25$1.50
7471Gemini 2.5 Flash Lite Preview 09251083±220.9K4.8%1.2%209 tps0.7s1M$0.25$0.35
7586Seed 2.0 Lite (Medium)1082±62.1K1.9%6.6%33 tps1.6s256K$0.25$2.00
76111LongCat Flash Chat1082±46.5K3.2%0.8%85 tps0.9s131K$0.14$0.68
7771GPT-5 Mini1082±217.5K4.3%2.6%66 tps14.2s400K$0.25$2.00
7884GPT-5 Mini Minimal1081±36.8K6.5%1.2%63 tps1.4s400K$0.25$2.00
79153Ministral 14B 3.01079±53K3.4%2.0%119 tps0.5s128K$0.20$0.20
8093Qwen Max1078±165.6K2.1%1.5%49 tps1.5s33K$1.60$6.40
8171Gemini 2.5 Flash Thinking1076±222.8K2.3%2.2%88 tps6.4s1M$0.30$2.50
8293DeepSeek V3 0324 Turbo1076±256.4K2.9%6.3%12 tps2.4s164K$0.73$1.79
83153Apriel 1.5 15B Thinker1076±52.1K1.6%2.4%146 tps0.4s131K$0$0
8495Kimi K2 Thinking1074±38.3K2.9%4.2%61 tps5.9s262K$0.24$1.03
85106DeepSeek V3 03241065±146.7K2.5%5.8%12 tps2.7s164K$0.38$0.93
8686Claude Sonnet 41065±2113.6K2.4%1.8%49 tps1.3s200K$3.00$15.00
87101Qwen3.5 35B A3B1064±82.1K2.3%2.1%116 tps2.1s256K$0.63$1.13
88121NVIDIA Llama 3.3 Nemotron Super 49B v1.51064±54.5K3.7%2.0%50 tps0.6s131K$0.09$0.33
89106Grok 31063±265.8K2.6%1.5%53 tps0.6s1M$3.67$18.33
90111Grok 3 Fast1060±312.4K1.1%1.7%52 tps2.4s131K$5.00$25.00
91101Gemini 2.5 Flash Lite1060±250.1K4.8%1.3%210 tps0.7s1M$0.10$0.40
92143Solar Pro 2 2512151059±99852.5%1.8%107 tps1.5s66K$0.15$0.60
93119ERNIE 4.5 300B A47B1058±251.6K1.9%4.7%23 tps2.3s123K$0.28$1.10
9495Gemini 2.5 Flash1058±1118.2K1.8%1.3%2 tps3.7s1M$0.30$2.50
95113GLM 4.5 AirX1057±44.1K3.0%3.3%75 tps1.2s131K$1.10$4.50
96118GPT-4.1 mini1055±267.2K2.2%1.1%67 tps0.9s1M$0.34$1.60
97106Claude Sonnet 3.5 v21055±221.4K1.9%<0.1%46 tps1.4s200K$3.00$15.00
98119GLM 4.7 FP81053±62.7K1.1%6.9%40 tps1.3s200K$0.30$1.20
99101GPT-5 (Low)1051±52.1K1.4%1.8%75 tps8.2s400K$1.25$10.00
10095Gemini 2.5 Flash Lite Thinking Preview 09251051±414.2K4.3%1.5%152 tps3.0s1M$0.10$0.40
10181OpenAI o3-pro1049±46.7K3.4%5.2%22 tps70.8s200K$20.00$80.00
102113Mistral Medium1048±237.8K2.5%1.8%48 tps0.6s33K$1.48$4.55
103113GLM 4.51044±215.4K5.0%3.7%46 tps1.4s131K$0.43$1.63
104124Qwen3 235B A22B Thinking 25071044±36.5K2.4%2.5%53 tps1.6s131K$0.59$5.70
105133GPT-4.1 nano1040±161.4K2.5%0.6%175 tps0.5s1M$0.10$0.40
106129Seed 2.0 Mini (Low)1038±137803.1%10.7%33 tps1.8s256K$0.20$0.80
107143Seed 1.6 2506151037±55K2.0%3.1%46 tps2.2s256K$0.25$2.00
108143Mistral Medium 31034±101.5K2.9%2.4%47 tps0.8s33K$0.40$2.00
109113Gemini 2.5 Flash Lite Thinking1033±319K4.9%1.0%118 tps4.4s1M$0.03$0.13
110148Qwen3 30B A3B Thinking 25071027±37.7K2.3%0.5%124 tps1.2s131K$0.16$1.70
111133DeepSeek V3.2 Speciale1026±37.5K2.8%6.0%43 tps1.4s131K$0.84$1.52
112139GLM 4.6V1024±210K2.3%6.4%21 tps1.8s128K$0.38$0.90
113143Gemini 2.0 Flash1024±229.2K2.1%<0.1%76 tps0.5s1M$0.14$0.56
114165ERNIE 4.5 21B A3B1023±61.7K3.4%2.3%78 tps1.5s120K$0.05$0.19
115129DeepSeek V3.1 Thinking1022±312.7K6.2%7.1%18 tps1.8s131K$0.23$0.75
116170Devstral Small 25071021±71.4K3.9%2.2%186 tps0.5s131K$0.10$0.30
117148OpenAI o1-pro1021±99855.3%5.2%33 tps72.8s200K$150.00$600.00
118157Cogito v2.1 671B1017±54.6K1.9%0.8%85 tps0.5s128K$1.25$1.25
119246Amazon Nova Micro 1.01015±161.3K1.6%4.1%193 tps0.6s128K$0.04$0.07
120124Kimi K2 0905 Turbo1012±223.1K5.9%0.7%373 tps0.5s262K$1.70$6.50
121129Qwen3 Max Thinking1010±58.9K1.0%13.5%32 tps2.3s256K$1.20$6.00
12271Gemini 3.1 Flash Lite Preview1008±102.5K2.5%1.0%8 tps1.2s1M$0.25$1.50
123143Gemini 2.0 Flash Lite1008±263.2K3.2%<0.1%42 tps0.5s1M$0.08$0.30
124139Seed 2.0 Mini (Medium)1004±92.2K2.7%11.9%33 tps1.7s256K$0.15$0.60
125139OpenAI o4-mini1003±221.7K4.3%1.4%97 tps7.0s128K$1.10$4.40
126126Qwen3 VL 235B A22B Thinking999±39.9K6.2%4.3%47 tps3.0s127K$0.47$3.31
127194INTELLECT-3999±108952.7%1.5%114 tps0.6s131K$0.20$1.10
128157Qwen3 Next 80B A3B Thinking998±316.7K5.2%0.6%175 tps1.3s256K$0.21$2.26
129186Jamba 1.7 Large998±52.8K4.9%1.3%58 tps1.0s256K$1.33$5.33
130165Qwen3 4B998±312.9K6.5%1.9%94 tps1.5s128K$0.01$0.01
131170Devstral Medium997±311.7K2.9%1.5%77 tps0.6s131K$0.40$2.00
132160Llama 4 Scout997±266.9K2.4%0.6%88 tps5.1s131K$0.18$0.46
133161Qwen3 8B996±49.9K5.5%2.4%61 tps1.4s41K$0.02$0.07
134186Mistral Small 3.2 24B Instruct995±92.1K5.0%1.9%113 tps1.1s131K$0.02$0.08
135170Mistral Small 3.2 24B994±315.2K2.5%2.8%141 tps0.7s33K$0.02$0.08
136148OpenAI o4-mini-high988±233.5K4.5%1.9%117 tps15.9s200K$1.10$4.40
137133Kimi K2 0905988±316.2K3.9%4.0%30 tps1.4s262K$0.63$2.39
138148OpenAI o3987±312K2.6%0.9%85 tps6.8s128K$7.33$29.33
139179Baichuan-M2-32B983±71.9K5.9%<0.1%32 tps3.3s131K$0.07$0.07
140153OpenAI o1982±418.6K2.5%4.2%92 tps5.5s200K$15.00$60.00
141179Amazon Nova Pro 1.0982±224.5K1.6%0.9%96 tps0.7s300K$0.80$1.70
142179Inception Mercury979±228K1.8%0.4%257 tps1.1s32K$0.25$1.00
143186Jamba 1.6 Large977±215.8K1.3%2.0%59 tps1.2s256K$1.33$5.33
144194Llama 3.3 70B976±310.8K4.1%0.3%500 tps0.5s8K$0.48$0.66
145186Gemma 3n E4B976±225.5K1.8%2.0%30 tps0.5s8K$0.01$0.02
146157GPT-5 Nano974±310.1K6.0%3.2%113 tps20.9s400K$0.05$0.40
147179Qwen 2.5 72B972±45.6K2.1%1.2%96 tps1.2s131K$0.14$0.26
148175MiMo V2 Flash971±139004.3%7.2%24 tps1.9s262K$0.07$0.23
149165DeepSeek R1T2 Chimera967±45.9K3.3%3.0%28 tps1.8s164K$0.13$0.45
150175OpenAI o3-mini-low966±230.5K4.6%0.7%139 tps1.5s200K$1.10$4.40
151194Magistral Small 2506966±317.5K1.5%1.6%156 tps0.5s40K$0.37$1.10
152177OpenAI o3-mini962±233.6K4.2%0.8%143 tps3.3s200K$1.10$4.40
153201ERNIE 4.5 VL 424B A47B961±101.5K5.7%4.9%36 tps3.5s123K$0.42$1.25
154201Llama 3 8B960±213.1K1.8%6.0%85 tps0.7s8K$0.12$0.16
155209Seed 1.6 Flash 250715960±53.6K3.1%2.5%108 tps1.6s256K$0.07$0.30
156194GLM 4.5 Flash960±161.4K4.8%12.2%15 tps2.2s131K$0$0
157186Grok 3 Mini Fast958±226.4K4.4%1.6%44 tps0.5s131K$0.60$4.00
158214Qwen 2.5 VL 32B Instruct958±121.6K5.4%6.3%43 tps3.2s128K$0.35$0.62
159170Kimi K2 0711957±223.3K2.3%1.6%29 tps1.3s131K$0.72$2.60
160179Switchpoint Router957±48.5K2.0%1.7%71 tps4.9s131K$0.85$3.40
161214Gemma 3 12B956±39.8K1.9%4.2%73 tps0.8s131K$0.05$0.12
162179GLM 4.7 Flash956±84.8K1.8%5.8%61 tps2.8s128K$0.07$0.39
163222Rnj-1 Instruct954±63K3.7%0.6%103 tps0.3s33K$0.15$0.15
164201Devstral Small954±65.4K2.4%2.4%180 tps0.6s131K$0.10$0.30
165209Qwen3.5 9B FP8952±194953.9%5.8%64 tps0.7s256K$0.10$0.15
166209GPT-3.5 Turbo950±26K1.0%1.3%74 tps0.9s16K$0.75$1.75
167186Grok 3 Mini948±228.5K3.9%1.2%43 tps0.5s131K$0.30$0.50
168214Krutrim 2947±211.8K0.6%12.5%33 tps2.1s128K$1.00$1.00
169222Jamba 1.5 Large944±313.6K1.6%1.7%48 tps0.9s256K$1.50$6.00
170209Qwen 2.5 14B Instruct944±39K2.3%2.4%40 tps1.6s1M$0.40$1.61
171209Llama 3.3 Swallow 70B Instruct938±310.7K3.2%1.4%153 tps1.3s131K$0.13$0.39
172201GPT-4o mini932±49K3.4%2.1%71 tps1.7s128K$0.15$0.60
173229ERNIE 4.5 21B A3B Thinking930±62.7K3.6%1.8%87 tps1.5s120K$0.07$0.28
174229Moonshot V1 Auto928±64K1.6%1.2%54 tps1.5s8K$2.00$5.00
175240GPT-3.5 Turbo Instruct926±38K1.4%<0.1%46 tps1.2s4K$1.50$2.00
176225GPT-3.5 Turbo 16k923±310.7K1.6%<0.1%22 tps0.6s16K$3.00$4.00
177214Moonshot V1 128k917±54.7K1.7%1.4%54 tps1.5s131K$2.00$5.00
178229Krutrim Spectre V2912±47.4K1.1%<0.1%33 tps3.1s4K$0.19$0.19
179240Moonshot V1 8k911±64K1.8%1.0%55 tps1.5s8K$0.20$2.00
180246WizardLM-2 8x22B911±29.8K1.1%11.6%11 tps2.5s66K$0.77$0.77
181235GLM 4 32B904±211.7K2.1%2.6%40 tps1.6s33K$0.14$0.14
182246Mixtral 8x22B903±55.2K2.1%1.2%140 tps0.6s64K$2.00$6.00
183253GPT-4 Turbo903±137854.3%4.7%21 tps1.9s128K$10.00$30.00
184214OpenAI o3-mini-high901±315.8K3.0%2.4%231 tps10.5s200K$1.10$4.40
185256Solar Mini 250422901±53.7K4.4%1.8%90 tps1.7s33K$0.15$0.15
186265Ministral 3B 2512900±111.7K3.5%2.8%339 tps0.6s131K$0.10$0.10
187260Apriel 1.6 15B Thinker898±111.1K2.1%2.6%92 tps0.4s131K$0$0
188240Hermes 4 405B FP8897±102.1K5.6%3.5%31 tps0.9s131K$0.52$1.73
189240Moonshot V1 32k893±54K1.2%1.4%53 tps1.4s33K$1.00$3.00
190229Magistral Medium 2509887±56.2K6.2%4.0%58 tps0.9s131K$2.00$5.00
191265Inflection 3 Productivity883±47K1.7%0.6%50 tps3.2s8K$2.50$10.00
192260Open Mistral 7B879±35.4K2.4%0.7%176 tps0.4s33K$0.25$0.25
193246Hermes 4 70B878±91.3K4.3%1.1%67 tps0.6s131K$0.12$0.39
194265Magistral Small 2509876±73.4K4.8%2.7%116 tps0.6s131K$0.50$1.50
195265LFM2 2.6B863±52.2K6.3%6.7%184 tps0.4s33K$0.01$0.02
196271Inflection 3 Pi862±37.3K1.4%1.1%33 tps3.4s8K$2.50$10.00
197271Mistral Large851±54.7K2.5%1.5%54 tps0.7s33K$2.00$6.00
198274DeepHermes 3 Mistral 24B Preview850±121.7K4.7%2.5%50 tps1.0s33K$0.06$0.25
199265Qwen 2.5 VL 72B Instruct849±102.6K6.3%5.3%25 tps3.7s128K$1.01$2.79
200274LFM2 8B A1B831±72.3K6.7%<0.1%142 tps0.3s33K$0.01$0.02
201274DeepSeek-R1 Distill Qwen 32B807±64K3.3%6.2%22 tps1.8s131K$0.37$0.39
202274C4AI Aya Expanse 8B798±121.2K6.5%0.9%61 tps0.4s8K$0.50$1.50
203274MiniMax M2-her791±111.1K2.2%<0.1%108 tps0.7s205K$0.30$1.20
204274Moonshot V1 128k Vision779±129555.0%3.1%44 tps3.8s131K$2.00$5.00
205285Hunyuan A13B Instruct739±54.6K5.0%2.3%67 tps2.0s33K$0.01$0.01
206284MiniMax M1688±47.8K4.0%<0.1%31 tps2.8s1M$0.55$2.20
207289UI-TARS 1.5 7B667±181.4K8.7%4.0%75 tps0.9s128K$0.10$0.20
208291LFM2.5 1.2B Thinking630±227054.7%2.6%258 tps0.4s33K$0$0
Show Less