Models
Topics
Language
More

More filters

Show inactive models

Hide models that are no longer actively available on Yupp.

Turns

Filter model performance by the number of turns in a conversation.

Open license models

Filter the leaderboard to only show models that have an open license.

1569
Claude Opus 4.6 (Thinking)
1493
GPT-5.4
1469
Claude Opus 4.6
1418
Gemini 3.1 Pro
1368
GPT-5.1 (High)
1364
Claude Sonnet 4.6
1361
GPT-5.2 Instant
1360
GPT-5.1
1345
Qwen3 30B A3B Instruct 2507
1343
Gemini 3 Pro
1329
GPT-5.2
1313
Claude Opus 4.5 (Thinking)
1300
Gemini 3 Pro (Low)
1281
Gemini 3 Flash Preview
1280
Claude Sonnet 4.6 (Thinking)

Last updated about 1 month ago

RankOverallNameVIBE
Score
Confidence
Interval
VotesDownvote %Abort %SpeedLatencyContextCost
(Input)
Cost
(Output)
11Claude Opus 4.6 (Thinking)1569±101.5K1.7%2.5%56 tps1.6s200K$5.00$25.00
22GPT-5.41493±146951.4%2.6%55 tps0.8s1M$2.50$15.00
32Claude Opus 4.61469±161.6K2.4%2.1%48 tps1.7s200K$5.00$25.00
46Gemini 3.1 Pro1418±114.9K1.0%3.5%35 tps4.1s1M$2.00$12.00
58GPT-5.1 (High)1368±104.9K2.2%3.2%76 tps6.9s400K$1.25$10.00
64Claude Sonnet 4.61364±191.9K1.3%1.6%47 tps1.2s200K$3.00$15.00
710GPT-5.2 Instant1361±114K1.1%1.7%52 tps2.0s400K$1.75$14.00
88GPT-5.11360±92.6K2.4%2.3%71 tps1.4s400K$1.42$11.33
933Qwen3 30B A3B Instruct 25071345±63.4K1.4%1.2%55 tps1.3s131K$0.13$0.72
1010Gemini 3 Pro1343±716.2K1.4%2.1%50 tps3.6s1M$2.00$12.00
1116GPT-5.21329±93.2K1.2%4.1%18 tps2.7s400K$1.75$14.00
127Claude Opus 4.5 (Thinking)1313±96K2.5%1.8%49 tps1.4s200K$5.00$25.00
1314Gemini 3 Pro (Low)1300±84.1K1.8%2.4%51 tps3.5s1M$2.00$12.00
1417Gemini 3 Flash Preview1281±112K1.2%1.3%138 tps1.4s1M$0.50$3.00
155Claude Sonnet 4.6 (Thinking)1280±141.4K2.2%4.7%57 tps1.1s200K$3.00$15.00
1617GPT-5.2 (High)1275±126.5K1.4%6.7%18 tps16.3s400K$1.75$14.00
1729Qwen3 VL 235B A22B Instruct1273±141.1K2.3%3.1%75 tps1.9s129K$0.37$1.81
1822GPT-5 Chat1269±57.9K1.6%1.3%95 tps0.9s400K$1.25$10.00
1940Qwen3 235B A22B Instruct 25071261±83.1K1.4%6.8%13 tps1.9s262K$0.13$0.52
2010Claude Sonnet 4.5 (Thinking)1261±75.5K1.9%1.9%44 tps1.1s200K$3.00$15.00
2126Grok 4.1 Fast Non-Reasoning1260±162.5K3.7%0.9%101 tps0.5s2M$0.20$0.50
2214Gemini 3 Flash Preview Thinking1248±103.7K1.3%1.6%3 tps6.2s1M$0.50$3.00
2332Gemini 2.5 Pro High1234±64.6K2.4%1.5%48 tps2.3s1M$1.25$10.00
2462GPT-5.1 Instant1233±122.6K2.7%1.3%50 tps1.9s400K$1.25$10.00
2581GPT-4o1228±112.9K1.7%1.0%49 tps2.4s128K$3.71$12.57
2613GPT-5.3 Instant1225±132.3K1.3%0.9%63 tps0.8s400K$1.75$14.00
2742Qwen3 Max Instruct Preview1192±92.8K3.0%1.1%31 tps1.7s256K$1.43$6.61
2829Nova Experimental Chat 12-101192±111.4K0.7%2.4%84 tps12.9s98K$0$0
2917Claude Opus 4.51177±151.9K4.7%1.5%45 tps1.5s200K$5.00$25.00
3042GPT-5.2 (Extra High) 1172±133K1.6%13.2%17 tps20.5s400K$1.75$14.00
3156Gemini 3.1 Flash Lite Preview Thinking1162±197302.0%1.7%75 tps4.7s1M$0.25$1.50
3244Gemini 2.5 Pro1161±612.1K1.4%2.3%45 tps2.6s1M$1.25$10.00
3344Grok 4.1 Fast Reasoning1159±114.3K2.9%1.5%58 tps7.3s2M$0.20$0.50
3426Claude Haiku 4.5 (Extended Thinking)1154±82.4K2.8%1.4%115 tps0.7s200K$1.00$5.00
3548Grok 4 Fast Reasoning1154±102.2K3.0%2.1%102 tps3.1s2M$0.30$0.75
3668Qwen Plus (Aug'24)1152±94.8K1.1%1.4%53 tps1.3s30K$0.40$1.20
3760Gemini 2.5 Flash Preview 09251151±91.8K3.3%1.2%5 tps0.9s1M$0.13$0.97
3837Qwen3 Omni 30B A3B Thinking1150±168453.4%3.7%67 tps1.2s66K$0.97$1.79
3937Claude Sonnet 4.51148±93.3K2.7%1.4%41 tps1.3s200K$1.80$9.00
40106Claude Sonnet 3.5 v21147±141K2.0%<0.1%46 tps1.4s200K$3.00$15.00
41133Kimi K2 09051145±101.5K2.0%4.0%30 tps1.4s262K$0.63$2.39
4226GPT-5 (High)1131±92.7K3.2%4.5%81 tps35.9s400K$1.25$10.00
4340DeepSeek V3.21125±102.1K1.6%1.4%83 tps5.1s131K$0.43$1.09
44111LongCat Flash Chat1121±177254.6%0.8%85 tps0.9s131K$0.14$0.68
4571Gemini 2.5 Flash Lite Preview 09251116±102K2.4%1.2%209 tps0.7s1M$0.25$0.35
46101Gemini 2.5 Flash Lite1113±64.4K1.8%1.3%210 tps0.7s1M$0.10$0.40
4752Grok 4 Fast Non-Reasoning1108±121.8K3.0%1.5%93 tps0.6s2M$0.27$0.67
4879Qwen3 Max Thinking Preview1105±141.9K4.0%3.1%40 tps2.1s256K$1.20$6.00
49124Qwen3 235B A22B Thinking 25071091±207052.1%2.5%53 tps1.6s131K$0.59$5.70
5052GPT-51084±75K2.1%3.1%78 tps23.1s400K$1.25$9.67
5156DeepSeek V3.1 Turbo1082±161.8K2.2%0.9%173 tps1.3s164K$2.00$3.75
52148Qwen3 30B A3B Thinking 25071081±198902.7%0.5%124 tps1.2s131K$0.16$1.70
5393Qwen Max1080±75.4K1.1%1.5%49 tps1.5s33K$1.60$6.40
5422GLM 51080±151.4K1.4%3.4%36 tps2.7s200K$0.72$2.55
55113Mistral Medium1079±92.7K1.8%1.8%48 tps0.6s33K$1.48$4.55
5652Claude Haiku 4.51078±112.6K3.7%1.1%100 tps0.9s200K$1.00$5.00
5795Kimi K2 Thinking1072±308808.8%4.2%61 tps5.9s262K$0.24$1.03
5860MiniMax M2.11071±112.6K1.1%2.1%66 tps2.6s205K$0.30$1.20
5986DeepSeek V3.1 Chat1069±111.3K3.0%2.8%21 tps1.6s131K$0.38$1.00
6093DeepSeek V3 0324 Turbo1068±74.2K0.8%6.3%12 tps2.4s164K$0.73$1.79
6168Grok 41062±610.5K1.3%3.9%29 tps11.1s256K$3.00$15.00
6295Gemini 2.5 Flash1061±710K1.0%1.3%2 tps3.7s1M$0.30$2.50
6344DeepSeek V3.1 Terminus Chat1060±131.4K3.3%3.4%27 tps1.5s131K$0.86$1.80
6484GPT-5 Mini Minimal1057±117455.7%1.2%63 tps1.4s400K$0.25$2.00
6571Gemini 2.5 Flash Thinking1055±112.8K2.3%2.2%88 tps6.4s1M$0.30$2.50
6695Gemini 2.5 Flash Lite Thinking Preview 09251051±151.5K4.2%1.5%152 tps3.0s1M$0.10$0.40
6756MiniMax M2.1 Lightning1050±236151.6%1.7%52 tps2.1s205K$0.30$2.40
68157Qwen3 Next 80B A3B Thinking1049±92K2.6%0.6%175 tps1.3s256K$0.21$2.26
6968GLM 4.71047±152.4K1.2%5.8%40 tps1.5s200K$0.77$1.73
7071GPT-5 Mini1047±92.2K2.7%2.6%66 tps14.2s400K$0.25$2.00
71106DeepSeek V3 03241045±84.1K1.0%5.8%12 tps2.7s164K$0.38$0.93
72106Grok 31044±76K1.1%1.5%53 tps0.6s1M$3.67$18.33
73113Gemini 2.5 Flash Lite Thinking1041±92.2K1.8%1.0%118 tps4.4s1M$0.03$0.13
7481OpenAI o3-pro1037±189502.6%5.2%22 tps70.8s200K$20.00$80.00
75165DeepSeek R1T2 Chimera1031±175753.4%3.0%28 tps1.8s164K$0.13$0.45
7648Claude Sonnet 4 (Thinking)1028±153.7K2.9%1.5%52 tps1.5s200K$3.00$13.67
77126Qwen3 VL 235B A22B Thinking1027±139354.1%4.3%47 tps3.0s127K$0.47$3.31
7862MiniMax M21027±92.5K5.2%2.2%39 tps2.3s205K$0.21$0.85
79129Qwen3 Max Thinking1022±121.3K1.1%13.5%32 tps2.3s256K$1.20$6.00
8071Qwen3.5 397B A17B1021±229101.1%4.3%57 tps1.4s256K$0.52$3.00
81124Kimi K2 0905 Turbo1017±122.1K2.3%0.7%373 tps0.5s262K$1.70$6.50
82119ERNIE 4.5 300B A47B1014±114K1.1%4.7%23 tps2.3s123K$0.28$1.10
8386Claude Sonnet 41013±710.4K1.2%1.8%49 tps1.3s200K$3.00$15.00
8465GLM 4.61001±151.3K4.4%5.4%39 tps1.5s200K$0.42$1.66
85118GPT-4.1 mini999±105.1K1.4%1.1%67 tps0.9s1M$0.34$1.60
8671Seed 1.8 251228997±132.4K1.3%3.7%41 tps2.1s256K$0.25$2.00
87161Qwen3 8B991±111.4K2.5%2.4%61 tps1.4s41K$0.02$0.07
88113GLM 4.5986±151.5K2.0%3.7%46 tps1.4s131K$0.43$1.63
89129DeepSeek V3.1 Thinking984±131.4K3.7%7.1%18 tps1.8s131K$0.23$0.75
90139OpenAI o4-mini971±82.2K2.6%1.4%97 tps7.0s128K$1.10$4.40
91148OpenAI o3968±121.6K1.6%0.9%85 tps6.8s128K$7.33$29.33
92143Gemini 2.0 Flash965±121.8K1.3%<0.1%76 tps0.5s1M$0.14$0.56
9371DeepSeek V3.1962±207503.2%0.8%197 tps0.4s164K$0.55$1.60
94133GPT-4.1 nano958±84K1.4%0.6%175 tps0.5s1M$0.10$0.40
95157GPT-5 Nano955±181.2K4.1%3.2%113 tps20.9s400K$0.05$0.40
9686Amazon Nova 2 Lite948±219707.6%1.0%137 tps0.6s300K$0.35$2.95
97143Gemini 2.0 Flash Lite948±73.5K1.7%<0.1%42 tps0.5s1M$0.08$0.30
98153OpenAI o1946±113.6K1.0%4.2%92 tps5.5s200K$15.00$60.00
99165Qwen3 4B940±141.7K5.2%1.9%94 tps1.5s128K$0.01$0.01
100179GLM 4.7 Flash932±266902.1%5.8%61 tps2.8s128K$0.07$0.39
101170Kimi K2 0711932±122.4K1.7%1.6%29 tps1.3s131K$0.72$2.60
102170Mistral Small 3.2 24B929±149852.5%2.8%141 tps0.7s33K$0.02$0.08
103111Grok 3 Fast922±125300.9%1.7%52 tps2.4s131K$5.00$25.00
104133DeepSeek V3.2 Speciale922±257806.6%6.0%43 tps1.4s131K$0.84$1.52
105148OpenAI o4-mini-high915±104.7K1.5%1.9%117 tps15.9s200K$1.10$4.40
106143Seed 1.6 250615888±235302.8%3.1%46 tps2.2s256K$0.25$2.00
107139GLM 4.6V880±338852.2%6.4%21 tps1.8s128K$0.38$0.90
108157Cogito v2.1 671B876±304903.9%0.8%85 tps0.5s128K$1.25$1.25
109160Llama 4 Scout872±114.4K1.4%0.6%88 tps5.1s131K$0.18$0.46
110194Magistral Small 2506870±161K2.8%1.6%156 tps0.5s40K$0.37$1.10
111170Devstral Medium865±198051.8%1.5%77 tps0.6s131K$0.40$2.00
112209Llama 3.3 Swallow 70B Instruct865±198201.8%1.4%153 tps1.3s131K$0.13$0.39
113175OpenAI o3-mini-low852±84.4K1.8%0.7%139 tps1.5s200K$1.10$4.40
114186Grok 3 Mini852±142.5K1.4%1.2%43 tps0.5s131K$0.30$0.50
115177OpenAI o3-mini851±74.7K1.8%0.8%143 tps3.3s200K$1.10$4.40
116179Inception Mercury847±131.4K1.0%0.4%257 tps1.1s32K$0.25$1.00
117214OpenAI o3-mini-high833±132.9K1.0%2.4%231 tps10.5s200K$1.10$4.40
118235GLM 4 32B820±167002.1%2.6%40 tps1.6s33K$0.14$0.14
119186Gemma 3n E4B814±171.6K3.6%2.0%30 tps0.5s8K$0.01$0.02
120186Grok 3 Mini Fast807±142.4K1.8%1.6%44 tps0.5s131K$0.60$4.00
121179Amazon Nova Pro 1.0803±131.2K2.0%0.9%96 tps0.7s300K$0.80$1.70
122229Magistral Medium 2509782±285507.6%4.0%58 tps0.9s131K$2.00$5.00
123186Jamba 1.6 Large761±157801.9%2.0%59 tps1.2s256K$1.33$5.33
124222Jamba 1.5 Large744±247152.1%1.7%48 tps0.9s256K$1.50$6.00
125274DeepSeek-R1 Distill Qwen 32B736±225701.7%6.2%22 tps1.8s131K$0.37$0.39
126194Llama 3.3 70B726±267355.2%0.3%500 tps0.5s8K$0.48$0.66
127179Switchpoint Router710±266203.1%1.7%71 tps4.9s131K$0.85$3.40
128284MiniMax M1707±141.5K1.0%<0.1%31 tps2.8s1M$0.55$2.20
129214Gemma 3 12B689±235504.3%4.2%73 tps0.8s131K$0.05$0.12
130209Qwen 2.5 14B Instruct679±225053.8%2.4%40 tps1.6s1M$0.40$1.61
131201GPT-4o mini654±305154.6%2.1%71 tps1.7s128K$0.15$0.60
Show Less