Leaderboard | Text

Models

Choose model family

Claude by Anthropic

Mistral by Mistral AI

Topics

Choose topic

All topics Facts and Information Creative Writing and Ideation Logic and Problem-Solving Task Completion Coding

Choose language

All languages English Chinese Arabic Spanish Indonesian Japanese

More filters

Show inactive models

Hide models that are no longer actively available on Yupp.

Turns

Filter model performance by the number of turns in a conversation.

All Single turn Multiple turns

Open license models

Filter the leaderboard to only show models that have an open license.

All selected Open license Proprietary license

900

Llama 4 Maverick

899

R1 1776

888

Claude Sonnet 3.5

888

Seed 1.6 250615

886

DeepSeek-R1 0528 Qwen3 8B

883

NVIDIA Llama 3.3 Nemotron Super 49B v1

880

GLM 4.6V

879

Gemma 3 27B IT

876

Cogito v2.1 671B

872

Llama 4 Scout

870

Magistral Small 2506

870

GPT-5 Mini High

865

Claude Haiku 3.5

865

Devstral Medium

865

Llama 3.3 Swallow 70B Instruct

Last updated about 1 month ago

Rank	Overall	Name	VIBE Score	Confidence Interval	Votes	Downvote %	Abort %	Speed	Latency	Context	Cost (Input)	Cost (Output)
161	161	Llama 4 Maverick	900	±11	5.1K	1.9%	1.2%	88 tps	2.4s	1M	$0.23	$0.83
162	253	R1 1776	899	±15	1.3K	0.8%	<0.1%	61 tps	1.0s	128K	$2.00	$8.00
163	200	Claude Sonnet 3.5	888	±27	495	2.9%	1.0%	40 tps	2.7s	200K	$3.00	$15.00
164	143	Seed 1.6 250615	888	±23	530	2.8%	3.1%	46 tps	2.2s	256K	$0.25	$2.00
165	314	DeepSeek-R1 0528 Qwen3 8B	886	±19	1.1K	5.7%	<0.1%	45 tps	2.4s	128K	$0.05	$0.09
166	219	NVIDIA Llama 3.3 Nemotron Super 49B v1	883	±17	915	1.1%	<0.1%	13 tps	N/A	131K	$0.07	$0.20
167	139	GLM 4.6V	880	±33	885	2.2%	6.4%	21 tps	1.8s	128K	$0.38	$0.90
168	201	Gemma 3 27B IT	879	±21	560	1.8%	2.0%	60 tps	0.8s	128K	$0.17	$0.29
169	157	Cogito v2.1 671B	876	±30	490	3.9%	0.8%	85 tps	0.5s	128K	$1.25	$1.25
170	160	Llama 4 Scout	872	±11	4.4K	1.4%	0.6%	88 tps	5.1s	131K	$0.18	$0.46
171	194	Magistral Small 2506	870	±16	1K	2.8%	1.6%	156 tps	0.5s	40K	$0.37	$1.10
172	241	GPT-5 Mini High	870	±17	770	3.1%	<0.1%	33 tps	3.9s	400K	$0.25	$2.00
173	213	Claude Haiku 3.5	865	±12	1.3K	3.1%	0.8%	40 tps	2.8s	200K	$0.80	$4.00
174	170	Devstral Medium	865	±19	805	1.8%	1.5%	77 tps	0.6s	131K	$0.40	$2.00
175	209	Llama 3.3 Swallow 70B Instruct	865	±19	820	1.8%	1.4%	153 tps	1.3s	131K	$0.13	$0.39
176	219	Arcee AI Virtuoso-Large	863	±17	710	1.4%	<0.1%	64 tps	0.5s	131K	$0.75	$1.20
177	186	GLM 4.6V Flash	858	±23	750	2.6%	3.7%	64 tps	2.1s	128K	$0.04	$0.40
178	175	OpenAI o3-mini-low	852	±8	4.4K	1.8%	0.7%	139 tps	1.5s	200K	$1.10	$4.40
179	186	Grok 3 Mini	852	±14	2.5K	1.4%	1.2%	43 tps	0.5s	131K	$0.30	$0.50
180	177	OpenAI o3-mini	851	±7	4.7K	1.8%	0.8%	143 tps	3.3s	200K	$1.10	$4.40
181	179	Inception Mercury	847	±13	1.4K	1.0%	0.4%	257 tps	1.1s	32K	$0.25	$1.00
182	177	Mistral Small 3.1 24B Instruct	839	±22	695	3.5%	7.5%	15 tps	2.4s	131K	$0.06	$0.18
183	214	OpenAI o3-mini-high	833	±13	2.9K	1.0%	2.4%	231 tps	10.5s	200K	$1.10	$4.40
184	314	MAI-DS-R1	823	±19	855	4.5%	<0.1%	73 tps	3.2s	64K	$0.10	$0.40
185	399	Magistral Medium (Thinking)	822	±24	600	1.6%	<0.1%	67 tps	0.8s	41K	$2.00	$5.00
186	277	Wikipedia	821	±13	1.7K	5.9%	<0.1%	47 tps	2.1s	32K	$0	$0
187	222	Sky T1 32B Preview	821	±18	625	1.6%	7.8%	73 tps	0.6s	16K	$0.12	$0.18
188	235	GLM 4 32B	820	±16	700	2.1%	2.6%	40 tps	1.6s	33K	$0.14	$0.14
189	186	Gemma 3n E4B	814	±17	1.6K	3.6%	2.0%	30 tps	0.5s	8K	$0.01	$0.02
190	186	Grok 3 Mini Fast	807	±14	2.4K	1.8%	1.6%	44 tps	0.5s	131K	$0.60	$4.00
191	179	Amazon Nova Pro 1.0	803	±13	1.2K	2.0%	0.9%	96 tps	0.7s	300K	$0.80	$1.70
192	277	Grok 2	798	±18	555	0.9%	<0.1%	55 tps	1.1s	131K	$2.00	$10.00
193	270	AFM 4.5B Preview	797	±38	610	3.9%	<0.1%	32 tps	0.0s	66K	$0	$0
194	292	Arcee AI Spotlight	788	±15	1.1K	1.3%	<0.1%	121 tps	0.4s	131K	$0.18	$0.18
195	225	Command R 7B	787	±26	660	2.9%	1.1%	76 tps	0.4s	128K	$0.04	$0.15
196	219	Grok 3 Mini Beta	783	±17	605	0.8%	<0.1%	75 tps	0.5s	131K	$0.45	$2.25
197	200	NVIDIA Llama 3.1 Nemotron 70B	783	±17	1.2K	2.4%	<0.1%	9 tps	0.1s	128K	$0.33	$0.39
198	229	Magistral Medium 2509	782	±28	550	7.6%	4.0%	58 tps	0.9s	131K	$2.00	$5.00
199	270	Solar Pro 2 250710 (Reasoning)	782	±22	605	1.6%	<0.1%	9 tps	N/A	66K	$0.50	$0.50
200	200	K2 Think	763	±24	605	0.8%	<0.1%	418 tps	2.8s	N/A	$0	$0

5of6

View All (223 models)