Leaderboard | Text

Models

Choose model family

Claude by Anthropic

Mistral by Mistral AI

Choose topic

All topics Facts and Information Creative Writing and Ideation Logic and Problem-Solving Task Completion Coding

Language

Choose language

All languages English Chinese Arabic Spanish Indonesian Japanese

More filters

Show inactive models

Hide models that are no longer actively available on Yupp.

Turns

Filter model performance by the number of turns in a conversation.

All Single turn Multiple turns

Open license models

Filter the leaderboard to only show models that have an open license.

All selected Open license Proprietary license

892

Gemma 3n E4B

890

Pixtral Large

876

Switchpoint Router

866

ERNIE 4.5 21B A3B Thinking

854

Llama 3.3 Swallow 70B Instruct

849

Magistral Medium 2509

847

Magistral Small 2506

835

Mistral Small 3.1

830

Qwen 2.5 14B Instruct

830

Magistral Small 2509

829

Inception Mercury

828

Hermes 4 405B Reasoning FP8

826

Llama 3 8B

825

Gemma 3 4B

819

Jamba 1.5 Large

Last updated about 1 month ago

Rank	Overall	Name	VIBE Score	Confidence Interval	Votes	Downvote %	Abort %	Speed	Latency	Context	Cost (Input)	Cost (Output)
161	186	Gemma 3n E4B	892	±10	2K	2.6%	2.0%	30 tps	0.5s	8K	$0.01	$0.02
162	165	Pixtral Large	890	±12	640	4.5%	2.5%	57 tps	1.3s	128K	$1.50	$4.50
163	179	Switchpoint Router	876	±16	675	1.5%	1.7%	71 tps	4.9s	131K	$0.85	$3.40
164	229	ERNIE 4.5 21B A3B Thinking	866	±16	685	2.8%	1.8%	87 tps	1.5s	120K	$0.07	$0.28
165	209	Llama 3.3 Swallow 70B Instruct	854	±18	890	1.1%	1.4%	153 tps	1.3s	131K	$0.13	$0.39
166	229	Magistral Medium 2509	849	±16	990	3.9%	4.0%	58 tps	0.9s	131K	$2.00	$5.00
167	194	Magistral Small 2506	847	±14	1.3K	1.9%	1.6%	156 tps	0.5s	40K	$0.37	$1.10
168	161	Mistral Small 3.1	835	±17	675	1.5%	7.4%	13 tps	2.6s	32K	$0.17	$0.28
169	209	Qwen 2.5 14B Instruct	830	±24	570	1.7%	2.4%	40 tps	1.6s	1M	$0.40	$1.61
170	265	Magistral Small 2509	830	±23	825	5.7%	2.7%	116 tps	0.6s	131K	$0.50	$1.50
171	179	Inception Mercury	829	±10	2K	1.5%	0.4%	257 tps	1.1s	32K	$0.25	$1.00
172	260	Hermes 4 405B Reasoning FP8	828	±11	1.3K	3.7%	3.6%	32 tps	0.8s	131K	$1.00	$3.00
173	201	Llama 3 8B	826	±17	720	1.4%	6.0%	85 tps	0.7s	8K	$0.12	$0.16
174	235	Gemma 3 4B	825	±14	755	3.2%	1.3%	138 tps	0.7s	131K	$0.02	$0.04
175	222	Jamba 1.5 Large	819	±15	690	1.4%	1.7%	48 tps	0.9s	256K	$1.50	$6.00
176	194	Llama 3.2 11B Instruct	816	±22	525	2.8%	1.5%	152 tps	0.5s	8K	$0.16	$0.16
177	179	Amazon Nova Pro 1.0	807	±19	1.4K	1.7%	0.9%	96 tps	0.7s	300K	$0.80	$1.70
178	201	GPT-4o mini	803	±24	545	4.4%	2.1%	71 tps	1.7s	128K	$0.15	$0.60
179	222	Sky T1 32B Preview	797	±17	625	1.6%	7.8%	73 tps	0.6s	16K	$0.12	$0.18
180	225	Command R 7B	775	±18	870	1.7%	1.1%	76 tps	0.4s	128K	$0.04	$0.15
181	246	Ministral 3B	766	±21	575	1.7%	0.8%	248 tps	0.4s	131K	$0.08	$0.08
182	229	Ministral 8B	763	±23	525	3.7%	1.4%	177 tps	0.4s	128K	$0.14	$0.14
183	225	Command R	754	±22	540	2.7%	5.8%	54 tps	0.6s	128K	$0.30	$0.99
184	235	GLM 4 32B	751	±19	740	2.0%	2.6%	40 tps	1.6s	33K	$0.14	$0.14
185	246	DeepSeek-R1 Distill Llama 70B	733	±10	2.6K	2.3%	3.6%	27 tps	1.6s	32K	$0.73	$0.95
186	256	Gemma 3 1B	733	±21	670	2.9%	0.6%	176 tps	1.0s	33K	$0.06	$0.10
187	214	C4AI Aya Expanse 32B	702	±22	825	1.8%	1.5%	43 tps	0.5s	128K	$0.50	$1.50
188	225	GPT-3.5 Turbo 16k	699	±17	690	0.7%	<0.1%	22 tps	0.6s	16K	$3.00	$4.00
189	274	DeepSeek-R1 Distill Qwen 32B	638	±9	1.8K	2.7%	6.2%	22 tps	1.8s	131K	$0.37	$0.39
190	287	Phi 4 Reasoning	632	±13	2K	2.2%	21.0%	29 tps	1.0s	33K	$0.06	$0.25
191	284	MiniMax M1	570	±10	3K	1.3%	<0.1%	31 tps	2.8s	1M	$0.55	$2.20
192	291	Phi 4 Mini Reasoning	545	±12	2.3K	3.1%	9.7%	30 tps	0.9s	128K	$0.07	$0.30
193	281	MythoMax L2 13B	466	±30	520	4.6%	1.2%	22 tps	1.1s	4K	$0.18	$0.18

5of5

View All (193 models)