Filter model performance by the number of turns in a conversation.
Filter the leaderboard to only show models that have an open license.
Last updated about 1 month ago
| Rank | Overall | Name | VIBE Score | Confidence Interval | Votes | Downvote % | Abort % | Speed | Latency | Context | Cost (Input) | Cost (Output) |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 201 | 214 | 958 | ±12 | 1.6K | 5.4% | 6.3% | 43 tps | 3.2s | 128K | $0.35 | $0.62 | |
| 202 | 201 | 958 | ±4 | 6.8K | 2.1% | 1.5% | 84 tps | 0.4s | 33K | $0.80 | $0.80 | |
| 203 | 170 | 957 | ±2 | 23.3K | 2.3% | 1.6% | 29 tps | 1.3s | 131K | $0.72 | $2.60 | |
| 204 | 179 | Switchpoint Router | 957 | ±4 | 8.5K | 2.0% | 1.7% | 71 tps | 4.9s | 131K | $0.85 | $3.40 |
| 205 | 214 | 956 | ±3 | 9.8K | 1.9% | 4.2% | 73 tps | 0.8s | 131K | $0.05 | $0.12 | |
| 206 | 179 | 956 | ±8 | 4.8K | 1.8% | 5.8% | 61 tps | 2.8s | 128K | $0.07 | $0.39 | |
| 207 | 222 | 954 | ±6 | 3K | 3.7% | 0.6% | 103 tps | 0.3s | 33K | $0.15 | $0.15 | |
| 208 | 201 | 954 | ±6 | 5.4K | 2.4% | 2.4% | 180 tps | 0.6s | 131K | $0.10 | $0.30 | |
| 209 | 209 | 952 | ±19 | 495 | 3.9% | 5.8% | 64 tps | 0.7s | 256K | $0.10 | $0.15 | |
| 210 | 209 | 950 | ±2 | 6K | 1.0% | 1.3% | 74 tps | 0.9s | 16K | $0.75 | $1.75 | |
| 211 | 186 | 948 | ±2 | 28.5K | 3.9% | 1.2% | 43 tps | 0.5s | 131K | $0.30 | $0.50 | |
| 212 | 214 | 947 | ±2 | 11.8K | 0.6% | 12.5% | 33 tps | 2.1s | 128K | $1.00 | $1.00 | |
| 213 | 225 | 946 | ±3 | 7.3K | 2.1% | 1.5% | 171 tps | 0.5s | 131K | $0.15 | $0.15 | |
| 214 | 235 | 945 | ±2 | 8.8K | 1.0% | <0.1% | 76 tps | 1.0s | 131K | $0.08 | $0.09 | |
| 215 | 222 | 944 | ±3 | 13.6K | 1.6% | 1.7% | 48 tps | 0.9s | 256K | $1.50 | $6.00 | |
| 216 | 209 | 944 | ±3 | 9K | 2.3% | 2.4% | 40 tps | 1.6s | 1M | $0.40 | $1.61 | |
| 217 | 225 | 940 | ±3 | 14K | 1.9% | 1.1% | 76 tps | 0.4s | 128K | $0.04 | $0.15 | |
| 218 | 209 | Llama 3.3 Swallow 70B Instruct | 938 | ±3 | 10.7K | 3.2% | 1.4% | 153 tps | 1.3s | 131K | $0.13 | $0.39 |
| 219 | 201 | 938 | ±3 | 9.7K | 1.7% | 2.0% | 60 tps | 0.8s | 128K | $0.17 | $0.29 | |
| 220 | 214 | 934 | ±4 | 7.5K | 2.3% | 3.7% | 40 tps | 1.9s | 131K | $0.08 | $0.27 | |
| 221 | 186 | 933 | ±4 | 7.9K | 3.7% | 3.7% | 64 tps | 2.1s | 128K | $0.04 | $0.40 | |
| 222 | 201 | 932 | ±4 | 9K | 3.4% | 2.1% | 71 tps | 1.7s | 128K | $0.15 | $0.60 | |
| 223 | 214 | 930 | ±2 | 17.9K | 1.6% | 1.5% | 43 tps | 0.5s | 128K | $0.50 | $1.50 | |
| 224 | 229 | 930 | ±6 | 2.7K | 3.6% | 1.8% | 87 tps | 1.5s | 120K | $0.07 | $0.28 | |
| 225 | 246 | 929 | ±3 | 8.6K | 2.2% | 0.8% | 248 tps | 0.4s | 131K | $0.08 | $0.08 | |
| 226 | 229 | 928 | ±6 | 4K | 1.6% | 1.2% | 54 tps | 1.5s | 8K | $2.00 | $5.00 | |
| 227 | 240 | 928 | ±3 | 4.2K | 1.2% | <0.1% | 112 tps | 0.4s | 131K | $0.07 | $0.13 | |
| 228 | 240 | 927 | ±11 | 900 | 2.7% | 5.3% | 28 tps | 1.3s | 128K | $0.38 | $0.55 | |
| 229 | 240 | 926 | ±3 | 8K | 1.4% | <0.1% | 46 tps | 1.2s | 4K | $1.50 | $2.00 | |
| 230 | 214 | 925 | ±5 | 4.2K | 3.3% | 2.0% | 78 tps | 1.0s | 131K | $0.88 | $0.88 | |
| 231 | 222 | Sky T1 32B Preview | 923 | ±3 | 11.2K | 1.6% | 7.8% | 73 tps | 0.6s | 16K | $0.12 | $0.18 |
| 232 | 225 | 923 | ±3 | 10.7K | 1.6% | <0.1% | 22 tps | 0.6s | 16K | $3.00 | $4.00 | |
| 233 | 235 | 923 | ±4 | 5.3K | 2.2% | 2.2% | 142 tps | 0.6s | 33K | $0.23 | $0.23 | |
| 234 | 229 | 922 | ±3 | 7.7K | 2.5% | 1.4% | 177 tps | 0.4s | 128K | $0.14 | $0.14 | |
| 235 | 225 | 920 | ±3 | 9.8K | 2.0% | 5.8% | 54 tps | 0.6s | 128K | $0.30 | $0.99 | |
| 236 | 214 | 917 | ±5 | 4.7K | 1.7% | 1.4% | 54 tps | 1.5s | 131K | $2.00 | $5.00 | |
| 237 | 229 | 915 | ±8 | 1.3K | 2.9% | 1.9% | 61 tps | 1.0s | 8K | $0.07 | $0.09 | |
| 238 | 229 | 912 | ±4 | 7.4K | 1.1% | <0.1% | 33 tps | 3.1s | 4K | $0.19 | $0.19 | |
| 239 | 240 | 911 | ±6 | 4K | 1.8% | 1.0% | 55 tps | 1.5s | 8K | $0.20 | $2.00 | |
| 240 | 246 | 911 | ±2 | 9.8K | 1.1% | 11.6% | 11 tps | 2.5s | 66K | $0.77 | $0.77 |