Filter model performance by the number of turns in a conversation.
Filter the leaderboard to only show models that have an open license.
Last updated about 1 month ago
| Rank | Overall | Name | VIBE Score | Confidence Interval | Votes | Downvote % | Abort % | Speed | Latency | Context | Cost (Input) | Cost (Output) |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 60 | 1171 | ±6 | 5.5K | 3.4% | <0.1% | 46 tps | 1.4s | 200K | $3.00 | $15.00 | |
| 2 | 43 | 1205 | ±3 | 43.2K | 3.7% | 1.8% | 49 tps | 1.3s | 200K | $3.00 | $15.00 | |
| 3 | 27 | 1261 | ±3 | 25.9K | 2.9% | 1.5% | 52 tps | 1.5s | 200K | $3.00 | $13.67 | |
| 4 | 19 | 1283 | ±3 | 16.4K | 4.5% | 1.1% | 100 tps | 0.9s | 200K | $1.00 | $5.00 | |
| 5 | 17 | 1307 | ±3 | 20.9K | 5.0% | 1.4% | 41 tps | 1.3s | 200K | $1.80 | $9.00 | |
| 6 | 12 | 1353 | ±4 | 14.3K | 3.8% | 1.4% | 115 tps | 0.7s | 200K | $1.00 | $5.00 | |
| 7 | 10 | 1362 | ±4 | 58.2K | 3.3% | 1.9% | 44 tps | 1.1s | 200K | $3.00 | $15.00 | |
| 8 | 7 | 1409 | ±5 | 15.1K | 2.2% | 1.5% | 45 tps | 1.5s | 200K | $5.00 | $25.00 | |
| 9 | 6 | 1446 | ±4 | 60.8K | 1.9% | 1.8% | 49 tps | 1.4s | 200K | $5.00 | $25.00 | |
| 10 | 5 | 1506 | ±8 | 16.2K | 3.5% | 4.7% | 57 tps | 1.1s | 200K | $3.00 | $15.00 | |
| 11 | 4 | 1566 | ±8 | 16.5K | 1.6% | 2.5% | 56 tps | 1.6s | 200K | $5.00 | $25.00 | |
| 12 | 1 | 1594 | ±10 | 15.7K | 1.4% | 1.6% | 47 tps | 1.2s | 200K | $3.00 | $15.00 | |
| 13 | 1 | 1596 | ±6 | 21.6K | 1.1% | 2.1% | 48 tps | 1.7s | 200K | $5.00 | $25.00 |