Introducing BetterBench - more accurate PP and TPS measurement
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
| I built this because the existing benchmarks were using random data and with MTP content types can vary a lot on what performance you see. 5% or more with content types. BetterBench is designed to have content consistency within 1% and also measures across different content types. Here are the results running Qwen3.6 27B FP8 on dual R9700's for example: You can find the repo here: [link] [comments] |
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.