r/LocalLLaMA · · 1 min read

My issue with Artificial Analysis's 'intelligence index'

Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.

I swear AA is not the bipartisan they so claim. An open source mode (Qwen 3.8 max) was number 1 on the agentic index, then they just so happen to launch "v4.1.1" of their index in which they just adjusted the weights of the gdpval and t3 banking so that it would be lower than opus, despite the lead in t3 being a 8% lead over opus while opus only has a 5% lead on gdpval. Highly likely to be paid off imo. You can check other subreddits for the score before and after the change, just made it so an open source model would lost and anthropic would continue being number one

submitted by /u/Infinite-Local5435
[link] [comments]

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from r/LocalLLaMA