r/LocalLLaMA · · 1 min read

Built a 6x cheaper CodeRabbit alternative using open source models

Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.

Built a 6x cheaper CodeRabbit alternative using open source models

Coderabbit apparently uses GPT + Claude models to review PRs and it costed $60/month.

So I grabbed a friend and made a alternative which does the same things but uses open source models as backend instead( because inference costs are wayyyy cheaper)

We tested it on a PR containing 10 intentionally planted issues.

https://preview.redd.it/3j9qt4mruh1h1.png?width=846&format=png&auto=webp&s=3e9fa3559b315d09b8c65e2324165e412ac325b4

https://preview.redd.it/2c9qb4mruh1h1.png?width=842&format=png&auto=webp&s=7d0bf9296639ef5bedd915869043755b5610a73a

and the result?
~detected all 10/10 issues
~much faster and accurate
~has the ability to auto fix
~has almost all the features that coderabbit offers including a prompt to fix the bug using AI agents
~practically infinite reviews at 6x less prize

This made me think that are the Chinese models really that ahead of the curve while also being open sourced as well or did we really just managed to create a better review architecture than a 550 million$ company.

Full pr: https://github.com/testingPrix/TestRepo/pull/2

We have done tests even with 11k line PRs and PrixAI manages to be scarily accurate.

Would genuinely appreciate feedback, criticism, or suggestions from the community. Our Cactopus might go all out against the big rabbit.

submitted by /u/Axintwo
[link] [comments]

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from r/LocalLLaMA