50+ Hours and 100M+ Tokens Later, Open Source Autonomous Agent is GETTING CLOSER at Solving an Open Math problem

This experiment is live, you can inspect all the internal reasoning, memories, attempts here: https://artificium-covering-experiment.gr.bio/

The problem that the agent is trying to solve is a covering design problem: https://en.wikipedia.org/wiki/Covering_design

Known as C(25,15,5), the best current solution uses 42 groups, the open problem is finding a better solution, the current goal is achieving 41 groups.

The reason I picked this experiment is because it's very simple to Verify whether a solution is correct or not. The website has a real time checker that would independently verify whether the solution is correct or not.

So far has been running for 52+ hours and has processed 106,406,666 tokens.

Because of the harness created for Autonomous work and Continual learning, it always tries new approaches and learns from mistakes: https://github.com/officialgr/agent-artificium

You can see it's public notes or inspect the internal reasoning, memories and life-loop.

As you can see since the beginning it is always finding better and better solutions, right now it's best solution is 44, if it manages to get to 41 this would be the first time an open source agent makes a research breakthrough in mathematics.

I believe that if an open source agent (open source model + harness) manages to solve this problem it would be a great moment for local open source AI since the entire experiment can be reproduced on consumer hardware (I'm using a 5090 on runpod but can be done on a 3090 since it's powered by qwen 27B 3.8)

If you like this experiment and share my vision for open source autonomous research please consider supporting me with a donation or compute, also if you are a company and would like to collab/sponsor you can find my email at gr.bio