I'm trying to post-train AliceAI-Foundation-80B-A3B-Base myself
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
| | Just wanted to share with someone - don't have much to report yet. I am interested in this new AliceAI model and have been wanting to make a community impact for a while - and releasing an initial agentic version of this model sounds cool. I am training on 3 32gb v100s (which has been fun to get to work, to say the least). What I'm really doing is creating a shallow distill of Qwen 3.8 27b and then using reinforcement learning - My initial plan is a SFT with Qwen3.8 27b synthetic data I'm generating targeting long horizon agentic work - then, RL / GRPO with a grader model for a while. I'm considering using a stronger model to generate the training data, but I'm trying to keep this on my local machine only. It's coming along - I can just barely fit the weights and activations on the v100s in qlora. I've built the framework for the SFT data generation for. I don't expect anything amazing but it should be a neat experiment. Also considering using a pre-existing data set for the tune, but I'm more interested in creating my own distillation. Update: it's training! [link] [comments] |
More from r/LocalLLaMA
-
Europe rejoins the fight with Chonky! Mistral Large 4 Released, Open weights end of month, who’s ready?
Oct 6
-
How abliterated models can get you pwned
Oct 6
-
Local AI World Model Part 2 - Deep NN to turn Images into Playable Characters, with prompt switching mid rollout
Oct 6
-
GPT-6.1 Sol looped "leak" hints at nested models serving architecture
Oct 6
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.