Need real world ML problems to evaluate my educational ML tools
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
I'm a retired platform engineer, coding mainly in Rust, and involved with a ML study group.
I developed a ML programming language (alternative to Python, Colab) to help me learn (and teach) ML concepts, visually. It has slowly grown to demonstrate a lot of concepts.
It can do training on CPU (in browser) or on Apple Silicon via MLX, or NVIDIA hardware via CUDA so far.
My goal is to train local model coding agents to get better (learn my style, my process, my tools, follow best practices, learn from mistakes, and collaborate).
I have an idea of how to do this, and I've built many different tools to help with this, but have not actually gotten to the point where a local LLM can demonstrably and measurably improve. I've been very recently adding a lot of general purpose (array) programming language features (and functional programming) to make the language better for training and evaluation (and visualization). I plan to focus on ICL and ICRL (maybe XSkills) before I get deeper into fine-tuning. Looking for someone to talk to about this (other than cloud AIs).
My live browser demo shows CPU only demos. you need to install the Rust repos and run a server on a system with either Apple Silicon or NVIDIA GPUs (and that unlocks more in the connected UI, but mainly for CLI REPL and scripting at that point). The UI can optionally, when connected via my server, use an Ollama model to explain things (like Gemini in Colab).
I develop on Mac and Linux (Arch BTW) mainly, but have fixed Windows bugs upon request. What are people using to train local models?
[link] [comments]
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.