Simple Multi-Agent Architecture Running Across Our Entire Org. Keeping everything in Loop.
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
Currently, we're running agents at org scale. There were multiple problems we faced, like the credential problem, the state problem, and the execution trace problem, during our initial days but we overcame it & here's our simplified architecture.
Our setup runs three agent classes against a shared context layer. Observer agents sit at the edge pulling in external signals and writing structured events. Task agents pick up work from that stream, execute bounded actions, and write results back. Goal agents read the full execution history, build plans, sequence task agents, and re-plan when conditions shift.
LangGraph handles the goal agent layer. The stateful graph structure maps to how goal agents work: conditional branching, checkpointed state, and the ability to resume mid-plan when a task agent fails or returns a partial result. Hand-rolling that logic is how you end up with orchestration code nobody wants to touch six months later.
CrewAI handles task coordination. Role-based agent assignment with shared short-term and long-term memory, plus a planning agent that sequences tasks before execution starts. The crew model maps closely enough to the task-oriented agent class that we use it without custom scaffolding.
Harbor sits underneath all of it. Every agent in the fleet gets scoped access to tools, files, and workflows through Harbor's workspace model. Credentials stay in Harbor, not in model context. Every tool call produces a trace. When an agent calls a database, hits an external API, or triggers a downstream workflow, that action is logged with full provenance. At fleet scale, that trace layer is what lets you debug a failure in under an hour instead of a day.
The ring-based protocol governs message routing on top of this. Kernel agents at Ring 0 manage agent lifecycle. Orchestrators at Ring 1 route messages by agent metadata and classification. Goal agents at Ring 2 decompose intents into task plans. Task agents at Ring 3 execute with least privilege. Observer agents at Ring 4 run continuously, posting events without making decisions.
As the shared conversation deepens, newer agents start with a richer operational history than earlier ones did. Our best thing is that the coordination overhead per agent drops as the history grows.
[link] [comments]
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.