What problem does it solve?
Orchestrates and connects multiple mesh-llm nodes into a cohesive mesh, enabling private deployments with invite tokens, joining public meshes via auto-discovery, and managing named or published meshes across diverse networks.
Core Features & Use Cases
- Private meshes: create and join with invite tokens; publish for discovery (mesh-name) and cross-network collaboration.
- Public mesh & client roles: auto-join best public mesh, API clients-only nodes, and dual-role deployments.
- Networking and routing: NAT/firewall traversal, LAN mdns, iroh relay-assisted discovery, and unified OpenAI-compatible API routing on port 9337.
- Verification and visibility: status endpoints to confirm mesh composition and model availability across peers.
Quick Start
Start two mesh-llm nodes and form a private mesh with an invite token or join the public mesh with --auto.