Open Issues Need Help
View All on GitHubDistributed expert cache for large MoE inference: swarm-shared GGUF weights, node-local compute, gossip discovery, OpenAI-compatible API. One static Zig binary with Metal/Vulkan backends.
Distributed expert cache for large MoE inference: swarm-shared GGUF weights, node-local compute, gossip discovery, OpenAI-compatible API. One static Zig binary with Metal/Vulkan backends.
Distributed expert cache for large MoE inference: swarm-shared GGUF weights, node-local compute, gossip discovery, OpenAI-compatible API. One static Zig binary with Metal/Vulkan backends.