Distributed expert cache for large MoE inference: swarm-shared GGUF weights, node-local compute, gossip discovery, OpenAI-compatible API. One static Zig binary with Metal/Vulkan backends.

0 stars 0 forks 0 watchers Zig Apache License 2.0
distributed-systems gguf gossip-protocol inference-engine llm-inference metal mixture-of-experts moe openai-api p2p vulkan zig
3 Open Issues Need Help Last updated: Aug 1, 2026

Open Issues Need Help

View All on GitHub
good first issue security

Distributed expert cache for large MoE inference: swarm-shared GGUF weights, node-local compute, gossip discovery, OpenAI-compatible API. One static Zig binary with Metal/Vulkan backends.

Zig
#distributed-systems#gguf#gossip-protocol#inference-engine#llm-inference#metal#mixture-of-experts#moe#openai-api#p2p#vulkan#zig

Distributed expert cache for large MoE inference: swarm-shared GGUF weights, node-local compute, gossip discovery, OpenAI-compatible API. One static Zig binary with Metal/Vulkan backends.

Zig
#distributed-systems#gguf#gossip-protocol#inference-engine#llm-inference#metal#mixture-of-experts#moe#openai-api#p2p#vulkan#zig

Distributed expert cache for large MoE inference: swarm-shared GGUF weights, node-local compute, gossip discovery, OpenAI-compatible API. One static Zig binary with Metal/Vulkan backends.

Zig
#distributed-systems#gguf#gossip-protocol#inference-engine#llm-inference#metal#mixture-of-experts#moe#openai-api#p2p#vulkan#zig