Mesh-LLM/mesh-llm

MoA gateway: idle-worker judges for early hedging + hint-carrying retries about 3 hours ago

help wanted

Mesh-LLM/mesh-llm

1.3K

Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.

Rust

#agents#ai#decentralized#distributed#llm

huggingface PKCE auth to get token 22 days ago

enhancement help wanted

Mesh-LLM/mesh-llm

1.3K

Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.

Rust

#agents#ai#decentralized#distributed#llm

Finish binary native runtime SDK distribution about 1 month ago

help wanted

Mesh-LLM/mesh-llm

1.3K

Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.

Rust

#agents#ai#decentralized#distributed#llm

skippy: 'decode: failed to find a memory slot for batch of size 2048' on goose/pi after a few tool-laden turns about 1 month ago

help wanted

Mesh-LLM/mesh-llm

1.3K

Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.

Rust

#agents#ai#decentralized#distributed#llm

TODO: write a hermes-side mesh-llm provider (openai-compat with mesh + MoA) about 1 month ago

help wanted

Mesh-LLM/mesh-llm

1.3K

Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.

Rust

#agents#ai#decentralized#distributed#llm

TODO: test pi harness more thoroughly with MoA (mesh model) about 1 month ago

help wanted

Mesh-LLM/mesh-llm

1.3K

Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.

Rust

#agents#ai#decentralized#distributed#llm

openai-frontend: chat_template_kwargs.enable_thinking / reasoning_effort='none' not honored on direct model calls about 1 month ago

help wanted

Mesh-LLM/mesh-llm

1.3K

Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.

Rust

#agents#ai#decentralized#distributed#llm

Have peers advertise their observed tokens-per-second through gossip about 1 month ago

help wanted

Mesh-LLM/mesh-llm

1.3K

Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.

Rust

#agents#ai#decentralized#distributed#llm

publish_crates job will fail on v0.66.0 GA: mesh-llm-client has path-only workspace deps about 1 month ago

help wanted

Mesh-LLM/mesh-llm

1.3K

Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.

Rust

#agents#ai#decentralized#distributed#llm

MoA: stream the winning worker's tokens instead of one-shot delta about 1 month ago

help wanted

Mesh-LLM/mesh-llm

1.3K

Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.

Rust

#agents#ai#decentralized#distributed#llm

auto-router: model-level fallback when top-pick model has no eligible peers about 1 month ago

help wanted

Mesh-LLM/mesh-llm

1.3K

Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.

Rust

#agents#ai#decentralized#distributed#llm

Console shows 0.0 tok/s for mesh (MoA) — usage hardcoded to zero, timings never emitted about 1 month ago

help wanted

Mesh-LLM/mesh-llm

1.3K

Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.

Rust

#agents#ai#decentralized#distributed#llm

After #600 lands: rank routing candidates by gossiped tok/s about 1 month ago

help wanted

Mesh-LLM/mesh-llm

1.3K

Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.

Rust

#agents#ai#decentralized#distributed#llm

MoA: fast worker shouldn't think — thinking models can poison fan-out and leak reasoning to chat about 1 month ago

help wanted

Mesh-LLM/mesh-llm

1.3K

Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.

Rust

#agents#ai#decentralized#distributed#llm

llama.cpp upstream canary failing nightly: patch 0009 (Qwen35MoE) needs rebase against current upstream about 1 month ago

bug help wanted

Mesh-LLM/mesh-llm

1.3K

Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.

Rust

#agents#ai#decentralized#distributed#llm

Skippy: return reasoning_content for thinking models about 2 months ago

enhancement help wanted

Mesh-LLM/mesh-llm

1.3K

Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.

Rust

#agents#ai#decentralized#distributed#llm

[feat] bind-ip about 2 months ago

help wanted

Mesh-LLM/mesh-llm

1.3K

Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.

Rust

#agents#ai#decentralized#distributed#llm

Open Issues Need Help