mesh-llm good first issues (Rust)

MoA gateway: idle-worker judges for early hedging + hint-carrying retries 4 days ago

help wanted component: runtime

Mesh-LLM/mesh-llm

1.3K

Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.

Rust

#agents#ai#decentralized#distributed#llm

Serve one loaded model to multiple independent meshes 15 days ago

enhancement help wanted spec component: runtime

Mesh-LLM/mesh-llm

1.3K

Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.

Rust

#agents#ai#decentralized#distributed#llm

huggingface PKCE auth to get token 28 days ago

enhancement help wanted component: cli

Mesh-LLM/mesh-llm

1.3K

Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.

Rust

#agents#ai#decentralized#distributed#llm

TODO: write a hermes-side mesh-llm provider (openai-compat with mesh + MoA) 28 days ago

help wanted component: cli

Mesh-LLM/mesh-llm

1.3K

Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.

Rust

#agents#ai#decentralized#distributed#llm

TODO: test pi harness more thoroughly with MoA (mesh model) 28 days ago

help wanted component: cli

Mesh-LLM/mesh-llm

1.3K

Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.

Rust

#agents#ai#decentralized#distributed#llm

Finish binary native runtime SDK distribution 5 months ago

help wanted

Mesh-LLM/mesh-llm

1.3K

Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.

Rust

#agents#ai#decentralized#distributed#llm

skippy: 'decode: failed to find a memory slot for batch of size 2048' on goose/pi after a few tool-laden turns 5 months ago

help wanted

Mesh-LLM/mesh-llm

1.3K

Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.

Rust

#agents#ai#decentralized#distributed#llm

openai-frontend: chat_template_kwargs.enable_thinking / reasoning_effort='none' not honored on direct model calls 5 months ago

help wanted

Mesh-LLM/mesh-llm

1.3K

Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.

Rust

#agents#ai#decentralized#distributed#llm

Have peers advertise their observed tokens-per-second through gossip 5 months ago

help wanted

Mesh-LLM/mesh-llm

1.3K

Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.

Rust

#agents#ai#decentralized#distributed#llm

publish_crates job will fail on v0.66.0 GA: mesh-llm-client has path-only workspace deps 5 months ago

help wanted

Mesh-LLM/mesh-llm

1.3K

Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.

Rust

#agents#ai#decentralized#distributed#llm

MoA: stream the winning worker's tokens instead of one-shot delta 5 months ago

help wanted

Mesh-LLM/mesh-llm

1.3K

Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.

Rust

#agents#ai#decentralized#distributed#llm

auto-router: model-level fallback when top-pick model has no eligible peers 5 months ago

help wanted

Mesh-LLM/mesh-llm

1.3K

Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.

Rust

#agents#ai#decentralized#distributed#llm

Console shows 0.0 tok/s for mesh (MoA) — usage hardcoded to zero, timings never emitted 5 months ago

help wanted

Mesh-LLM/mesh-llm

1.3K

Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.

Rust

#agents#ai#decentralized#distributed#llm

After #600 lands: rank routing candidates by gossiped tok/s 5 months ago

help wanted

Mesh-LLM/mesh-llm

1.3K

Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.

Rust

#agents#ai#decentralized#distributed#llm

MoA: fast worker shouldn't think — thinking models can poison fan-out and leak reasoning to chat 5 months ago

help wanted

Mesh-LLM/mesh-llm

1.3K

Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.

Rust

#agents#ai#decentralized#distributed#llm

llama.cpp upstream canary failing nightly: patch 0009 (Qwen35MoE) needs rebase against current upstream 5 months ago

bug help wanted

Mesh-LLM/mesh-llm

1.3K

Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.

Rust

#agents#ai#decentralized#distributed#llm

Skippy: return reasoning_content for thinking models 5 months ago

enhancement help wanted

Mesh-LLM/mesh-llm

1.3K

Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.

Rust

#agents#ai#decentralized#distributed#llm

[feat] bind-ip 6 months ago

help wanted

Mesh-LLM/mesh-llm

1.3K

Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.

Rust

#agents#ai#decentralized#distributed#llm

Mesh-LLM/mesh-llm

Open Issues Need Help