tokio-prompt-orchestrator good first issues (Rust)

Upgrade async-nats to clear rustls-webpki advisories (needs MSRV decision) 30 days ago

help wanted good first issue

57

Tokio pipeline for serving LLM requests: bounded five-stage flow with dedup, circuit breakers, retries, rate limits and a dead-letter queue in front of Anthropic, OpenAI, llama.cpp or vLLM. REST, SSE, MCP, TUI.

Rust

#agent#anthropic#async#backpressure#circuit-breaker#llm#llm-serving#mcp#model-context-protocol#multi-agent#openai#orchestration#rate-limiting#rust#tokio

Turn ignored README snippets into compiling doctests 30 days ago

documentation good first issue

Mattbusel/tokio-prompt-orchestrator

57

Tokio pipeline for serving LLM requests: bounded five-stage flow with dedup, circuit breakers, retries, rate limits and a dead-letter queue in front of Anthropic, OpenAI, llama.cpp or vLLM. REST, SSE, MCP, TUI.

Rust

#agent#anthropic#async#backpressure#circuit-breaker#llm#llm-serving#mcp#model-context-protocol#multi-agent#openai#orchestration#rate-limiting#rust#tokio

Add a Retriever trait so the RAG stage can call real retrieval 30 days ago

enhancement good first issue

Mattbusel/tokio-prompt-orchestrator

57

Tokio pipeline for serving LLM requests: bounded five-stage flow with dedup, circuit breakers, retries, rate limits and a dead-letter queue in front of Anthropic, OpenAI, llama.cpp or vLLM. REST, SSE, MCP, TUI.

Rust

#agent#anthropic#async#backpressure#circuit-breaker#llm#llm-serving#mcp#model-context-protocol#multi-agent#openai#orchestration#rate-limiting#rust#tokio

Dockerfile does not build a working image 30 days ago

bug good first issue

Mattbusel/tokio-prompt-orchestrator

57

Tokio pipeline for serving LLM requests: bounded five-stage flow with dedup, circuit breakers, retries, rate limits and a dead-letter queue in front of Anthropic, OpenAI, llama.cpp or vLLM. REST, SSE, MCP, TUI.

Rust

#agent#anthropic#async#backpressure#circuit-breaker#llm#llm-serving#mcp#model-context-protocol#multi-agent#openai#orchestration#rate-limiting#rust#tokio

Mattbusel/tokio-prompt-orchestrator

Open Issues Need Help