Open Issues Need Help
View All on GitHub progress=True on process_prompts() about 2 months ago
enhancement good first issue
geoff-davis/async-batch-llm geoff-davis/async-batch-llm Provider-agnostic framework for high-throughput LLM processing with async workers, automatic retries, rate limiting, and intelligent validation recovery.
Open project →
1
Provider-agnostic framework for high-throughput LLM processing with async workers, automatic retries, rate limiting, and intelligent validation recovery.
Python
#ai#asyncio#batch-processing#checkpointing#concurrency#deepseek#fault-tolerance#gemini#llm#llm-orchestration#llmops#observability#openai#openrouter#parallel-processing#pydantic-ai#python#rate-limiting#retry#streaming