Open Issues Need Help
View All on GitHub documentation help wanted evals eval-integrity
hsaghir/looplet hsaghir/looplet Test-driven harness engineering for Python agents: own the loop, capture failures, and gate every change.
Open project →
6
Test-driven harness engineering for Python agents: own the loop, capture failures, and gate every change.
Python
#agent-evals#agent-harness#ai-agents#anthropic#asyncio#function-calling#harness-engineering#hooks#llm#llm-agent#mcp#observability#ollama#openai#provenance#pytest#python#regression-testing#testing#tool-calling
Add optional AWS Bedrock Converse backend 2 days ago
enhancement help wanted provider
hsaghir/looplet hsaghir/looplet Test-driven harness engineering for Python agents: own the loop, capture failures, and gate every change.
Open project →
6
Test-driven harness engineering for Python agents: own the loop, capture failures, and gate every change.
Python
#agent-evals#agent-harness#ai-agents#anthropic#asyncio#function-calling#harness-engineering#hooks#llm#llm-agent#mcp#observability#ollama#openai#provenance#pytest#python#regression-testing#testing#tool-calling
enhancement help wanted provider launch-ready
hsaghir/looplet hsaghir/looplet Test-driven harness engineering for Python agents: own the loop, capture failures, and gate every change.
Open project →
6
Test-driven harness engineering for Python agents: own the loop, capture failures, and gate every change.
Python
#agent-evals#agent-harness#ai-agents#anthropic#asyncio#function-calling#harness-engineering#hooks#llm#llm-agent#mcp#observability#ollama#openai#provenance#pytest#python#regression-testing#testing#tool-calling
documentation help wanted provider launch-ready
hsaghir/looplet hsaghir/looplet Test-driven harness engineering for Python agents: own the loop, capture failures, and gate every change.
Open project →
6
Test-driven harness engineering for Python agents: own the loop, capture failures, and gate every change.
Python
#agent-evals#agent-harness#ai-agents#anthropic#asyncio#function-calling#harness-engineering#hooks#llm#llm-agent#mcp#observability#ollama#openai#provenance#pytest#python#regression-testing#testing#tool-calling
enhancement help wanted evals provenance api-design
hsaghir/looplet hsaghir/looplet Test-driven harness engineering for Python agents: own the loop, capture failures, and gate every change.
Open project →
6
Test-driven harness engineering for Python agents: own the loop, capture failures, and gate every change.
Python
#agent-evals#agent-harness#ai-agents#anthropic#asyncio#function-calling#harness-engineering#hooks#llm#llm-agent#mcp#observability#ollama#openai#provenance#pytest#python#regression-testing#testing#tool-calling
documentation help wanted good first issue provenance launch-ready
hsaghir/looplet hsaghir/looplet Test-driven harness engineering for Python agents: own the loop, capture failures, and gate every change.
Open project →
6
Test-driven harness engineering for Python agents: own the loop, capture failures, and gate every change.
Python
#agent-evals#agent-harness#ai-agents#anthropic#asyncio#function-calling#harness-engineering#hooks#llm#llm-agent#mcp#observability#ollama#openai#provenance#pytest#python#regression-testing#testing#tool-calling
Define provenance and eval artifact compatibility policy about 2 months ago
help wanted evals provenance api-design launch-ready
hsaghir/looplet hsaghir/looplet Test-driven harness engineering for Python agents: own the loop, capture failures, and gate every change.
Open project →
6
Test-driven harness engineering for Python agents: own the loop, capture failures, and gate every change.
Python
#agent-evals#agent-harness#ai-agents#anthropic#asyncio#function-calling#harness-engineering#hooks#llm#llm-agent#mcp#observability#ollama#openai#provenance#pytest#python#regression-testing#testing#tool-calling
documentation help wanted evals provenance launch-ready
hsaghir/looplet hsaghir/looplet Test-driven harness engineering for Python agents: own the loop, capture failures, and gate every change.
Open project →
6
Test-driven harness engineering for Python agents: own the loop, capture failures, and gate every change.
Python
#agent-evals#agent-harness#ai-agents#anthropic#asyncio#function-calling#harness-engineering#hooks#llm#llm-agent#mcp#observability#ollama#openai#provenance#pytest#python#regression-testing#testing#tool-calling
Add a versioned JSON eval summary for CI consumers 3 months ago
enhancement help wanted evals api-design
hsaghir/looplet hsaghir/looplet Test-driven harness engineering for Python agents: own the loop, capture failures, and gate every change.
Open project →
6
Test-driven harness engineering for Python agents: own the loop, capture failures, and gate every change.
Python
#agent-evals#agent-harness#ai-agents#anthropic#asyncio#function-calling#harness-engineering#hooks#llm#llm-agent#mcp#observability#ollama#openai#provenance#pytest#python#regression-testing#testing#tool-calling
enhancement help wanted
hsaghir/looplet hsaghir/looplet Test-driven harness engineering for Python agents: own the loop, capture failures, and gate every change.
Open project →
6
Test-driven harness engineering for Python agents: own the loop, capture failures, and gate every change.
Python
#agent-evals#agent-harness#ai-agents#anthropic#asyncio#function-calling#harness-engineering#hooks#llm#llm-agent#mcp#observability#ollama#openai#provenance#pytest#python#regression-testing#testing#tool-calling
documentation enhancement help wanted
hsaghir/looplet hsaghir/looplet Test-driven harness engineering for Python agents: own the loop, capture failures, and gate every change.
Open project →
6
Test-driven harness engineering for Python agents: own the loop, capture failures, and gate every change.
Python
#agent-evals#agent-harness#ai-agents#anthropic#asyncio#function-calling#harness-engineering#hooks#llm#llm-agent#mcp#observability#ollama#openai#provenance#pytest#python#regression-testing#testing#tool-calling
enhancement help wanted good first issue
hsaghir/looplet hsaghir/looplet Test-driven harness engineering for Python agents: own the loop, capture failures, and gate every change.
Open project →
6
Test-driven harness engineering for Python agents: own the loop, capture failures, and gate every change.
Python
#agent-evals#agent-harness#ai-agents#anthropic#asyncio#function-calling#harness-engineering#hooks#llm#llm-agent#mcp#observability#ollama#openai#provenance#pytest#python#regression-testing#testing#tool-calling
Fill in missing docstrings on public symbols 6 months ago
documentation help wanted good first issue
hsaghir/looplet hsaghir/looplet Test-driven harness engineering for Python agents: own the loop, capture failures, and gate every change.
Open project →
6
Test-driven harness engineering for Python agents: own the loop, capture failures, and gate every change.
Python
#agent-evals#agent-harness#ai-agents#anthropic#asyncio#function-calling#harness-engineering#hooks#llm#llm-agent#mcp#observability#ollama#openai#provenance#pytest#python#regression-testing#testing#tool-calling
Improve error messages for common misuse 6 months ago
enhancement help wanted good first issue
hsaghir/looplet hsaghir/looplet Test-driven harness engineering for Python agents: own the loop, capture failures, and gate every change.
Open project →
6
Test-driven harness engineering for Python agents: own the loop, capture failures, and gate every change.
Python
#agent-evals#agent-harness#ai-agents#anthropic#asyncio#function-calling#harness-engineering#hooks#llm#llm-agent#mcp#observability#ollama#openai#provenance#pytest#python#regression-testing#testing#tool-calling
Add a minimal Makefile with common targets 6 months ago
enhancement help wanted good first issue
hsaghir/looplet hsaghir/looplet Test-driven harness engineering for Python agents: own the loop, capture failures, and gate every change.
Open project →
6
Test-driven harness engineering for Python agents: own the loop, capture failures, and gate every change.
Python
#agent-evals#agent-harness#ai-agents#anthropic#asyncio#function-calling#harness-engineering#hooks#llm#llm-agent#mcp#observability#ollama#openai#provenance#pytest#python#regression-testing#testing#tool-calling
Ship reusable eval recipes as looplet.evals.recipes 6 months ago
enhancement help wanted good first issue
hsaghir/looplet hsaghir/looplet Test-driven harness engineering for Python agents: own the loop, capture failures, and gate every change.
Open project →
6
Test-driven harness engineering for Python agents: own the loop, capture failures, and gate every change.
Python
#agent-evals#agent-harness#ai-agents#anthropic#asyncio#function-calling#harness-engineering#hooks#llm#llm-agent#mcp#observability#ollama#openai#provenance#pytest#python#regression-testing#testing#tool-calling
Write a "why not LangGraph" FAQ entry 6 months ago
documentation help wanted good first issue
hsaghir/looplet hsaghir/looplet Test-driven harness engineering for Python agents: own the loop, capture failures, and gate every change.
Open project →
6
Test-driven harness engineering for Python agents: own the loop, capture failures, and gate every change.
Python
#agent-evals#agent-harness#ai-agents#anthropic#asyncio#function-calling#harness-engineering#hooks#llm#llm-agent#mcp#observability#ollama#openai#provenance#pytest#python#regression-testing#testing#tool-calling