Git-native regression testing for LLM agent tool loops. Assert on the trajectory — the ordered tool calls — not the final prose. Local-first, deterministic, no API key in CI; exit codes are the API.

agent-testing anthropic ci cli evals llm llm-agents openai python regression-testing testing tool-calling
3 Open Issues Need Help Last updated: Aug 3, 2026

Open Issues Need Help

View All on GitHub
enhancement good first issue provider

Git-native regression testing for LLM agent tool loops. Assert on the trajectory — the ordered tool calls — not the final prose. Local-first, deterministic, no API key in CI; exit codes are the API.

Python
#agent-testing#anthropic#ci#cli#evals#llm#llm-agents#openai#python#regression-testing#testing#tool-calling
Provider: add GLM (Zhipu) about 2 hours ago
enhancement good first issue provider

Git-native regression testing for LLM agent tool loops. Assert on the trajectory — the ordered tool calls — not the final prose. Local-first, deterministic, no API key in CI; exit codes are the API.

Python
#agent-testing#anthropic#ci#cli#evals#llm#llm-agents#openai#python#regression-testing#testing#tool-calling
Provider: add DeepSeek about 2 hours ago
enhancement good first issue provider

Git-native regression testing for LLM agent tool loops. Assert on the trajectory — the ordered tool calls — not the final prose. Local-first, deterministic, no API key in CI; exit codes are the API.

Python
#agent-testing#anthropic#ci#cli#evals#llm#llm-agents#openai#python#regression-testing#testing#tool-calling