deyna256

deyna256/convy

Conversation tests for AI agents: a simulated user talks to your agent through its API, a judge checks every claim, and convy reports pass rate, tokens, time and what changed between builds.

5 good first / help-wanted issues · Python · last activity Oct 8, 2026

agent-evaluation ai-agents chatbot-testing cli conversational-ai llm llm-as-a-judge llm-evaluation python simulated-user testing
5 Open Issues Need Help Last updated: Oct 8, 2026

Open Issues Need Help

View All on GitHub
good first issue docs
deyna256/convy
2

Conversation tests for AI agents: a simulated user talks to your agent through its API, a judge checks every claim, and convy reports pass rate, tokens, time and what changed between builds.

Python
#agent-evaluation#ai-agents#chatbot-testing#cli#conversational-ai#llm#llm-as-a-judge#llm-evaluation#python#simulated-user#testing
bug good first issue
deyna256/convy
2

Conversation tests for AI agents: a simulated user talks to your agent through its API, a judge checks every claim, and convy reports pass rate, tokens, time and what changed between builds.

Python
#agent-evaluation#ai-agents#chatbot-testing#cli#conversational-ai#llm#llm-as-a-judge#llm-evaluation#python#simulated-user#testing
deyna256/convy
2

Conversation tests for AI agents: a simulated user talks to your agent through its API, a judge checks every claim, and convy reports pass rate, tokens, time and what changed between builds.

Python
#agent-evaluation#ai-agents#chatbot-testing#cli#conversational-ai#llm#llm-as-a-judge#llm-evaluation#python#simulated-user#testing
bug good first issue
deyna256/convy
2

Conversation tests for AI agents: a simulated user talks to your agent through its API, a judge checks every claim, and convy reports pass rate, tokens, time and what changed between builds.

Python
#agent-evaluation#ai-agents#chatbot-testing#cli#conversational-ai#llm#llm-as-a-judge#llm-evaluation#python#simulated-user#testing
deyna256/convy
2

Conversation tests for AI agents: a simulated user talks to your agent through its API, a judge checks every claim, and convy reports pass rate, tokens, time and what changed between builds.

Python
#agent-evaluation#ai-agents#chatbot-testing#cli#conversational-ai#llm#llm-as-a-judge#llm-evaluation#python#simulated-user#testing