Verified agentic AI evaluation labs: 70 runnable use cases, seeded scenarios, real-model results, costs, and observed failures.

4 stars 1 forks 4 watchers Python Apache License 2.0
agent-evaluation agentic-ai agentic-workflows ai-agents ai-safety awesome-list benchmarks llm-agents llm-evaluation python reproducible-research responsible-ai
5 Open Issues Need Help Last updated: Aug 13, 2026

Open Issues Need Help

View All on GitHub
good first issue challenge adapt

Verified agentic AI evaluation labs: 70 runnable use cases, seeded scenarios, real-model results, costs, and observed failures.

Python
#agent-evaluation#agentic-ai#agentic-workflows#ai-agents#ai-safety#awesome-list#benchmarks#llm-agents#llm-evaluation#python#reproducible-research#responsible-ai
good first issue challenge break

Verified agentic AI evaluation labs: 70 runnable use cases, seeded scenarios, real-model results, costs, and observed failures.

Python
#agent-evaluation#agentic-ai#agentic-workflows#ai-agents#ai-safety#awesome-list#benchmarks#llm-agents#llm-evaluation#python#reproducible-research#responsible-ai
good first issue challenge break

Verified agentic AI evaluation labs: 70 runnable use cases, seeded scenarios, real-model results, costs, and observed failures.

Python
#agent-evaluation#agentic-ai#agentic-workflows#ai-agents#ai-safety#awesome-list#benchmarks#llm-agents#llm-evaluation#python#reproducible-research#responsible-ai
good first issue challenge reproduce

Verified agentic AI evaluation labs: 70 runnable use cases, seeded scenarios, real-model results, costs, and observed failures.

Python
#agent-evaluation#agentic-ai#agentic-workflows#ai-agents#ai-safety#awesome-list#benchmarks#llm-agents#llm-evaluation#python#reproducible-research#responsible-ai
good first issue challenge reproduce

Verified agentic AI evaluation labs: 70 runnable use cases, seeded scenarios, real-model results, costs, and observed failures.

Python
#agent-evaluation#agentic-ai#agentic-workflows#ai-agents#ai-safety#awesome-list#benchmarks#llm-agents#llm-evaluation#python#reproducible-research#responsible-ai