UKGovernmentBEIS

UKGovernmentBEIS/inspect_ai

Inspect: A framework for large language model evaluations

2.5K stars 629 forks 2.5K watchers Python MIT License

View on GitHub Website

2 Open Issues Need Help Last updated: Aug 5, 2026

Open Issues Need Help

View All on GitHub

Model-graded scorers should warn at runtime when no grader model or model-role is bound (silent self-grading) 12 days ago

good first issue accepted

UKGovernmentBEIS/inspect_ai

2.5K

Inspect: A framework for large language model evaluations

Python

Improve display of grouped metrics 10 months ago

good first issue viewer

UKGovernmentBEIS/inspect_ai

2.5K

Inspect: A framework for large language model evaluations

Python