ChelseaKR

ChelseaKR/gauntlet

pip install gauntlet-evals · v0.1.0. Merge-blocking evaluation gates for generative AI features: YAML suites run against any HTTP endpoint or Python callable, fail the build on a miss, and emit both a diffable JSON pack and a reviewer document cross-referenced to California's published GenAI risk framework. Aligned to, never approved by.

1 good first / help-wanted issue · Python · last activity Sep 7, 2026

1 stars 0 forks 1 watchers Python Apache License 2.0
adversarial-testing ai-evaluation ai-governance bilingual california ci ci-gate civic-tech evals evaluation-framework genai github-actions groundedness guardrails llm llm-eval prompt-injection python responsible-ai risk-management
1 Open Issue Need Help Last updated: Sep 7, 2026

Open Issues Need Help

View All on GitHub
help wanted good first issue roadmap accessibility
ChelseaKR/gauntlet
1

pip install gauntlet-evals · v0.1.0. Merge-blocking evaluation gates for generative AI features: YAML suites run against any HTTP endpoint or Python callable, fail the build on a miss, and emit both a diffable JSON pack and a reviewer document cross-referenced to California's published GenAI risk framework. Aligned to, never approved by.

Python
#adversarial-testing#ai-evaluation#ai-governance#bilingual#california#ci#ci-gate#civic-tech#evals#evaluation-framework#genai#github-actions#groundedness#guardrails#llm#llm-eval#prompt-injection#python#responsible-ai#risk-management