hermes-labs-ai

hermes-labs-ai/hermes-rubric

Evidence-first LLM-as-judge scoring for AI artifacts — papers, PRs, prompts, cold emails: synthesizes a rubric, collects quoted-evidence citations, scores only against that evidence, and hedges on thin evidence. Every dimension ties to a file:line or quote, with reproducibility receipts. 7 backends.

2 good first / help-wanted issues · Python · last activity Sep 30, 2026

2 stars 2 forks 2 watchers Python Apache License 2.0
agent-skills ai-agents ai-audit ai-reliability ai-safety citations cli evals evidence-first hermes-labs llm llm-as-judge llm-evaluation llm-judge prompt-engineering python reproducibility structured-scoring
2 Open Issues Need Help Last updated: Sep 30, 2026

Open Issues Need Help

View All on GitHub
hermes-labs-ai/hermes-rubric
2

Evidence-first LLM-as-judge scoring for AI artifacts — papers, PRs, prompts, cold emails: synthesizes a rubric, collects quoted-evidence citations, scores only against that evidence, and hedges on thin evidence. Every dimension ties to a file:line or quote, with reproducibility receipts. 7 backends.

Python
#agent-skills#ai-agents#ai-audit#ai-reliability#ai-safety#citations#cli#evals#evidence-first#hermes-labs#llm#llm-as-judge#llm-evaluation#llm-judge#prompt-engineering#python#reproducibility#structured-scoring
hermes-labs-ai/hermes-rubric
2

Evidence-first LLM-as-judge scoring for AI artifacts — papers, PRs, prompts, cold emails: synthesizes a rubric, collects quoted-evidence citations, scores only against that evidence, and hedges on thin evidence. Every dimension ties to a file:line or quote, with reproducibility receipts. 7 backends.

Python
#agent-skills#ai-agents#ai-audit#ai-reliability#ai-safety#citations#cli#evals#evidence-first#hermes-labs#llm#llm-as-judge#llm-evaluation#llm-judge#prompt-engineering#python#reproducibility#structured-scoring