iris-eval

iris-eval/mcp-server

The agent eval standard for MCP — score output quality, catch safety failures, enforce cost budgets

8 good first / help-wanted issues · TypeScript · last activity Aug 12, 2026

7 stars 2 forks 7 watchers TypeScript MIT License
agent-evaluation ai-agent claude eval evaluation llm mcp mcp-server model-context-protocol observability security tracing
8 Open Issues Need Help Last updated: Aug 12, 2026

Open Issues Need Help

View All on GitHub
enhancement good first issue effort: medium dashboard P3
iris-eval/mcp-server
7

The agent eval standard for MCP — score output quality, catch safety failures, enforce cost budgets

TypeScript
#agent-evaluation#ai-agent#claude#eval#evaluation#llm#mcp#mcp-server#model-context-protocol#observability#security#tracing
enhancement good first issue effort: large dashboard
iris-eval/mcp-server
7

The agent eval standard for MCP — score output quality, catch safety failures, enforce cost budgets

TypeScript
#agent-evaluation#ai-agent#claude#eval#evaluation#llm#mcp#mcp-server#model-context-protocol#observability#security#tracing
enhancement good first issue effort: large
iris-eval/mcp-server
7

The agent eval standard for MCP — score output quality, catch safety failures, enforce cost budgets

TypeScript
#agent-evaluation#ai-agent#claude#eval#evaluation#llm#mcp#mcp-server#model-context-protocol#observability#security#tracing
enhancement good first issue effort: medium
iris-eval/mcp-server
7

The agent eval standard for MCP — score output quality, catch safety failures, enforce cost budgets

TypeScript
#agent-evaluation#ai-agent#claude#eval#evaluation#llm#mcp#mcp-server#model-context-protocol#observability#security#tracing
enhancement good first issue effort: large
iris-eval/mcp-server
7

The agent eval standard for MCP — score output quality, catch safety failures, enforce cost budgets

TypeScript
#agent-evaluation#ai-agent#claude#eval#evaluation#llm#mcp#mcp-server#model-context-protocol#observability#security#tracing
enhancement good first issue effort: small
iris-eval/mcp-server
7

The agent eval standard for MCP — score output quality, catch safety failures, enforce cost budgets

TypeScript
#agent-evaluation#ai-agent#claude#eval#evaluation#llm#mcp#mcp-server#model-context-protocol#observability#security#tracing
enhancement good first issue effort: small
iris-eval/mcp-server
7

The agent eval standard for MCP — score output quality, catch safety failures, enforce cost budgets

TypeScript
#agent-evaluation#ai-agent#claude#eval#evaluation#llm#mcp#mcp-server#model-context-protocol#observability#security#tracing
enhancement good first issue effort: small
iris-eval/mcp-server
7

The agent eval standard for MCP — score output quality, catch safety failures, enforce cost budgets

TypeScript
#agent-evaluation#ai-agent#claude#eval#evaluation#llm#mcp#mcp-server#model-context-protocol#observability#security#tracing