Evaluation and Tracking for LLM Experiments and AI Agents

agent-evaluation agentops ai-agents ai-monitoring ai-observability evals explainable-ml llm-eval llm-evaluation llmops llms machine-learning neural-networks
70 Open Issues Need Help Last updated: Jul 6, 2026

Open Issues Need Help

View All on GitHub
enhancement help wanted

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
enhancement help wanted LLM Judge Providers

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
enhancement help wanted

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
enhancement help wanted Metric Implementations

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
enhancement good first issue help wanted

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
enhancement help wanted Examples

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
documentation good first issue Examples CI/CD

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
enhancement good first issue help wanted

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
enhancement help wanted

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
enhancement help wanted

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
enhancement help wanted

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
documentation good first issue Examples

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
enhancement help wanted

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
documentation good first issue Examples

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
enhancement good first issue help wanted

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
good first issue help wanted

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
enhancement good first issue help wanted

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
documentation enhancement good first issue Examples CI/CD

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
documentation enhancement good first issue Examples CI/CD

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
documentation enhancement good first issue Examples CI/CD

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
documentation good first issue Examples CI/CD

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
documentation good first issue

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
enhancement good first issue help wanted

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
enhancement good first issue help wanted

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
enhancement good first issue

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
enhancement good first issue help wanted

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
enhancement good first issue

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
enhancement good first issue help wanted

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
enhancement good first issue

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
enhancement help wanted

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
enhancement help wanted

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
enhancement good first issue

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
enhancement good first issue

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
enhancement good first issue help wanted

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
enhancement help wanted

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
enhancement good first issue help wanted

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
enhancement good first issue help wanted

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
enhancement good first issue help wanted

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
enhancement help wanted Integrations

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
enhancement help wanted Integrations

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
enhancement help wanted Integrations

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
enhancement help wanted Integrations

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
enhancement help wanted LLM Judge Providers

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
documentation enhancement help wanted

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
enhancement help wanted Integrations

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
documentation good first issue Agent Skills

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
enhancement good first issue Metric Implementations

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
enhancement help wanted Agent Skills

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
enhancement help wanted Examples

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
documentation good first issue Examples

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
documentation help wanted Website

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
enhancement help wanted Integrations

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
enhancement help wanted Dashboard

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
enhancement help wanted Dashboard

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
help wanted Examples

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
documentation good first issue

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
documentation good first issue

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
documentation good first issue

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
documentation good first issue

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
enhancement help wanted LLM Judge Providers

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks
enhancement help wanted LLM Judge Providers

Evaluation and Tracking for LLM Experiments and AI Agents

Python
#agent-evaluation#agentops#ai-agents#ai-monitoring#ai-observability#evals#explainable-ml#llm-eval#llm-evaluation#llmops#llms#machine-learning#neural-networks