Arize-ai

Arize-ai/phoenix

AI Observability & Evaluation

20 good first / help-wanted issues · Python · last activity Jul 10, 2026

agents ai-monitoring ai-observability aiengineering anthropic datasets evals langchain llamaindex llm-eval llm-evaluation llmops llms openai prompt-engineering smolagents
20 Open Issues Need Help Last updated: Jul 10, 2026

Open Issues Need Help

View All on GitHub
enhancement help wanted backlog c/infra
Arize-ai/phoenix
10.5K

AI Observability & Evaluation

Python
#agents#ai-monitoring#ai-observability#aiengineering#anthropic#datasets#evals#langchain#llamaindex#llm-eval#llm-evaluation#llmops#llms#openai#prompt-engineering#smolagents
enhancement help wanted backlog c/experiments c/usability
Arize-ai/phoenix
10.5K

AI Observability & Evaluation

Python
#agents#ai-monitoring#ai-observability#aiengineering#anthropic#datasets#evals#langchain#llamaindex#llm-eval#llm-evaluation#llmops#llms#openai#prompt-engineering#smolagents
enhancement good first issue c/dx good-agent-issue c/cli
Arize-ai/phoenix
10.5K

AI Observability & Evaluation

Python
#agents#ai-monitoring#ai-observability#aiengineering#anthropic#datasets#evals#langchain#llamaindex#llm-eval#llm-evaluation#llmops#llms#openai#prompt-engineering#smolagents
good first issue backlog javascript
Arize-ai/phoenix
10.5K

AI Observability & Evaluation

Python
#agents#ai-monitoring#ai-observability#aiengineering#anthropic#datasets#evals#langchain#llamaindex#llm-eval#llm-evaluation#llmops#llms#openai#prompt-engineering#smolagents
Arize-ai/phoenix
10.5K

AI Observability & Evaluation

Python
#agents#ai-monitoring#ai-observability#aiengineering#anthropic#datasets#evals#langchain#llamaindex#llm-eval#llm-evaluation#llmops#llms#openai#prompt-engineering#smolagents
Arize-ai/phoenix
10.5K

AI Observability & Evaluation

Python
#agents#ai-monitoring#ai-observability#aiengineering#anthropic#datasets#evals#langchain#llamaindex#llm-eval#llm-evaluation#llmops#llms#openai#prompt-engineering#smolagents
Arize-ai/phoenix
10.5K

AI Observability & Evaluation

Python
#agents#ai-monitoring#ai-observability#aiengineering#anthropic#datasets#evals#langchain#llamaindex#llm-eval#llm-evaluation#llmops#llms#openai#prompt-engineering#smolagents
enhancement good first issue stale c/experiments
Arize-ai/phoenix
10.5K

AI Observability & Evaluation

Python
#agents#ai-monitoring#ai-observability#aiengineering#anthropic#datasets#evals#langchain#llamaindex#llm-eval#llm-evaluation#llmops#llms#openai#prompt-engineering#smolagents
enhancement good first issue c/ui
Arize-ai/phoenix
10.5K

AI Observability & Evaluation

Python
#agents#ai-monitoring#ai-observability#aiengineering#anthropic#datasets#evals#langchain#llamaindex#llm-eval#llm-evaluation#llmops#llms#openai#prompt-engineering#smolagents
enhancement good first issue c/ui stale
Arize-ai/phoenix
10.5K

AI Observability & Evaluation

Python
#agents#ai-monitoring#ai-observability#aiengineering#anthropic#datasets#evals#langchain#llamaindex#llm-eval#llm-evaluation#llmops#llms#openai#prompt-engineering#smolagents
enhancement help wanted backlog c/traces stale
Arize-ai/phoenix
10.5K

AI Observability & Evaluation

Python
#agents#ai-monitoring#ai-observability#aiengineering#anthropic#datasets#evals#langchain#llamaindex#llm-eval#llm-evaluation#llmops#llms#openai#prompt-engineering#smolagents
enhancement help wanted stale c/prompts
Arize-ai/phoenix
10.5K

AI Observability & Evaluation

Python
#agents#ai-monitoring#ai-observability#aiengineering#anthropic#datasets#evals#langchain#llamaindex#llm-eval#llm-evaluation#llmops#llms#openai#prompt-engineering#smolagents
Arize-ai/phoenix
10.5K

AI Observability & Evaluation

Python
#agents#ai-monitoring#ai-observability#aiengineering#anthropic#datasets#evals#langchain#llamaindex#llm-eval#llm-evaluation#llmops#llms#openai#prompt-engineering#smolagents
Arize-ai/phoenix
10.5K

AI Observability & Evaluation

Python
#agents#ai-monitoring#ai-observability#aiengineering#anthropic#datasets#evals#langchain#llamaindex#llm-eval#llm-evaluation#llmops#llms#openai#prompt-engineering#smolagents
bug help wanted stale priority: medium c/filters
Arize-ai/phoenix
10.5K

AI Observability & Evaluation

Python
#agents#ai-monitoring#ai-observability#aiengineering#anthropic#datasets#evals#langchain#llamaindex#llm-eval#llm-evaluation#llmops#llms#openai#prompt-engineering#smolagents
bug help wanted c/ui stale
Arize-ai/phoenix
10.5K

AI Observability & Evaluation

Python
#agents#ai-monitoring#ai-observability#aiengineering#anthropic#datasets#evals#langchain#llamaindex#llm-eval#llm-evaluation#llmops#llms#openai#prompt-engineering#smolagents
enhancement good first issue needs information c/experiments
Arize-ai/phoenix
10.5K

AI Observability & Evaluation

Python
#agents#ai-monitoring#ai-observability#aiengineering#anthropic#datasets#evals#langchain#llamaindex#llm-eval#llm-evaluation#llmops#llms#openai#prompt-engineering#smolagents
Arize-ai/phoenix
10.5K

AI Observability & Evaluation

Python
#agents#ai-monitoring#ai-observability#aiengineering#anthropic#datasets#evals#langchain#llamaindex#llm-eval#llm-evaluation#llmops#llms#openai#prompt-engineering#smolagents
enhancement good first issue help wanted
Arize-ai/phoenix
10.5K

AI Observability & Evaluation

Python
#agents#ai-monitoring#ai-observability#aiengineering#anthropic#datasets#evals#langchain#llamaindex#llm-eval#llm-evaluation#llmops#llms#openai#prompt-engineering#smolagents

AI Summary: Enhance the Arize Phoenix platform's TypeScript client to allow running experiments using in-memory datasets provided as parameters to the `runExperiment` function, eliminating the need for persistent dataset storage. This involves modifying the function to accept a dataset object containing examples directly, rather than a dataset ID.

Complexity: 3/5
enhancement good first issue triage
Arize-ai/phoenix
10.5K

AI Observability & Evaluation

Python
#agents#ai-monitoring#ai-observability#aiengineering#anthropic#datasets#evals#langchain#llamaindex#llm-eval#llm-evaluation#llmops#llms#openai#prompt-engineering#smolagents