The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

agentops agents ai ai-governance apache-spark evaluation langchain llm-evaluation llmops machine-learning ml mlflow mlops model-management observability open-source openai prompt-engineering
87 Open Issues Need Help Last updated: Jul 3, 2026

Open Issues Need Help

View All on GitHub
enhancement help wanted has-closing-pr

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
bug good first issue area/uiux help wanted has-closing-pr

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
good first issue has-closing-pr ready

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted domain/deep-learning

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted integrations/azure area/server-infra has-closing-pr

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
bug good first issue area/uiux has-closing-pr ready

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
bug area/windows help wanted area/models priority/important-longterm has-closing-pr

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
bug Acknowledged help wanted area/tracking priority/important-soon has-closing-pr

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement area/uiux help wanted area/tracking has-closing-pr

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted area/tracing domain/genai

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted area/models domain/classical-ml

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement area/uiux help wanted area/tracking area/sqlalchemy needs design area/server-infra domain/platform

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
help wanted has-closing-pr area/evaluation domain/genai ready

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted has-closing-pr area/tracing domain/genai ready

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted area/tracing domain/genai

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted area/build has-closing-pr domain/platform

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted has-closing-pr domain/genai ready

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted area/scoring area/evaluation domain/genai domain/classical-ml ready

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted area/tracking has-closing-pr

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement area/docs help wanted area/model-registry area/tracking priority/important-longterm needs design

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted has-closing-pr area/tracing domain/genai

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
bug area/uiux help wanted has-closing-pr

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted area/tracking has-closing-pr domain/platform

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement area/uiux Acknowledged help wanted area/tracking priority/important-longterm needs design

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted area/tracing domain/genai domain/platform ready

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted area/server-infra

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted area/tracking has-closing-pr domain/classical-ml

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
good first issue

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
bug help wanted area/models area/docker has-closing-pr

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
good first issue has-closing-pr

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
good first issue help wanted has-closing-pr ready

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted area/tracking area/server-infra has-closing-pr

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering

AI Summary: This GitHub issue proposes enhancing the `mlflow.metrics.genai` documentation by adding examples that demonstrate the use of Amazon Nova models via AWS Bedrock (e.g., `bedrock:/<model-name>`). The goal is to diversify the existing Bedrock model examples on the `llms/llm-evaluate` page beyond just Anthropic models. The issue creator is willing to contribute the documentation fix.

Complexity: 2/5
good first issue area/docs has-closing-pr

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement area/uiux help wanted area/tracking

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted area/model-registry area/tracking area/sqlalchemy priority/important-longterm needs design

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted area/model-registry area/tracking

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted area/scoring area/tracking area/evaluation domain/genai

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
stale language/java Acknowledged help wanted area/tracking

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted area/evaluation domain/genai

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted area/scoring has-closing-pr domain/platform

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted has-closing-pr domain/genai

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted has-closing-pr domain/genai

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted has-closing-pr area/evaluation domain/genai

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted area/evaluation domain/genai

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted area/evaluation domain/genai

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted area/tracing domain/genai

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted area/docker area/tracing domain/genai

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted area/tracking has-closing-pr domain/genai

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted needs design area/deployments

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering

AI Summary: This GitHub issue reports two documentation errors on the MLflow website. The first is an undefined variable, `model_info`, in step 5 of the MLflow Tracking Quickstart guide, which is then used in step 6. The second involves two minor typos ("enronments" and "mo") on the ML docs main page under the Model Deployment and Model Evaluation tabs, respectively. The reporter is willing to contribute a fix.

Complexity: 1/5
good first issue area/docs

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted has-closing-pr domain/genai

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement area/uiux help wanted has-closing-pr domain/genai

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted area/tracing domain/genai

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement good first issue area/tracing domain/genai

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
bug good first issue area/uiux has-closing-pr

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted has-closing-pr

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
good first issue has-closing-pr

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted has-closing-pr area/tracing domain/genai

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
good first issue area/docs has-closing-pr

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted has-closing-pr domain/genai

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement area/uiux help wanted has-closing-pr

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted has-closing-pr area/tracing domain/genai

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement area/uiux help wanted has-closing-pr

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted area/scoring domain/platform

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted has-closing-pr

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering

AI Summary: The task involves improving the code quality of the `dev/generate_protos.py` script in the MLflow project. This includes adding type hints to all functions, replacing the `os` module with `pathlib` for path manipulation, removing unnecessary `str()` calls, and improving consistency in `pathlib` usage. The goal is to enhance code readability, type safety, and maintainability.

Complexity: 3/5
enhancement good first issue dev-tools

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering

AI Summary: The task is to debug and fix a bug in MLflow's S3 artifact store. The `ListArtifacts` API is incorrectly returning a 500 error when the S3 bucket doesn't exist or the user lacks permissions, instead of a more appropriate 400 or 403 error. The fix involves modifying the S3 artifact repository code to catch and handle the relevant botocore exceptions and return the correct HTTP status codes with informative error messages.

Complexity: 4/5
area/uiux help wanted area/artifacts area/tracking has-closing-pr

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering

AI Summary: Implement a UI feature in MLflow's Chart view that allows users to toggle the visibility of all finished runs with a single button, improving usability when monitoring many runs.

Complexity: 4/5
enhancement area/uiux help wanted

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering

AI Summary: The task is to investigate why the MLflow documentation page at https://mlflow.org/docs/latest/api_reference/models.html returns a 403 error. If the page is legitimately unavailable, the solution is to remove or correct all links to this page within the MLflow documentation. If the 403 error is a temporary issue, the solution is to report the problem to the MLflow team and update the documentation once the issue is resolved.

Complexity: 3/5
good first issue area/docs help wanted has-closing-pr

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering