mlflow

mlflow/mlflow

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

97 good first / help-wanted issues · Python · last activity Jul 3, 2026

agentops agents ai ai-governance apache-spark evaluation langchain llm-evaluation llmops machine-learning ml mlflow mlops model-management observability open-source openai prompt-engineering
97 Open Issues Need Help Last updated: Jul 3, 2026

Open Issues Need Help

View All on GitHub
enhancement help wanted
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted area/tracing domain/genai
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted area/scoring area/tracking area/evaluation domain/genai
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
bug good first issue area/uiux help wanted has-closing-pr
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement area/uiux help wanted has-closing-pr
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted area/models area/deployments
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted domain/deep-learning
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted area/server-infra
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted area/scoring domain/platform
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
bug help wanted area/projects priority/backlog
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
bug area/uiux help wanted has-closing-pr
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted area/tracing domain/genai domain/platform ready
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement area/uiux help wanted area/tracking area/sqlalchemy needs design area/server-infra domain/platform
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
good first issue has-closing-pr
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
good first issue has-closing-pr ready
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
bug area/windows help wanted area/models priority/important-longterm has-closing-pr
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted area/scoring area/evaluation domain/genai domain/classical-ml ready
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement area/docs help wanted area/tracking
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
good first issue
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted has-closing-pr
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted integrations/azure area/server-infra has-closing-pr
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
bug good first issue area/uiux has-closing-pr ready
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
bug Acknowledged help wanted area/tracking priority/important-soon has-closing-pr
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement area/uiux help wanted area/tracking has-closing-pr
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted area/models domain/classical-ml
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted has-closing-pr area/tracing domain/genai ready
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted area/tracing domain/genai
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted area/build has-closing-pr domain/platform
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted has-closing-pr domain/genai ready
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted area/tracking has-closing-pr
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement area/docs help wanted area/model-registry area/tracking priority/important-longterm needs design
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted has-closing-pr area/tracing domain/genai
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted area/tracking has-closing-pr domain/platform
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement area/uiux Acknowledged help wanted area/tracking priority/important-longterm needs design
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted area/tracking has-closing-pr domain/classical-ml
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
good first issue
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
bug help wanted area/models area/docker has-closing-pr
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
good first issue has-closing-pr
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
good first issue help wanted has-closing-pr ready
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted area/tracking area/server-infra has-closing-pr
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering

AI Summary: This GitHub issue proposes enhancing the `mlflow.metrics.genai` documentation by adding examples that demonstrate the use of Amazon Nova models via AWS Bedrock (e.g., `bedrock:/<model-name>`). The goal is to diversify the existing Bedrock model examples on the `llms/llm-evaluate` page beyond just Anthropic models. The issue creator is willing to contribute the documentation fix.

Complexity: 2/5
good first issue area/docs has-closing-pr
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement area/uiux help wanted area/tracking
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted area/model-registry area/tracking area/sqlalchemy priority/important-longterm needs design
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted area/model-registry area/tracking
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
stale language/java Acknowledged help wanted area/tracking
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted area/evaluation domain/genai
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted area/scoring has-closing-pr domain/platform
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted has-closing-pr domain/genai
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted has-closing-pr domain/genai
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted has-closing-pr area/evaluation domain/genai
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted area/evaluation domain/genai
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted area/evaluation domain/genai
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted area/tracing domain/genai
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted area/docker area/tracing domain/genai
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted area/tracking has-closing-pr domain/genai
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted needs design area/deployments
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering

AI Summary: This GitHub issue reports two documentation errors on the MLflow website. The first is an undefined variable, `model_info`, in step 5 of the MLflow Tracking Quickstart guide, which is then used in step 6. The second involves two minor typos ("enronments" and "mo") on the ML docs main page under the Model Deployment and Model Evaluation tabs, respectively. The reporter is willing to contribute a fix.

Complexity: 1/5
good first issue area/docs
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted has-closing-pr domain/genai
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement area/uiux help wanted has-closing-pr domain/genai
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted area/tracing domain/genai
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement good first issue area/tracing domain/genai
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
bug good first issue area/uiux has-closing-pr
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted has-closing-pr
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
good first issue has-closing-pr
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted has-closing-pr area/tracing domain/genai
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
good first issue area/docs has-closing-pr
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted has-closing-pr domain/genai
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement area/uiux help wanted has-closing-pr
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted has-closing-pr area/tracing domain/genai
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement area/uiux help wanted has-closing-pr
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
enhancement help wanted has-closing-pr
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering

AI Summary: The task involves improving the code quality of the `dev/generate_protos.py` script in the MLflow project. This includes adding type hints to all functions, replacing the `os` module with `pathlib` for path manipulation, removing unnecessary `str()` calls, and improving consistency in `pathlib` usage. The goal is to enhance code readability, type safety, and maintainability.

Complexity: 3/5
enhancement good first issue dev-tools
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering

AI Summary: The task is to debug and fix a bug in MLflow's S3 artifact store. The `ListArtifacts` API is incorrectly returning a 500 error when the S3 bucket doesn't exist or the user lacks permissions, instead of a more appropriate 400 or 403 error. The fix involves modifying the S3 artifact repository code to catch and handle the relevant botocore exceptions and return the correct HTTP status codes with informative error messages.

Complexity: 4/5
area/uiux help wanted area/artifacts area/tracking has-closing-pr
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering

AI Summary: Implement a UI feature in MLflow's Chart view that allows users to toggle the visibility of all finished runs with a single button, improving usability when monitoring many runs.

Complexity: 4/5
enhancement area/uiux help wanted
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering

AI Summary: The task is to investigate why the MLflow documentation page at https://mlflow.org/docs/latest/api_reference/models.html returns a 403 error. If the page is legitimately unavailable, the solution is to remove or correct all links to this page within the MLflow documentation. If the 403 error is a temporary issue, the solution is to report the problem to the MLflow team and update the documentation once the issue is resolved.

Complexity: 3/5
good first issue area/docs help wanted has-closing-pr
mlflow/mlflow
26.8K

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Python
#agentops#agents#ai#ai-governance#apache-spark#evaluation#langchain#llm-evaluation#llmops#machine-learning#ml#mlflow#mlops#model-management#observability#open-source#openai#prompt-engineering