ashishodu2023/cortexops

Track LLM judge cost per eval run about 1 hour ago

enhancement help wanted

1

CortexOps is the CI reliability layer for AI agents — golden datasets, tool-call gates, and regression diffs that block bad deploys before users see them.

Python

#crewai#evaluation#langgraph#llm-agents#mlops#observability#python

Add eval results to GitHub Actions job summary about 2 hours ago

enhancement help wanted

ashishodu2023/cortexops

1

CortexOps is the CI reliability layer for AI agents — golden datasets, tool-call gates, and regression diffs that block bad deploys before users see them.

Python

#crewai#evaluation#langgraph#llm-agents#mlops#observability#python

Add trace sampling configuration about 2 hours ago

enhancement help wanted

ashishodu2023/cortexops

1

CortexOps is the CI reliability layer for AI agents — golden datasets, tool-call gates, and regression diffs that block bad deploys before users see them.

Python

#crewai#evaluation#langgraph#llm-agents#mlops#observability#python

Add pytest plugin for eval gates about 2 hours ago

enhancement help wanted

ashishodu2023/cortexops

1

CortexOps is the CI reliability layer for AI agents — golden datasets, tool-call gates, and regression diffs that block bad deploys before users see them.

Python

#crewai#evaluation#langgraph#llm-agents#mlops#observability#python

Add return type hints to all public SDK functions about 2 hours ago

enhancement good first issue beginner

ashishodu2023/cortexops

1

CortexOps is the CI reliability layer for AI agents — golden datasets, tool-call gates, and regression diffs that block bad deploys before users see them.

Python

#crewai#evaluation#langgraph#llm-agents#mlops#observability#python

Improve error message when API key is invalid about 2 hours ago

bug good first issue beginner

ashishodu2023/cortexops

1

CortexOps is the CI reliability layer for AI agents — golden datasets, tool-call gates, and regression diffs that block bad deploys before users see them.

Python

#crewai#evaluation#langgraph#llm-agents#mlops#observability#python

Add Docker Compose for self-hosted deployment about 2 hours ago

enhancement good first issue beginner

ashishodu2023/cortexops

1

CortexOps is the CI reliability layer for AI agents — golden datasets, tool-call gates, and regression diffs that block bad deploys before users see them.

Python

#crewai#evaluation#langgraph#llm-agents#mlops#observability#python

Document all environment variables about 2 hours ago

documentation good first issue beginner

ashishodu2023/cortexops

1

CortexOps is the CI reliability layer for AI agents — golden datasets, tool-call gates, and regression diffs that block bad deploys before users see them.

Python

#crewai#evaluation#langgraph#llm-agents#mlops#observability#python

Write 'Why AI agent observability?' explainer doc about 2 hours ago

documentation good first issue beginner

ashishodu2023/cortexops

1

CortexOps is the CI reliability layer for AI agents — golden datasets, tool-call gates, and regression diffs that block bad deploys before users see them.

Python

#crewai#evaluation#langgraph#llm-agents#mlops#observability#python

Write Getting Started in 5 Minutes tutorial about 2 hours ago

documentation good first issue beginner

ashishodu2023/cortexops

1

CortexOps is the CI reliability layer for AI agents — golden datasets, tool-call gates, and regression diffs that block bad deploys before users see them.

Python

#crewai#evaluation#langgraph#llm-agents#mlops#observability#python

Add quick-start GIF to SDK README about 2 hours ago

documentation good first issue beginner

ashishodu2023/cortexops

1

CortexOps is the CI reliability layer for AI agents — golden datasets, tool-call gates, and regression diffs that block bad deploys before users see them.

Python

#crewai#evaluation#langgraph#llm-agents#mlops#observability#python

Add Smolagents (HuggingFace) example about 2 hours ago

enhancement good first issue beginner

ashishodu2023/cortexops

1

CortexOps is the CI reliability layer for AI agents — golden datasets, tool-call gates, and regression diffs that block bad deploys before users see them.

Python

#crewai#evaluation#langgraph#llm-agents#mlops#observability#python

Add LlamaIndex query engine tracing example about 2 hours ago

enhancement good first issue beginner

ashishodu2023/cortexops

1

CortexOps is the CI reliability layer for AI agents — golden datasets, tool-call gates, and regression diffs that block bad deploys before users see them.

Python

#crewai#evaluation#langgraph#llm-agents#mlops#observability#python

Add Haystack pipeline tracing example about 2 hours ago

enhancement good first issue beginner

ashishodu2023/cortexops

1

CortexOps is the CI reliability layer for AI agents — golden datasets, tool-call gates, and regression diffs that block bad deploys before users see them.

Python

#crewai#evaluation#langgraph#llm-agents#mlops#observability#python

Add DSPy tracing example about 2 hours ago

enhancement good first issue beginner

ashishodu2023/cortexops

1

CortexOps is the CI reliability layer for AI agents — golden datasets, tool-call gates, and regression diffs that block bad deploys before users see them.

Python

#crewai#evaluation#langgraph#llm-agents#mlops#observability#python

Add CrewAI multi-agent example about 2 hours ago

enhancement good first issue beginner

ashishodu2023/cortexops

1

CortexOps is the CI reliability layer for AI agents — golden datasets, tool-call gates, and regression diffs that block bad deploys before users see them.

Python

#crewai#evaluation#langgraph#llm-agents#mlops#observability#python

Add Grafana Tempo export example about 2 hours ago

enhancement good first issue beginner

ashishodu2023/cortexops

1

CortexOps is the CI reliability layer for AI agents — golden datasets, tool-call gates, and regression diffs that block bad deploys before users see them.

Python

#crewai#evaluation#langgraph#llm-agents#mlops#observability#python

Add OpenTelemetry Jaeger export example about 2 hours ago

enhancement good first issue beginner

ashishodu2023/cortexops

1

CortexOps is the CI reliability layer for AI agents — golden datasets, tool-call gates, and regression diffs that block bad deploys before users see them.

Python

#crewai#evaluation#langgraph#llm-agents#mlops#observability#python

Add Azure OpenAI tracing example about 2 hours ago

enhancement good first issue beginner

ashishodu2023/cortexops

1

CortexOps is the CI reliability layer for AI agents — golden datasets, tool-call gates, and regression diffs that block bad deploys before users see them.

Python

#crewai#evaluation#langgraph#llm-agents#mlops#observability#python

Add Gemini (Google ADK) tracing example about 2 hours ago

enhancement good first issue beginner

ashishodu2023/cortexops

1

CortexOps is the CI reliability layer for AI agents — golden datasets, tool-call gates, and regression diffs that block bad deploys before users see them.

Python

#crewai#evaluation#langgraph#llm-agents#mlops#observability#python

Open Issues Need Help