ashishodu2023

ashishodu2023/cortexops

CortexOps is the CI reliability layer for AI agents — golden datasets, tool-call gates, and regression diffs that block bad deploys before users see them.

20 good first / help-wanted issues · Python · last activity Jul 13, 2026

1 stars 1 forks 1 watchers Python MIT License
crewai evaluation langgraph llm-agents mlops observability python
View on GitHub Website
20 Open Issues Need Help Last updated: Jul 13, 2026

Open Issues Need Help

View All on GitHub
Add return type hints to all public SDK functions 24 days ago
enhancement good first issue beginner
ashishodu2023/cortexops
1

CortexOps is the CI reliability layer for AI agents — golden datasets, tool-call gates, and regression diffs that block bad deploys before users see them.

Python
#crewai#evaluation#langgraph#llm-agents#mlops#observability#python
Track LLM judge cost per eval run 24 days ago
enhancement help wanted area:sdk
ashishodu2023/cortexops
1

CortexOps is the CI reliability layer for AI agents — golden datasets, tool-call gates, and regression diffs that block bad deploys before users see them.

Python
#crewai#evaluation#langgraph#llm-agents#mlops#observability#python
Add Docker Compose for self-hosted deployment 25 days ago
enhancement good first issue beginner area:backend
ashishodu2023/cortexops
1

CortexOps is the CI reliability layer for AI agents — golden datasets, tool-call gates, and regression diffs that block bad deploys before users see them.

Python
#crewai#evaluation#langgraph#llm-agents#mlops#observability#python
Add Azure OpenAI tracing example 25 days ago
enhancement good first issue beginner area:integrations
ashishodu2023/cortexops
1

CortexOps is the CI reliability layer for AI agents — golden datasets, tool-call gates, and regression diffs that block bad deploys before users see them.

Python
#crewai#evaluation#langgraph#llm-agents#mlops#observability#python
Add Gemini (Google ADK) tracing example 25 days ago
enhancement good first issue beginner area:integrations
ashishodu2023/cortexops
1

CortexOps is the CI reliability layer for AI agents — golden datasets, tool-call gates, and regression diffs that block bad deploys before users see them.

Python
#crewai#evaluation#langgraph#llm-agents#mlops#observability#python
Add Grafana Tempo export example 25 days ago
enhancement good first issue beginner area:integrations
ashishodu2023/cortexops
1

CortexOps is the CI reliability layer for AI agents — golden datasets, tool-call gates, and regression diffs that block bad deploys before users see them.

Python
#crewai#evaluation#langgraph#llm-agents#mlops#observability#python
Add OpenTelemetry Jaeger export example 25 days ago
enhancement good first issue beginner area:integrations
ashishodu2023/cortexops
1

CortexOps is the CI reliability layer for AI agents — golden datasets, tool-call gates, and regression diffs that block bad deploys before users see them.

Python
#crewai#evaluation#langgraph#llm-agents#mlops#observability#python
Add eval results to GitHub Actions job summary 25 days ago
enhancement help wanted area:ci
ashishodu2023/cortexops
1

CortexOps is the CI reliability layer for AI agents — golden datasets, tool-call gates, and regression diffs that block bad deploys before users see them.

Python
#crewai#evaluation#langgraph#llm-agents#mlops#observability#python
Improve error message when API key is invalid 2 months ago
bug good first issue beginner
ashishodu2023/cortexops
1

CortexOps is the CI reliability layer for AI agents — golden datasets, tool-call gates, and regression diffs that block bad deploys before users see them.

Python
#crewai#evaluation#langgraph#llm-agents#mlops#observability#python
Add trace sampling configuration 4 months ago
enhancement help wanted
ashishodu2023/cortexops
1

CortexOps is the CI reliability layer for AI agents — golden datasets, tool-call gates, and regression diffs that block bad deploys before users see them.

Python
#crewai#evaluation#langgraph#llm-agents#mlops#observability#python
Add pytest plugin for eval gates 4 months ago
enhancement help wanted
ashishodu2023/cortexops
1

CortexOps is the CI reliability layer for AI agents — golden datasets, tool-call gates, and regression diffs that block bad deploys before users see them.

Python
#crewai#evaluation#langgraph#llm-agents#mlops#observability#python
Document all environment variables 4 months ago
documentation good first issue beginner
ashishodu2023/cortexops
1

CortexOps is the CI reliability layer for AI agents — golden datasets, tool-call gates, and regression diffs that block bad deploys before users see them.

Python
#crewai#evaluation#langgraph#llm-agents#mlops#observability#python
Write 'Why AI agent observability?' explainer doc 4 months ago
documentation good first issue beginner
ashishodu2023/cortexops
1

CortexOps is the CI reliability layer for AI agents — golden datasets, tool-call gates, and regression diffs that block bad deploys before users see them.

Python
#crewai#evaluation#langgraph#llm-agents#mlops#observability#python
Write Getting Started in 5 Minutes tutorial 4 months ago
documentation good first issue beginner
ashishodu2023/cortexops
1

CortexOps is the CI reliability layer for AI agents — golden datasets, tool-call gates, and regression diffs that block bad deploys before users see them.

Python
#crewai#evaluation#langgraph#llm-agents#mlops#observability#python
Add quick-start GIF to SDK README 4 months ago
documentation good first issue beginner
ashishodu2023/cortexops
1

CortexOps is the CI reliability layer for AI agents — golden datasets, tool-call gates, and regression diffs that block bad deploys before users see them.

Python
#crewai#evaluation#langgraph#llm-agents#mlops#observability#python
Add Smolagents (HuggingFace) example 4 months ago
enhancement good first issue beginner
ashishodu2023/cortexops
1

CortexOps is the CI reliability layer for AI agents — golden datasets, tool-call gates, and regression diffs that block bad deploys before users see them.

Python
#crewai#evaluation#langgraph#llm-agents#mlops#observability#python
Add LlamaIndex query engine tracing example 4 months ago
enhancement good first issue beginner
ashishodu2023/cortexops
1

CortexOps is the CI reliability layer for AI agents — golden datasets, tool-call gates, and regression diffs that block bad deploys before users see them.

Python
#crewai#evaluation#langgraph#llm-agents#mlops#observability#python
Add Haystack pipeline tracing example 4 months ago
enhancement good first issue beginner
ashishodu2023/cortexops
1

CortexOps is the CI reliability layer for AI agents — golden datasets, tool-call gates, and regression diffs that block bad deploys before users see them.

Python
#crewai#evaluation#langgraph#llm-agents#mlops#observability#python
Add DSPy tracing example 4 months ago
enhancement good first issue beginner
ashishodu2023/cortexops
1

CortexOps is the CI reliability layer for AI agents — golden datasets, tool-call gates, and regression diffs that block bad deploys before users see them.

Python
#crewai#evaluation#langgraph#llm-agents#mlops#observability#python
Add CrewAI multi-agent example 4 months ago
enhancement good first issue beginner
ashishodu2023/cortexops
1

CortexOps is the CI reliability layer for AI agents — golden datasets, tool-call gates, and regression diffs that block bad deploys before users see them.

Python
#crewai#evaluation#langgraph#llm-agents#mlops#observability#python