Agenta-AI

Agenta-AI/agenta

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

72 good first / help-wanted issues · TypeScript · last activity Jul 1, 2026

4.3K stars 555 forks 4.3K watchers TypeScript Other
agents evaluation llm-as-a-judge llm-evaluation llm-framework llm-monitoring llm-observability llm-platform llm-playground llm-tools llmops observability prompt-engineering prompt-management rag-evaluation
View on GitHub Website
72 Open Issues Need Help Last updated: Jul 1, 2026

Open Issues Need Help

View All on GitHub
Resolving a workflow revision with a circular embed returns 500 instead of 4xx 3 days ago
good first issue
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
Onboarding: clearing a restored "Other" answer hides the text box and lets typing pick another choice 5 days ago
good first issue
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
(bug) A mobile session whose first message never reached the server spins on "Loading conversation" forever about 1 month ago
good first issue frontend bug report ux bug
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
JSON Diff: case_insensitive_keys=True scores identical JSON as 0.0 when keys contain uppercase letters about 1 month ago
good first issue
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
Committing a revision with an already-used slug returns 500 instead of 409 about 1 month ago
good first issue
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
[chat] Run errors render the raw JSON body as the agent's reply about 1 month ago
good first issue dev experience frontend ux bug
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
[SDK] Unanchored "/api" split in init.py breaks the trace endpoint for a host named api about 2 months ago
good first issue
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
[bug] The chat blocks the working-directory-relative file link that the platform prompt tells the agent to write about 2 months ago
good first issue
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
(bug) The provider drawer lists 34 models for a key that OpenAI just rejected 2 months ago
good first issue frontend internal team bug report
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
(bug) Stepper displayed on question form dock when only one question exists 2 months ago
good first issue frontend ux bug
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
(bug) A scheme-less AGENTA_API_URL produces a malformed OTLP endpoint in the SDK 2 months ago
good first issue sdk bug report
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
(bug) The chat error card cuts the provider error off at the card edge and offers no action 2 months ago
good first issue frontend bug report
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
(bug) Some provider logos are invisible in dark mode 2 months ago
good first issue frontend bug report ux bug
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
[auth] One-time-code inputs lost their accessible names; expired-code copy is ungrammatical 2 months ago
good first issue frontend ux internal team bug report bug
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
[Bug] : Sidebar Content get cramp up 2 months ago
good first issue
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
(feat) Autofocus the auth inputs for a better sign-in experience 2 months ago
good first issue frontend ux feature request internal team
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
(bug) The sign-in page's right panel leaves a large empty gap on wide screens 2 months ago
good first issue frontend bug report ux bug
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
[api] PUT /sessions/streams/header accepts a wrapped body and silently does nothing 2 months ago
good first issue backend bug report bug
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
[mobile] /m sessions list: agent name crowds out the session title (one letter visible) 2 months ago
good first issue frontend ux bug
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
(bug) The rename session dialog ignores Enter and only confirms on the button 3 months ago
good first issue frontend ux low priority bug report
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
(bug) Usage card reports a failure rate 100x too low — 1 failure in 6 requests shows as "0.17%" 3 months ago
good first issue frontend high priority observability bug report
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
(bug) OSS dev web container cannot start: copy-pdf-worker.mjs missing from image 3 months ago
good first issue backend devops bug report build
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
Swap sendgrid by SMTP 3 months ago
good first issue backend feature request internal team
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
Together AI model run fails with InvalidSecretsV0Error 3 months ago
good first issue backend sdk evaluation internal team bug report
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
[AGE-2166] Add Reset Password Functionality to Workspace UI 3 months ago
good first issue frontend ui feature internal team
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
(chore) The organization fetcher logs emoji debug lines to the browser console on every settings page 3 months ago
good first issue dev experience frontend low priority
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
(bug) The Advanced row label is truncated to "Advan…" in the agent Overview configuration rail 3 months ago
good first issue frontend ux low priority bug report
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
(bug) Usage chart y-axis labels are clipped, so the latency scale reads 0K / 5K / 0K / 5K 3 months ago
good first issue frontend ux bug report
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
(bug) An archived agent's conversations still appear on the project Sessions page 3 months ago
good first issue frontend ux bug report
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
(bug) "View all" on Automation runs opens the same unfiltered sessions list as Sessions 3 months ago
good first issue frontend ux low priority bug report
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
(bug) A deleted session stays in the sessions list until the page is reloaded 3 months ago
good first issue frontend ux bug report
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
(test) Built-ins SDK tests: vacuous coerce_tool_configs resolver test and substring-only JSON example check 3 months ago
good first issue tests python bug report
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
(chore) Extract PlaygroundSyncStateTag out of Playground.tsx 3 months ago
good first issue frontend refactor playground
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
(bug) Pi permissions controls are hidden when the agent config omits harness.kind 3 months ago
good first issue frontend bug report
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
(bug) Sandbox-not-allowed error type slug is hardcoded to 'local' regardless of the refused provider 3 months ago
good first issue bug report
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
(bug) delete-app E2E test times out when a leftover skill-upload agent app leaks into the picker 3 months ago
good first issue frontend tests bug report
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
[UX bug] Misleading error message in evaluation table 3 months ago
good first issue frontend ux
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
(chore) Tool resolver rejects reserved built-in tool names only after secret resolution and adapter calls 3 months ago
good first issue SDK Improvement
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
(docs) Agent-workflows docs still describe the removed "forced tools" model and stale services/agent paths 3 months ago
documentation good first issue
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
Run errors not shown correctly in evaluation table 3 months ago
bug good first issue Frontend Evaluation Bug Report
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
Tool/trigger discovery returns a bare 404 when Composio is not configured 4 months ago
good first issue dev experience Backend Bug Report
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
Open evaluator registry button links incorrectly 4 months ago
bug good first issue Frontend Bug Report
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
Commit modal shows wrong variant name for new variants 4 months ago
good first issue Frontend ux bug Playground
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
[Bug] In the observability trace table, we are not displaying the exceptions in the output column 5 months ago
bug good first issue Frontend
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
Trace drawer entity chips show IDs on hover 5 months ago
bug good first issue Frontend
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
Text inputs in test case drawer auto-switch type 5 months ago
good first issue Frontend UX ux bug Playground Bug Report
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
[feat][UX/UI] Hide mapping and preview until a test set is selected 5 months ago
good first issue Frontend Observability
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
Create API key modal overflows API key text 5 months ago
bug good first issue UI
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
Fix SDK eval breadcrumbs showing `Auto Evals` 5 months ago
bug good first issue Frontend
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
[UI/UX] Improve click behavior in tables 5 months ago
good first issue Frontend UI UX Improvement
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
Improve dark mode polish for header and tool menu 5 months ago
good first issue Frontend UI UX
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
[AGE-1858] Add llms.txt to docs 5 months ago
documentation good first issue Low priority
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
fix(frontend): block deletion of an app's last revision 7 months ago
bug good first issue Frontend UI UX
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
[bug] Auto-scroll issue in variant drawer with large prompts 8 months ago
bug good first issue Frontend UI ux bug
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
Curly template formatter raises false TemplateFormatError when substituted values contain {{variable}} patterns 8 months ago
bug good first issue SDK
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
[Bug] Inconsistent Password Validation Rule in Signup and Signin 9 months ago
bug good first issue unconfirmed bug
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
SDK: curly template format fails when substituted values contain same variable names 9 months ago
bug good first issue SDK
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
Bug: Embedding traces incorrectly shown with chat UI in trace drawer 9 months ago
bug good first issue Frontend UI
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
Bug: Comments (strings) in annotation tab not shown in trace drawer 9 months ago
bug good first issue Frontend UI Observability
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
Commit button disabled when clearing max token field 9 months ago
bug good first issue Frontend Playground
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
[chore] Print warning messages when any instrumentation method is called before ag.init() 10 months ago
good first issue dev experience SDK
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
Add indentation and symbols to tools list for clarity 10 months ago
good first issue UI UX
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
[docs] Create an observability example with Anthropic/TS 10 months ago
documentation good first issue example Observability
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
Add copy button to error / value popovers in evaluation scenarios table 10 months ago
bug good first issue Frontend UI feature Evaluation
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
Variant state changes to draft with large prompts 11 months ago
bug good first issue Frontend ux bug
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
[UX] Deleting a trace should load the next trace 11 months ago
good first issue Frontend UX
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
[chore] Add warning when ag.init() is called and API key is not set 11 months ago
good first issue dev experience SDK Chore
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
[AGE-3376] Fix incorrect height of load application container in evaluator playground 11 months ago
bug good first issue Frontend UI
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
[docs] Create example and write docs for Google ADK integration 11 months ago
documentation good first issue example Observability integration
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
Fix UI bug on survey page 11 months ago
bug good first issue Frontend UX
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
Empty state configure provider 12 months ago
enhancement good first issue Frontend UX
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation
[AGE-3362] [bug] Text overlap issue in Playground chat mode UI about 1 year ago
bug good first issue Frontend UI Playground
Agenta-AI/agenta
4.3K

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScript
#agents#evaluation#llm-as-a-judge#llm-evaluation#llm-framework#llm-monitoring#llm-observability#llm-platform#llm-playground#llm-tools#llmops#observability#prompt-engineering#prompt-management#rag-evaluation