AgentsKit-io

AgentsKit-io/provider-swap-evaluation

Reproducible JavaScript experiment for testing whether an agent evaluation survives an AI provider swap

3 good first / help-wanted issues · JavaScript · last activity Jul 28, 2026

0 stars 1 forks 0 watchers JavaScript MIT License
agents ai-evaluation javascript llm-evaluation provider-portability reproducible-research
View on GitHub
3 Open Issues Need Help Last updated: Jul 28, 2026

Open Issues Need Help

View All on GitHub
Document a third adapter without changing the evaluation boundary 3 months ago
documentation good first issue help wanted provider-portability
AgentsKit-io/provider-swap-evaluation
0

Reproducible JavaScript experiment for testing whether an agent evaluation survives an AI provider swap

JavaScript
#agents#ai-evaluation#javascript#llm-evaluation#provider-portability#reproducible-research
Add a terminal-state invariant test for timeouts 3 months ago
good first issue help wanted reliability testing
AgentsKit-io/provider-swap-evaluation
0

Reproducible JavaScript experiment for testing whether an agent evaluation survives an AI provider swap

JavaScript
#agents#ai-evaluation#javascript#llm-evaluation#provider-portability#reproducible-research
Add a case-preserving regression case to the provider-swap baseline 3 months ago
good first issue help wanted testing provider-portability
AgentsKit-io/provider-swap-evaluation
0

Reproducible JavaScript experiment for testing whether an agent evaluation survives an AI provider swap

JavaScript
#agents#ai-evaluation#javascript#llm-evaluation#provider-portability#reproducible-research