Open Issues Need Help
View All on GitHub good first issue help wanted
aicostbudget/llm-cost-per-task-benchmark aicostbudget/llm-cost-per-task-benchmark What one correct LLM answer really costs: 16 tasks, code-only validators, bring-your-own-key runner (OpenAI, Anthropic, Gemini, DeepSeek). First result: same accuracy, 9x the cost per success.
Open project →
1
What one correct LLM answer really costs: 16 tasks, code-only validators, bring-your-own-key runner (OpenAI, Anthropic, Gemini, DeepSeek). First result: same accuracy, 9x the cost per success.
Python
#ai-cost#anthropic#benchmark#cost-optimization#deepseek#finops#gemini#llm#llm-benchmark#llm-cost#llm-evaluation#llmops#openai#prompt-caching#python#reasoning-models#text-to-sql#tool-calling
help wanted
aicostbudget/llm-cost-per-task-benchmark aicostbudget/llm-cost-per-task-benchmark What one correct LLM answer really costs: 16 tasks, code-only validators, bring-your-own-key runner (OpenAI, Anthropic, Gemini, DeepSeek). First result: same accuracy, 9x the cost per success.
Open project →
1
What one correct LLM answer really costs: 16 tasks, code-only validators, bring-your-own-key runner (OpenAI, Anthropic, Gemini, DeepSeek). First result: same accuracy, 9x the cost per success.
Python
#ai-cost#anthropic#benchmark#cost-optimization#deepseek#finops#gemini#llm#llm-benchmark#llm-cost#llm-evaluation#llmops#openai#prompt-caching#python#reasoning-models#text-to-sql#tool-calling