Open Issues Need Help
View All on GitHubAI Summary: This GitHub issue aims to enhance the accessibility of the benchmark repository for new contributors. It proposes adding a concise quickstart guide to the README, standardizing the README's structure to align with other OpenSymbolicAI repos, and including a markdown table to summarize benchmark results by model and provider. The goal is to make it easier for newcomers to understand and run the benchmarks.
TravelPlanner benchmark (ICML 2024): OpenSymbolicAI achieves 100% pass rate with 6x fewer tokens than LangChain and 17x fewer LLM calls than CrewAI
TravelPlanner benchmark (ICML 2024): OpenSymbolicAI achieves 100% pass rate with 6x fewer tokens than LangChain and 17x fewer LLM calls than CrewAI
TravelPlanner benchmark (ICML 2024): OpenSymbolicAI achieves 100% pass rate with 6x fewer tokens than LangChain and 17x fewer LLM calls than CrewAI