Open Issues Need Help
View All on GitHub Ask_YogaSutra: Benchmark testsuite about 2 hours ago
AI Summary: This issue proposes creating a benchmark test suite for an 'Ask_YogaSutra' system. It involves compiling a dataset of YogaSutra-related question-answer pairs in a CSV/XLS format, varying in complexity and language. Additionally, a robust test framework needs to be developed to execute these tests against different embedding and chat models with configurable hyperparameters, ultimately generating accuracy metrics.
Complexity:
4/5
enhancement good first issue ask_yogasutra
This repo is a collection of various PoCs (Proof-of-Concepts) to interface custom data using LLMs.
Python