Open Issues Need Help
View All on GitHub [Feature Request] ROUGE Score Drops Due to <think> Tags in LLM Outputs (Internal Reasoning) 7 days ago
enhancement help wanted
AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automation
Python
#analysis#automl#benchmarking#document-parser#embeddings#evaluation#llm#llm-evaluation#llm-ops#open-source#ops#optimization#pipeline#python#qa#rag#rag-evaluation#retrieval-augmented-generation
[Feature Request] Make short version data of Eli5 dataset for quick testing and evaluation 5 months ago
enhancement good first issue
AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automation
Python
#analysis#automl#benchmarking#document-parser#embeddings#evaluation#llm#llm-evaluation#llm-ops#open-source#ops#optimization#pipeline#python#qa#rag#rag-evaluation#retrieval-augmented-generation
Add NVIDA reranker module 5 months ago
good first issue New Module
AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automation
Python
#analysis#automl#benchmarking#document-parser#embeddings#evaluation#llm#llm-evaluation#llm-ops#open-source#ops#optimization#pipeline#python#qa#rag#rag-evaluation#retrieval-augmented-generation