Open Issues Need Help
View All on GitHub good first issue tests
LLMSQL/llmsql-benchmark LLMSQL/llmsql-benchmark A Text2SQL benchmark for evaluation of Large Language Models
Open project →
42
A Text2SQL benchmark for evaluation of Large Language Models
Python
#benchmark#language-model#text2sql-evaluation
[Evaluation] `evaluate()` always writes a randomly named report file into the working directory 14 days ago
enhancement good first issue evaluation
LLMSQL/llmsql-benchmark LLMSQL/llmsql-benchmark A Text2SQL benchmark for evaluation of Large Language Models
Open project →
42
A Text2SQL benchmark for evaluation of Large Language Models
Python
#benchmark#language-model#text2sql-evaluation
bug good first issue cli
LLMSQL/llmsql-benchmark LLMSQL/llmsql-benchmark A Text2SQL benchmark for evaluation of Large Language Models
Open project →
42
A Text2SQL benchmark for evaluation of Large Language Models
Python
#benchmark#language-model#text2sql-evaluation
[Evaluation] `fix_table_name` misses common spellings of "Table", so correct queries count as SQL errors 20 days ago
bug good first issue evaluation
LLMSQL/llmsql-benchmark LLMSQL/llmsql-benchmark A Text2SQL benchmark for evaluation of Large Language Models
Open project →
42
A Text2SQL benchmark for evaluation of Large Language Models
Python
#benchmark#language-model#text2sql-evaluation
bug good first issue cli
LLMSQL/llmsql-benchmark LLMSQL/llmsql-benchmark A Text2SQL benchmark for evaluation of Large Language Models
Open project →
42
A Text2SQL benchmark for evaluation of Large Language Models
Python
#benchmark#language-model#text2sql-evaluation
documentation good first issue
LLMSQL/llmsql-benchmark LLMSQL/llmsql-benchmark A Text2SQL benchmark for evaluation of Large Language Models
Open project →
42
A Text2SQL benchmark for evaluation of Large Language Models
Python
#benchmark#language-model#text2sql-evaluation
Add Leaderboard format save to `evaluate()` function 4 months ago
enhancement good first issue help wanted
LLMSQL/llmsql-benchmark LLMSQL/llmsql-benchmark A Text2SQL benchmark for evaluation of Large Language Models
Open project →
42
A Text2SQL benchmark for evaluation of Large Language Models
Python
#benchmark#language-model#text2sql-evaluation
Add exact match metric 5 months ago
enhancement good first issue help wanted feature
LLMSQL/llmsql-benchmark LLMSQL/llmsql-benchmark A Text2SQL benchmark for evaluation of Large Language Models
Open project →
42
A Text2SQL benchmark for evaluation of Large Language Models
Python
#benchmark#language-model#text2sql-evaluation
Add tests with real evaluations 7 months ago
good first issue help wanted tests change
LLMSQL/llmsql-benchmark LLMSQL/llmsql-benchmark A Text2SQL benchmark for evaluation of Large Language Models
Open project →
42
A Text2SQL benchmark for evaluation of Large Language Models
Python
#benchmark#language-model#text2sql-evaluation
Move creation of prompts to a function 7 months ago
enhancement good first issue help wanted
LLMSQL/llmsql-benchmark LLMSQL/llmsql-benchmark A Text2SQL benchmark for evaluation of Large Language Models
Open project →
42
A Text2SQL benchmark for evaluation of Large Language Models
Python
#benchmark#language-model#text2sql-evaluation
enhancement good first issue help wanted
LLMSQL/llmsql-benchmark LLMSQL/llmsql-benchmark A Text2SQL benchmark for evaluation of Large Language Models
Open project →
42
A Text2SQL benchmark for evaluation of Large Language Models
Python
#benchmark#language-model#text2sql-evaluation
Add `evaluate()` function to cli 8 months ago
enhancement good first issue help wanted
LLMSQL/llmsql-benchmark LLMSQL/llmsql-benchmark A Text2SQL benchmark for evaluation of Large Language Models
Open project →
42
A Text2SQL benchmark for evaluation of Large Language Models
Python
#benchmark#language-model#text2sql-evaluation
Restyle return button 9 months ago
documentation good first issue help wanted
LLMSQL/llmsql-benchmark LLMSQL/llmsql-benchmark A Text2SQL benchmark for evaluation of Large Language Models
Open project →
42
A Text2SQL benchmark for evaluation of Large Language Models
Python
#benchmark#language-model#text2sql-evaluation
[Feature] Add separated `limit` flag 10 months ago
enhancement good first issue feature
LLMSQL/llmsql-benchmark LLMSQL/llmsql-benchmark A Text2SQL benchmark for evaluation of Large Language Models
Open project →
42
A Text2SQL benchmark for evaluation of Large Language Models
Python
#benchmark#language-model#text2sql-evaluation
Add logo for the tab of the documentation 11 months ago
documentation enhancement good first issue help wanted
LLMSQL/llmsql-benchmark LLMSQL/llmsql-benchmark A Text2SQL benchmark for evaluation of Large Language Models
Open project →
42
A Text2SQL benchmark for evaluation of Large Language Models
Python
#benchmark#language-model#text2sql-evaluation
Add handaling of LoRA adapters for vllm inference 11 months ago
enhancement good first issue help wanted
LLMSQL/llmsql-benchmark LLMSQL/llmsql-benchmark A Text2SQL benchmark for evaluation of Large Language Models
Open project →
42
A Text2SQL benchmark for evaluation of Large Language Models
Python
#benchmark#language-model#text2sql-evaluation
[Feature] Add separated model_args flag 12 months ago
enhancement good first issue feature
LLMSQL/llmsql-benchmark LLMSQL/llmsql-benchmark A Text2SQL benchmark for evaluation of Large Language Models
Open project →
42
A Text2SQL benchmark for evaluation of Large Language Models
Python
#benchmark#language-model#text2sql-evaluation
Configure precommit hooks about 1 year ago
enhancement good first issue help wanted
LLMSQL/llmsql-benchmark LLMSQL/llmsql-benchmark A Text2SQL benchmark for evaluation of Large Language Models
Open project →
42
A Text2SQL benchmark for evaluation of Large Language Models
Python
#benchmark#language-model#text2sql-evaluation
Add better code coverage about 1 year ago
good first issue help wanted tests
LLMSQL/llmsql-benchmark LLMSQL/llmsql-benchmark A Text2SQL benchmark for evaluation of Large Language Models
Open project →
42
A Text2SQL benchmark for evaluation of Large Language Models
Python
#benchmark#language-model#text2sql-evaluation
Relax dependencies about 1 year ago
good first issue help wanted dependencies
LLMSQL/llmsql-benchmark LLMSQL/llmsql-benchmark A Text2SQL benchmark for evaluation of Large Language Models
Open project →
42
A Text2SQL benchmark for evaluation of Large Language Models
Python
#benchmark#language-model#text2sql-evaluation
Add sphinx to the dev group dependencies about 1 year ago
bug good first issue help wanted dependencies
LLMSQL/llmsql-benchmark LLMSQL/llmsql-benchmark A Text2SQL benchmark for evaluation of Large Language Models
Open project →
42
A Text2SQL benchmark for evaluation of Large Language Models
Python
#benchmark#language-model#text2sql-evaluation
Add CONTRIBUTING.md about 1 year ago
documentation help wanted
LLMSQL/llmsql-benchmark LLMSQL/llmsql-benchmark A Text2SQL benchmark for evaluation of Large Language Models
Open project →
42
A Text2SQL benchmark for evaluation of Large Language Models
Python
#benchmark#language-model#text2sql-evaluation