SynthBench good first issues (Python)

Validation run: GlobalOpinionQA × GPT-4o mini (direct OpenRouter) 2 months ago

good first issue help wanted validation-run

DataViking-Tech/SynthBench

0

Open benchmark harness for synthetic survey respondent quality. The MLPerf of synthetic UXR.

Python

#benchmark#llm-evaluation#opinions-qa#persona-simulation#python#survey-research#synthetic-respondents

Validation run: GlobalOpinionQA × Llama 3.3 70B Instruct (direct OpenRouter) 2 months ago

good first issue help wanted validation-run

DataViking-Tech/SynthBench

0

Open benchmark harness for synthetic survey respondent quality. The MLPerf of synthetic UXR.

Python

#benchmark#llm-evaluation#opinions-qa#persona-simulation#python#survey-research#synthetic-respondents

Validation run: GlobalOpinionQA × Gemini 2.5 Flash (direct OpenRouter) 2 months ago

good first issue help wanted validation-run

DataViking-Tech/SynthBench

0

Open benchmark harness for synthetic survey respondent quality. The MLPerf of synthetic UXR.

Python

#benchmark#llm-evaluation#opinions-qa#persona-simulation#python#survey-research#synthetic-respondents

Validation run: GlobalOpinionQA × Claude Haiku 4.5 (direct OpenRouter) 2 months ago

good first issue help wanted validation-run

DataViking-Tech/SynthBench

0

Open benchmark harness for synthetic survey respondent quality. The MLPerf of synthetic UXR.

Python

#benchmark#llm-evaluation#opinions-qa#persona-simulation#python#survey-research#synthetic-respondents

Call for third-party validation runs 2 months ago

help wanted authoritativeness validation-run

DataViking-Tech/SynthBench

0

Open benchmark harness for synthetic survey respondent quality. The MLPerf of synthetic UXR.

Python

#benchmark#llm-evaluation#opinions-qa#persona-simulation#python#survey-research#synthetic-respondents

Validation run: GlobalOpinionQA × Gemini 2.5 Flash Lite (direct OpenRouter) 2 months ago

good first issue help wanted validation-run

DataViking-Tech/SynthBench

0

Open benchmark harness for synthetic survey respondent quality. The MLPerf of synthetic UXR.

Python

#benchmark#llm-evaluation#opinions-qa#persona-simulation#python#survey-research#synthetic-respondents

Validation run: GSS × Claude Haiku 4.5 via SynthPanel personas (current GSS #1) 2 months ago

help wanted validation-run

DataViking-Tech/SynthBench

0

Open benchmark harness for synthetic survey respondent quality. The MLPerf of synthetic UXR.

Python

#benchmark#llm-evaluation#opinions-qa#persona-simulation#python#survey-research#synthetic-respondents

Validation run: GSS × Gemini 2.5 Flash (direct OpenRouter) 2 months ago

good first issue help wanted validation-run

DataViking-Tech/SynthBench

0

Open benchmark harness for synthetic survey respondent quality. The MLPerf of synthetic UXR.

Python

#benchmark#llm-evaluation#opinions-qa#persona-simulation#python#survey-research#synthetic-respondents

DataViking-Tech/SynthBench

Open Issues Need Help