medical-ai-failure-atlas good first issues (Python)

Collaboration task: Turkish and Chinese clinical safety wording review 3 months ago

help wanted synthetic-case collaboration language review

1

Clinician-built benchmark and live leaderboard for medical AI safety evaluation.

Python

#ai-benchmark#ai-safety#clinical-nlp#clinician-review#evaluation-framework#failure-analysis#failure-atlas#healthcare-ai#huggingface-spaces#language-model-evaluation#llm-evaluation#llm-safety#medfailbench#medical-ai#medical-ai-safety#medical-language-models#medical-llm#patient-safety#source-verification#turkish-medical-ai

Collaboration task: OHDSI or AMIA route note for synthetic medical AI safety review 4 months ago

documentation help wanted collaboration community

goktugozkanmd/medical-ai-failure-atlas

1

Clinician-built benchmark and live leaderboard for medical AI safety evaluation.

Python

#ai-benchmark#ai-safety#clinical-nlp#clinician-review#evaluation-framework#failure-analysis#failure-atlas#healthcare-ai#huggingface-spaces#language-model-evaluation#llm-evaluation#llm-safety#medfailbench#medical-ai#medical-ai-safety#medical-language-models#medical-llm#patient-safety#source-verification#turkish-medical-ai

Collaboration task: LM Evaluation Harness Turkish clinical source support task 4 months ago

help wanted tr-medllm collaboration adapter

goktugozkanmd/medical-ai-failure-atlas

1

Clinician-built benchmark and live leaderboard for medical AI safety evaluation.

Python

#ai-benchmark#ai-safety#clinical-nlp#clinician-review#evaluation-framework#failure-analysis#failure-atlas#healthcare-ai#huggingface-spaces#language-model-evaluation#llm-evaluation#llm-safety#medfailbench#medical-ai#medical-ai-safety#medical-language-models#medical-llm#patient-safety#source-verification#turkish-medical-ai

Collaboration task: AI transparency card mapping for SafetyGuard outputs 4 months ago

help wanted assurance-lab collaboration standards

goktugozkanmd/medical-ai-failure-atlas

1

Clinician-built benchmark and live leaderboard for medical AI safety evaluation.

Python

#ai-benchmark#ai-safety#clinical-nlp#clinician-review#evaluation-framework#failure-analysis#failure-atlas#healthcare-ai#huggingface-spaces#language-model-evaluation#llm-evaluation#llm-safety#medfailbench#medical-ai#medical-ai-safety#medical-language-models#medical-llm#patient-safety#source-verification#turkish-medical-ai

Collaboration task: Chinese model team run notes for synthetic safety prompts 4 months ago

help wanted synthetic-examples collaboration model teams

goktugozkanmd/medical-ai-failure-atlas

1

Clinician-built benchmark and live leaderboard for medical AI safety evaluation.

Python

#ai-benchmark#ai-safety#clinical-nlp#clinician-review#evaluation-framework#failure-analysis#failure-atlas#healthcare-ai#huggingface-spaces#language-model-evaluation#llm-evaluation#llm-safety#medfailbench#medical-ai#medical-ai-safety#medical-language-models#medical-llm#patient-safety#source-verification#turkish-medical-ai

Collaboration task: Inspect Evals adapter for MedFailBench safety layer 4 months ago

help wanted collaboration adapter

goktugozkanmd/medical-ai-failure-atlas

1

Clinician-built benchmark and live leaderboard for medical AI safety evaluation.

Python

#ai-benchmark#ai-safety#clinical-nlp#clinician-review#evaluation-framework#failure-analysis#failure-atlas#healthcare-ai#huggingface-spaces#language-model-evaluation#llm-evaluation#llm-safety#medfailbench#medical-ai#medical-ai-safety#medical-language-models#medical-llm#patient-safety#source-verification#turkish-medical-ai

good-first-issue: Add synthetic case for a missing drug-disease or safety gate pattern 4 months ago

good first issue data

goktugozkanmd/medical-ai-failure-atlas

1

Clinician-built benchmark and live leaderboard for medical AI safety evaluation.

Python

#ai-benchmark#ai-safety#clinical-nlp#clinician-review#evaluation-framework#failure-analysis#failure-atlas#healthcare-ai#huggingface-spaces#language-model-evaluation#llm-evaluation#llm-safety#medfailbench#medical-ai#medical-ai-safety#medical-language-models#medical-llm#patient-safety#source-verification#turkish-medical-ai

good-first-issue: Add usage example notebook to README or docs 4 months ago

documentation good first issue

goktugozkanmd/medical-ai-failure-atlas

1

Clinician-built benchmark and live leaderboard for medical AI safety evaluation.

Python

#ai-benchmark#ai-safety#clinical-nlp#clinician-review#evaluation-framework#failure-analysis#failure-atlas#healthcare-ai#huggingface-spaces#language-model-evaluation#llm-evaluation#llm-safety#medfailbench#medical-ai#medical-ai-safety#medical-language-models#medical-llm#patient-safety#source-verification#turkish-medical-ai

goktugozkanmd/medical-ai-failure-atlas

Open Issues Need Help