Open Issues Need Help
View All on GitHub Fall back when online services can't be reached. 27 days ago
bug good first issue
NVIDIA/garak NVIDIA/garak the LLM vulnerability scanner
Open project →
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
extra encodings 28 days ago
good first issue probes
NVIDIA/garak NVIDIA/garak the LLM vulnerability scanner
Open project →
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
detector: violence about 1 month ago
good first issue detectors new plugin
NVIDIA/garak NVIDIA/garak the LLM vulnerability scanner
Open project →
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
probe: injection with tags about 2 months ago
good first issue
NVIDIA/garak NVIDIA/garak the LLM vulnerability scanner
Open project →
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
buff: ignore previous instructions about 2 months ago
good first issue new plugin buffs
NVIDIA/garak NVIDIA/garak the LLM vulnerability scanner
Open project →
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
probe: anamorpher image about 2 months ago
good first issue probes new plugin
NVIDIA/garak NVIDIA/garak the LLM vulnerability scanner
Open project →
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
detector: StrongREJECT -- evaluation for jailbreaks about 2 months ago
good first issue new plugin dontautoclose
NVIDIA/garak NVIDIA/garak the LLM vulnerability scanner
Open project →
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
arch: give exit codes on improper exit 2 months ago
architecture good first issue cli
NVIDIA/garak NVIDIA/garak the LLM vulnerability scanner
Open project →
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
feature: make llmaaj prompts switchable 2 months ago
good first issue dontautoclose
NVIDIA/garak NVIDIA/garak the LLM vulnerability scanner
Open project →
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
probe: persuasive jailbreak 2 months ago
good first issue probes new plugin dontautoclose
NVIDIA/garak NVIDIA/garak the LLM vulnerability scanner
Open project →
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
probe: pdf injection 2 months ago
good first issue probes new plugin dontautoclose
NVIDIA/garak NVIDIA/garak the LLM vulnerability scanner
Open project →
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
probe: aart 2 months ago
good first issue probes new plugin
NVIDIA/garak NVIDIA/garak the LLM vulnerability scanner
Open project →
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
probe: replay filter evasion through icl 2 months ago
good first issue probes new plugin dontautoclose
NVIDIA/garak NVIDIA/garak the LLM vulnerability scanner
Open project →
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
probe: extraction of personal info from llms 2 months ago
good first issue probes new plugin dontautoclose
NVIDIA/garak NVIDIA/garak the LLM vulnerability scanner
Open project →
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
detector: misogyny 2 months ago
good first issue detectors new plugin
NVIDIA/garak NVIDIA/garak the LLM vulnerability scanner
Open project →
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
probe: credit cards 3 months ago
good first issue probes new plugin
NVIDIA/garak NVIDIA/garak the LLM vulnerability scanner
Open project →
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
probe: dart package hallucination 4 months ago
good first issue probes
NVIDIA/garak NVIDIA/garak the LLM vulnerability scanner
Open project →
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
probe: zws + bad character attacks 5 months ago
good first issue probes new plugin dontautoclose
NVIDIA/garak NVIDIA/garak the LLM vulnerability scanner
Open project →
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
probe: beavertails 6 months ago
good first issue probes new plugin
NVIDIA/garak NVIDIA/garak the LLM vulnerability scanner
Open project →
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
probe: simple adaptive attacks 6 months ago
good first issue probes new plugin
NVIDIA/garak NVIDIA/garak the LLM vulnerability scanner
Open project →
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
bug good first issue
NVIDIA/garak NVIDIA/garak the LLM vulnerability scanner
Open project →
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
bug: core cfg listed twice in report in default run 7 months ago
bug good first issue
NVIDIA/garak NVIDIA/garak the LLM vulnerability scanner
Open project →
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
generator: datasette / llm 8 months ago
good first issue generators new plugin
NVIDIA/garak NVIDIA/garak the LLM vulnerability scanner
Open project →
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
option to see `atkgen` auto red-team turns 10 months ago
good first issue probes
NVIDIA/garak NVIDIA/garak the LLM vulnerability scanner
Open project →
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
probe: system prompt recovery resilience 10 months ago
good first issue probes new plugin
NVIDIA/garak NVIDIA/garak the LLM vulnerability scanner
Open project →
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
probe: add resumé examples 10 months ago
good first issue probes
NVIDIA/garak NVIDIA/garak the LLM vulnerability scanner
Open project →
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
housekeeping: find lighter `base2048` dependency 11 months ago
good first issue housekeeping
NVIDIA/garak NVIDIA/garak the LLM vulnerability scanner
Open project →
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
Include information about why detectors are skipped 11 months ago
good first issue detectors reporting ux quality-accuracy
NVIDIA/garak NVIDIA/garak the LLM vulnerability scanner
Open project →
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
Add probe tier to `--list_probes` 11 months ago
good first issue ux dontautoclose
NVIDIA/garak NVIDIA/garak the LLM vulnerability scanner
Open project →
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
good first issue
NVIDIA/garak NVIDIA/garak the LLM vulnerability scanner
Open project →
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
probe: propile 11 months ago
good first issue probes new plugin dontautoclose
NVIDIA/garak NVIDIA/garak the LLM vulnerability scanner
Open project →
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
probe + detector: API keys about 1 year ago
good first issue detectors new plugin dontautoclose
NVIDIA/garak NVIDIA/garak the LLM vulnerability scanner
Open project →
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
config: `model_*` -> `target_*` about 1 year ago
good first issue cli ux
NVIDIA/garak NVIDIA/garak the LLM vulnerability scanner
Open project →
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
generator: anthropic about 1 year ago
good first issue generators new plugin dontautoclose
NVIDIA/garak NVIDIA/garak the LLM vulnerability scanner
Open project →
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
probe: repeated char injection about 1 year ago
good first issue probes new plugin
NVIDIA/garak NVIDIA/garak the LLM vulnerability scanner
Open project →
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
support helper command list filtering about 1 year ago
good first issue cli ux
NVIDIA/garak NVIDIA/garak the LLM vulnerability scanner
Open project →
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
good first issue cli reporting
NVIDIA/garak NVIDIA/garak the LLM vulnerability scanner
Open project →
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
validate test expectations are provided by fixtures about 1 year ago
good first issue tests
NVIDIA/garak NVIDIA/garak the LLM vulnerability scanner
Open project →
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
atbash cipher encoding about 1 year ago
good first issue probes
NVIDIA/garak NVIDIA/garak the LLM vulnerability scanner
Open project →
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment