Open Issues Need Help
View All on GitHub probe: extraction of personal info from llms 2 days ago
good first issue probes new plugin dontautoclose
NVIDIA/garak
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
probe: dart package hallucination 10 days ago
good first issue probes
NVIDIA/garak
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
probe: aart 13 days ago
good first issue probes new plugin
NVIDIA/garak
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
arch: give exit codes on improper exit about 1 month ago
architecture good first issue cli
NVIDIA/garak
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
probe: zws + bad character attacks about 1 month ago
good first issue probes new plugin dontautoclose
NVIDIA/garak
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
feature: make llmaaj prompts switchable about 2 months ago
good first issue dontautoclose
NVIDIA/garak
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
probe: injection with tags about 2 months ago
good first issue
NVIDIA/garak
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
probe: beavertails about 2 months ago
good first issue probes new plugin
NVIDIA/garak
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
probe: pdf injection 2 months ago
good first issue probes new plugin dontautoclose
NVIDIA/garak
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
probe: replay filter evasion through icl 2 months ago
good first issue probes new plugin dontautoclose
NVIDIA/garak
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
probe: anamorpher image 2 months ago
good first issue probes new plugin
NVIDIA/garak
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
probe: simple adaptive attacks 2 months ago
good first issue probes new plugin
NVIDIA/garak
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
detector: StrongREJECT -- evaluation for jailbreaks 3 months ago
good first issue new plugin dontautoclose
NVIDIA/garak
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
bug good first issue
NVIDIA/garak
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
bug: core cfg listed twice in report in default run 3 months ago
bug good first issue
NVIDIA/garak
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
generator: datasette / llm 4 months ago
good first issue generators new plugin
NVIDIA/garak
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
option to see `atkgen` auto red-team turns 7 months ago
good first issue probes
NVIDIA/garak
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
probe: system prompt recovery resilience 7 months ago
good first issue probes new plugin
NVIDIA/garak
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
probe: add resumé examples 7 months ago
good first issue probes
NVIDIA/garak
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
probe: persuasive jailbreak 7 months ago
good first issue probes new plugin dontautoclose
NVIDIA/garak
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
housekeeping: find lighter `base2048` dependency 7 months ago
good first issue housekeeping
NVIDIA/garak
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
Fall back when online services can't be reached. 7 months ago
bug good first issue
NVIDIA/garak
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
Include information about why detectors are skipped 7 months ago
good first issue detectors reporting ux quality-accuracy
NVIDIA/garak
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
Add probe tier to `--list_probes` 7 months ago
good first issue ux dontautoclose
NVIDIA/garak
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
good first issue
NVIDIA/garak
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
probe: propile 7 months ago
good first issue probes new plugin dontautoclose
NVIDIA/garak
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
buff: ignore previous instructions 9 months ago
good first issue new plugin buffs
NVIDIA/garak
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
probe + detector: API keys 9 months ago
good first issue detectors new plugin dontautoclose
NVIDIA/garak
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
config: `model_*` -> `target_*` 10 months ago
good first issue cli ux
NVIDIA/garak
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
generator: anthropic 10 months ago
good first issue generators new plugin dontautoclose
NVIDIA/garak
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
probe: repeated char injection 10 months ago
good first issue probes new plugin
NVIDIA/garak
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
support helper command list filtering 10 months ago
good first issue cli ux
NVIDIA/garak
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
good first issue cli reporting
NVIDIA/garak
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
validate test expectations are provided by fixtures 10 months ago
good first issue tests
NVIDIA/garak
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment
atbash cipher encoding 11 months ago
good first issue probes
NVIDIA/garak
8.4K
the LLM vulnerability scanner
Python
#ai#llm-evaluation#llm-security#security-scanners#vulnerability-assessment