bamdadd/context-leak - 7 Help Wanted Issues

Open Issues Need Help

Add `--list-scenarios` and `--scenario <id>` to the CLI about 2 hours ago

good first issue type: feature area: infra size: S

Leakage-verified contextual-integrity benchmark: does an agent disclose a sensitive attribute to a recipient the context forbids. Defensive, synthetic-only. Sibling of leakgauge.

Python

#agent-safety#benchmark#contextual-integrity#evaluation#llm#open-source#privacy

Validate that a scenario's forbidden/appropriate_flows reference real ids about 2 hours ago

good first issue type: feature area: infra size: S

bamdadd/context-leak

Leakage-verified contextual-integrity benchmark: does an agent disclose a sensitive attribute to a recipient the context forbids. Defensive, synthetic-only. Sibling of leakgauge.

Python

#agent-safety#benchmark#contextual-integrity#evaluation#llm#open-source#privacy

Add a second synthetic scenario in a different neutral domain about 2 hours ago

good first issue type: feature area: agent-safety size: S

bamdadd/context-leak

Leakage-verified contextual-integrity benchmark: does an agent disclose a sensitive attribute to a recipient the context forbids. Defensive, synthetic-only. Sibling of leakgauge.

Python

#agent-safety#benchmark#contextual-integrity#evaluation#llm#open-source#privacy

Add scorer normalization edge-case tests (NFKC / case-fold / whitespace) about 2 hours ago

good first issue type: test area: agent-safety size: S

bamdadd/context-leak

Leakage-verified contextual-integrity benchmark: does an agent disclose a sensitive attribute to a recipient the context forbids. Defensive, synthetic-only. Sibling of leakgauge.

Python

#agent-safety#benchmark#contextual-integrity#evaluation#llm#open-source#privacy

Add a disclosure-rate + utility report across scenarios about 2 hours ago

help wanted type: feature area: infra size: M

bamdadd/context-leak

Leakage-verified contextual-integrity benchmark: does an agent disclose a sensitive attribute to a recipient the context forbids. Defensive, synthetic-only. Sibling of leakgauge.

Python

#agent-safety#benchmark#contextual-integrity#evaluation#llm#open-source#privacy

Add a multi-attribute scenario where different attributes have different forbidden recipients about 2 hours ago

good first issue type: feature area: llm size: S

bamdadd/context-leak

Leakage-verified contextual-integrity benchmark: does an agent disclose a sensitive attribute to a recipient the context forbids. Defensive, synthetic-only. Sibling of leakgauge.

Python

#agent-safety#benchmark#contextual-integrity#evaluation#llm#open-source#privacy

Detect confirm/deny disclosures in the deterministic value match about 2 hours ago

help wanted type: research area: agent-safety size: M

bamdadd/context-leak

Leakage-verified contextual-integrity benchmark: does an agent disclose a sensitive attribute to a recipient the context forbids. Defensive, synthetic-only. Sibling of leakgauge.

Python

#agent-safety#benchmark#contextual-integrity#evaluation#llm#open-source#privacy