OWASP/Agent-Security-Regression-Harness

Add goal event support to the OpenAI Agents SDK adapter about 2 hours ago

enhancement help wanted adapter openai-agents

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Extend MCP host adapter: HTTP transport, OAuth, full lifecycle beyond stdio MVP 27 days ago

enhancement help wanted adapter mcp

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

chore: de-duplicate coverage omit patterns in pyproject.toml about 1 month ago

good first issue testing chore

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Implement approval_required assertion for approval-sensitive actions about 2 months ago

enhancement help wanted assertion

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Implement no_secret_disclosure assertion about 2 months ago

enhancement help wanted assertion

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Extend LangChain/LangGraph adapter to support streaming or callback traces about 2 months ago

enhancement help wanted adapter langchain

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Add SARIF output for code scanning integrations about 2 months ago

enhancement help wanted integration cli

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Good first issue: Add an MCP trust-boundary regression scenario about 2 months ago

good first issue help wanted scenario

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Support optional HTTP target headers without storing secrets in scenarios about 2 months ago

enhancement help wanted adapter http

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Make HTTP adapter timeout configurable about 2 months ago

enhancement good first issue adapter http

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Add suite-level runner for scenario and trace directories about 2 months ago

enhancement help wanted testing cli

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Add recursive scenario validation command about 2 months ago

enhancement good first issue validation cli

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Add JUnit XML output for CI systems about 2 months ago

enhancement help wanted integration cli

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Add trace fixtures and assertion checks for every bundled scenario about 2 months ago

help wanted scenario testing

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Keep Python scenario validation and scenario.schema.json in sync about 2 months ago

help wanted validation testing chore

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Validate emitted result JSON against result.schema.json in tests about 2 months ago

enhancement good first issue validation testing

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Add CLI option to fail the process on fail or error results about 2 months ago

enhancement help wanted testing cli

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Add GitHub Actions workflow to run harness checks on PRs 2 months ago

documentation help wanted testing integration

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Redact sensitive marker values in assertion evidence 2 months ago

bug help wanted assertion

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Record MCP resource, prompt, tool, and policy lifecycle events 2 months ago

enhancement help wanted adapter mcp

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Add async Python callable target support 2 months ago

enhancement help wanted adapter testing

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Implement expected.allowed_tools enforcement 2 months ago

enhancement help wanted assertion

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Tighten trace validation for message, tool call, and event item shapes 2 months ago

bug good first issue validation testing

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Normalize JSON fixture formatting 2 months ago

good first issue chore

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Add goal hijack scenario for API-key extraction drift 2 months ago

help wanted scenario goal_hijack

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Add automated live HTTP success-path test 2 months ago

good first issue adapter http testing

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Document how to integrate a real agent with the harness 2 months ago

documentation help wanted integration

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Validate goal_integrity requires expected_goal 2 months ago

enhancement good first issue assertion validation

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Good first issue: Improve scenario authoring docs 2 months ago

documentation good first issue help wanted

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Good first issue: Add a GitHub Actions CI usage example 2 months ago

documentation good first issue help wanted

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Implement no_external_recipient assertion 2 months ago

enhancement help wanted assertion

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Implement memory_isolation assertion 2 months ago

enhancement help wanted assertion

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Good first issue: Add a goal hijacking regression scenario 2 months ago

good first issue help wanted scenario

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Good first issue: Add an approval bypass regression scenario 2 months ago

good first issue help wanted scenario

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Good first issue: Add an unsafe tool execution regression scenario 2 months ago

good first issue help wanted scenario

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Implement goal_integrity assertion 2 months ago

enhancement help wanted assertion

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Help wanted: Add a toy hardened demo agent 2 months ago

good first issue help wanted example

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Help wanted: Add a toy vulnerable demo agent 2 months ago

good first issue help wanted example

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Good first issue: Add a basic prompt injection regression scenario 2 months ago

good first issue help wanted scenario

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

OWASP/Agent-Security-Regression-Harness

Open Issues Need Help