Agent-Security-Regression-Harness good first issues (Python)

Implement no_secret_disclosure assertion 2 months ago

enhancement help wanted assertion

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Extend MCP host adapter: HTTP transport, OAuth, full lifecycle beyond stdio MVP 3 months ago

enhancement help wanted adapter mcp

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Add goal event support to the OpenAI Agents SDK adapter 3 months ago

enhancement help wanted adapter openai-agents

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

chore: de-duplicate coverage omit patterns in pyproject.toml 5 months ago

good first issue testing chore

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Implement approval_required assertion for approval-sensitive actions 5 months ago

enhancement help wanted assertion

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Extend LangChain/LangGraph adapter to support streaming or callback traces 5 months ago

enhancement help wanted adapter langchain

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Add SARIF output for code scanning integrations 5 months ago

enhancement help wanted integration cli

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Good first issue: Add an MCP trust-boundary regression scenario 5 months ago

good first issue help wanted scenario

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Support optional HTTP target headers without storing secrets in scenarios 5 months ago

enhancement help wanted adapter http

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Make HTTP adapter timeout configurable 5 months ago

enhancement good first issue adapter http

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Add suite-level runner for scenario and trace directories 5 months ago

enhancement help wanted testing cli

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Add recursive scenario validation command 5 months ago

enhancement good first issue validation cli

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Add JUnit XML output for CI systems 5 months ago

enhancement help wanted integration cli

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Add trace fixtures and assertion checks for every bundled scenario 5 months ago

help wanted scenario testing

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Keep Python scenario validation and scenario.schema.json in sync 5 months ago

help wanted validation testing chore

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Validate emitted result JSON against result.schema.json in tests 5 months ago

enhancement good first issue validation testing

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Add CLI option to fail the process on fail or error results 5 months ago

enhancement help wanted testing cli

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Add GitHub Actions workflow to run harness checks on PRs 6 months ago

documentation help wanted testing integration

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Redact sensitive marker values in assertion evidence 6 months ago

bug help wanted assertion

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Record MCP resource, prompt, tool, and policy lifecycle events 6 months ago

enhancement help wanted adapter mcp

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Add async Python callable target support 6 months ago

enhancement help wanted adapter testing

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Implement expected.allowed_tools enforcement 6 months ago

enhancement help wanted assertion

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Tighten trace validation for message, tool call, and event item shapes 6 months ago

bug good first issue validation testing

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Normalize JSON fixture formatting 6 months ago

good first issue chore

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Add goal hijack scenario for API-key extraction drift 6 months ago

help wanted scenario goal_hijack

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Add automated live HTTP success-path test 6 months ago

good first issue adapter http testing

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Document how to integrate a real agent with the harness 6 months ago

documentation help wanted integration

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Validate goal_integrity requires expected_goal 6 months ago

enhancement good first issue assertion validation

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Good first issue: Improve scenario authoring docs 6 months ago

documentation good first issue help wanted

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Good first issue: Add a GitHub Actions CI usage example 6 months ago

documentation good first issue help wanted

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Implement no_external_recipient assertion 6 months ago

enhancement help wanted assertion

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Implement memory_isolation assertion 6 months ago

enhancement help wanted assertion

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Good first issue: Add a goal hijacking regression scenario 6 months ago

good first issue help wanted scenario

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Good first issue: Add an approval bypass regression scenario 6 months ago

good first issue help wanted scenario

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Good first issue: Add an unsafe tool execution regression scenario 6 months ago

good first issue help wanted scenario

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Implement goal_integrity assertion 6 months ago

enhancement help wanted assertion

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Help wanted: Add a toy hardened demo agent 6 months ago

good first issue help wanted example

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Help wanted: Add a toy vulnerable demo agent 6 months ago

good first issue help wanted example

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

Good first issue: Add a basic prompt injection regression scenario 6 months ago

good first issue help wanted scenario

OWASP/Agent-Security-Regression-Harness

34

Executable security regression testing for agentic applications and MCP-integrated systems.

Python

#agent-security#ai-security#appsec#llm-security#mcp#owasp#python#regression-testing#security-testing

OWASP/Agent-Security-Regression-Harness

Open Issues Need Help