Test Semgrep Rule Skill

What problem does it solve?

This skill helps security researchers and rule authors validate Semgrep rules against known vulnerable repositories to measure true and false positive rates, enabling reliable detection and benchmarking.

Core Features & Use Cases

• Execute end-to-end rule evaluation against curated vulnerable repos.
• Compute TP/FP/Recall/Precision metrics and summarize findings.
• Use Case: Benchmark rule performance across multi-language samples and standardized test-beds.

Quick Start

Follow the workflow to test a Semgrep rule against known vulnerable apps by cloning the test repositories described in resources/test-repositories.md, configuring your rule, running semgrep --config rule.yaml target/ --json > findings.json, and examining the results with jq.