qa-false-positive-detection

Detects false positive bug fixes through causation tests and confidence scoring.

3|Updated Feb 7, 2026
One-click install
npx skills add https://github.com/gabrielnsmnto/kord-aios --skill qa-false-positive-detection-gabrielnsmnto
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: qa-false-positive-detection
Source: https://github.com/gabrielnsmnto/kord-aios/tree/main/src/features/builtin-skills/kord-aios/qa/qa-false-positive-detection
Command: npx skills add https://github.com/gabrielnsmnto/kord-aios --skill qa-false-positive-detection-gabrielnsmnto

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? QA reviews often approve bug fixes that only appear to work due to confirmation bias, timing coincidences, or incomplete root cause analysis, letting placebo fixes slip into production. ## Core Features & Use Cases - Causation Verification: Runs remove-and-reapply tests to prove the fix actually causes the bug to disappear, and confirms old code fails while new code succeeds. - Confirmation Bias Checks: Validates that negative cases were tested, the fix mechanism is explained, and results are independently reproducible. - Weighted Confidence Scoring: Calculates a 0-1 confidence score from seven weighted factors and maps it to APPROVE, note, or REJECT recommendations. - Use Case: During review of a bug fix story claiming a null pointer was fixed, run the false positive check to verify the fix was tested against edge cases, the original bug reproduces without the fix, and the mechanism is explained before approving. ## Quick Start Run the false-positive-check command with a story ID and the claimed fix description to generate a verification report with a confidence score.

Frequently Asked Questions about qa-false-positive-detection

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I verify a bug fix is not a false positive?▼

Run the false-positive-check command with the story ID and claimed fix description. It performs a remove-and-reapply causation test, checks assumptions and bias factors, then outputs a confidence score with a verification report.

What is a false positive in QA bug fix review?▼

A false positive is a fix that appears to resolve a bug but does not address the root cause, such as placebo fixes, timing coincidences, environment-dependent behavior, or incomplete edge case handling. These pass superficial review but regress later.

How is the false positive confidence score calculated?▼

The score weights seven factors: remove test (0.25), assumptions verified (0.20), old code fails (0.15), new code succeeds (0.15), not self-healing (0.10), negative cases (0.10), and mechanism explained (0.05). Scores of 0.85 or higher indicate high confidence.

When should false positive detection run in the QA workflow?▼

It runs during the review-build phase whenever a story is identified as a bug fix. The confidence score is included in the QA report, and scores below 0.65 strongly weigh toward rejecting the fix.

What are common red flags of a placebo bug fix?▼

Red flags include testing only the happy path, inability to reproduce the original bug, unclear fix mechanism, timing or environment dependence, missing regression tests, undocumented assumptions, and considering only one explanation for the bug.