test-review

Analyze Python test suites for mutation-kill value and coverage gaps.

317|40|Updated Jan 21, 2025
One-click install
npx skills add https://github.com/benchflow-ai/benchflow --skill test-review-benchflow-ai
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: test-review
Source: https://github.com/benchflow-ai/benchflow/tree/main/.agents/skills/test-review
Command: npx skills add https://github.com/benchflow-ai/benchflow --skill test-review-benchflow-ai

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill addresses the accumulation of low-value, redundant, or misleading tests that slow down development and obscure genuine regressions.

Core Features & Use Cases

  • Mutation-Kill Analysis: Evaluates tests based on their ability to catch actual code mutations rather than just asserting on mock return values.
  • Bloat Reduction: Identifies and suggests removal of mock-echo tests, unreachable defensive checks, and redundant setter/getter tests.
  • Coverage Gap Detection: Highlights missing tests for complex public functions, concurrency branches, and boundary conditions.
  • Use Case: Use this to clean up a legacy test suite where developers are afraid to delete tests, ensuring that every remaining test provides meaningful protection against real-world bugs.

Quick Start

Invoke the test-review skill to analyze the entire tests directory for bloat and coverage gaps using parallel subagents.

Frequently Asked Questions about test-review

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I identify redundant tests and coverage gaps in a Python test suite?▼

To identify redundant tests and coverage gaps in a Python test suite, analyze mutation-kill value by evaluating assertion logic against defined mutation rules. This detects redundant mock-echo tests and highlights missing branch coverage.

What is mutation testing and how does it evaluate test suite quality?▼

Mutation testing evaluates test suite quality by systematically introducing code mutations to verify if existing assertions catch the changes. It measures true mutation-kill value rather than simple mock return values, ensuring tests protect against genuine regressions.

How do I clean up a legacy pytest suite without risking hidden regressions?▼

Clean up a legacy pytest suite by applying mutation-kill analysis to identify bloat and coverage gaps. This systematically evaluates mock seams and assertion logic, safely detecting unreachable defensive checks and redundant setter tests while preserving high-integrity coverage.

Does this test suite refactoring approach work for Python projects using pytest?▼

Yes, this test suite refactoring approach applies specifically to Python-based software engineering projects using pytest. It systematically evaluates mock seams, branch coverage, and assertion logic to maintain high-integrity test maintenance during refactoring.

When should I use mutation-kill analysis instead of standard code coverage?▼

Use mutation-kill analysis instead of standard code coverage when you need to prune bloat from accumulated low-value tests. It identifies misleading tests that assert only on mock return values, ensuring remaining tests provide meaningful protection against real-world bugs.