test-flakiness

Analyze CI test logs to identify and classify flaky tests.

Updated Aug 23, 2026
One-click install
npx skills add https://github.com/dawn840705/claude-code-game-studios --skill test-flakiness-dawn840705
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: test-flakiness
Source: https://github.com/dawn840705/claude-code-game-studios/tree/main/skills/test-flakiness
Command: npx skills add https://github.com/dawn840705/claude-code-game-studios --skill test-flakiness-dawn840705

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Intermittent, non-deterministic tests undermine CI trust and slow release cycles by producing inconsistent results across runs.

Core Features & Use Cases

  • Identify flaky tests by aggregating pass/fail history across multiple CI runs and test suites.
  • Classify flakiness causes (timing, order dependency, external state, random seed) and propose remediation steps.
  • Generate a regression quarantine plan and update or reference a flaky-test registry.
  • Produce summary reports and actionable recommendations to fix or quarantine tests.

Quick Start

Run /test-flakiness with a CI log path or run scan to analyze all available CI logs.

Frequently Asked Questions about test-flakiness

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I detect flaky tests from JUnit logs to stabilize CI?▼

To detect flaky tests from JUnit logs, you can analyze test results by aggregating pass/fail history across multiple CI runs to identify intermittent failures and stabilize your pipeline.

Why does my CI show intermittent test failures in Unity or Godot projects?▼

Intermittent CI failures in Unity, Godot, or Unreal projects are often caused by flaky tests exhibiting non-deterministic behavior due to timing, order dependency, external state, or random seeds.

How do I classify flakiness causes and generate a quarantine plan for failing tests?▼

You can classify flakiness causes and generate a regression quarantine plan by parsing test logs, evaluating pass/fail history, and producing actionable remediation recommendations to isolate unstable tests.

Can I analyze plain text CI logs to find non-deterministic test results?▼

Yes, you can analyze plain text CI logs to find non-deterministic test results by parsing the output and aggregating the historical pass and fail data to classify test flakiness.

What is the best way to aggregate pass/fail history across multiple test suites?▼

The best way to aggregate pass/fail history across multiple test suites is to scan available CI logs, classify the flakiness of each test, and generate a summary report with actionable fix recommendations.

Does this test flakiness detection work during the Polish or stabilization phases?▼

Yes, test flakiness detection is specifically applicable during Polish or stabilization phases when CI shows intermittent failures, helping you parse logs and update your flaky-test registry.