ci-failure-triage

Diagnoses failed GitHub Actions Playwright runs and posts structured root-cause reports to pull requests.

Updated Jun 18, 2026
One-click install
npx skills add https://github.com/tetianna/ai-assisted-qa-automation-2 --skill ci-failure-triage-tetianna
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: ci-failure-triage
Source: https://github.com/tetianna/ai-assisted-qa-automation-2/tree/main/.cursor/skills/ci-failure-triage
Command: npx skills add https://github.com/tetianna/ai-assisted-qa-automation-2 --skill ci-failure-triage-tetianna

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? When a CI run goes red, engineers waste time digging through logs and artifacts to figure out whether the failure is a real application bug, a flaky test, or an infrastructure issue. This Skill automates that investigation and delivers a structured diagnosis directly on the pull request. ## Core Features & Use Cases - Evidence Collection: Pulls failed run logs and the playwright-report artifact via the gh CLI or GitHub MCP, extracting the failing test, expected vs actual values, and trace paths. - Cross-Referenced Classification: Compares the spec, page object model, feature acceptance criteria, and repo conventions to classify the failure as an app bug, test issue, or CI/infra problem with a source-level root cause. - Structured PR Reporting: Posts a templated comment with run ID, classification, root cause, suggested fix, and evidence, then routes confirmed app bugs to a Jira bug-reporting workflow. - Use Case: A pull request's E2E check fails overnight. The Skill downloads the report artifact, identifies that a locator no longer matches after a UI change, classifies it as a test issue, and proposes a minimal patch for human review. ## Quick Start Triage the failing E2E run on this pull request and post a diagnosis comment with the root cause and suggested fix.

Frequently Asked Questions about ci-failure-triage

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I triage a failed Playwright CI run in GitHub Actions?▼

Use gh run view with --log-failed to read the failing test and assertion, then download the playwright-report artifact with gh run download. Cross-reference the spec, page object, and feature file to classify the failure before proposing a fix.

How to tell if a Playwright test failure is an app bug or a test issue?▼

Compare the assertion against the feature file's acceptance criteria. If the test matches the AC but the UI behavior differs, it is likely an app bug; locator mismatches, missing waits, or setup gaps indicate a test issue.

Can I download Playwright trace files from a GitHub Actions run?▼

Yes, use gh run download <run-id> -n playwright-report to fetch the artifact. Trace zips and screenshots live under test-results inside the downloaded report when the workflow uploads them.

Does this Skill merge fixes automatically after triage?▼

No, it only proposes patches for human review and never pushes or merges changes. Jira bugs are filed only after a human confirms the failure is a real application defect.

What if the failed run has no open pull request?▼

For failures on workflow_dispatch or main without a PR, the diagnosis is delivered in chat or the user is asked where to publish the report instead of posting a PR comment.