ci-performance-evaluation

Diagnose where CI pipeline time goes and validate which optimizations are worth shipping.

Updated Jun 12, 2026
One-click install
npx skills add https://github.com/missingbulb/GoogleCalendarEventCreator --skill ci-performance-evaluation-missingbulb
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: ci-performance-evaluation
Source: https://github.com/missingbulb/GoogleCalendarEventCreator/tree/main/.claudinite/shared/packs/basics/skills/ci-performance-evaluation
Command: npx skills add https://github.com/missingbulb/GoogleCalendarEventCreator --skill ci-performance-evaluation-missingbulb

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Slow CI pipelines waste developer time, but most optimization attempts fail because teams guess at the bottleneck instead of measuring it. This Skill provides an ordered, eight-step method for finding where CI time actually goes — from step-level timing breakdowns through per-test duration analysis to verified A/B results — so you only fix what measurably matters. ## Core Features & Use Cases - Step-level timing breakdown: Read each job step's started_at/completed_at across several runs to identify the dominant step before profiling anything. - Bottleneck classification: Distinguish caching problems (setup/install dominance), out-of-process waits (subprocesses, sleeps, network calls), fixed per-test fixture costs, and CPU-bound versus waiting-bound suites. - Verified optimization discipline: A/B every change at suite level, revert what shows no measurable gain, and report local and CI numbers separately. - Use Case: Your test suite takes 10 minutes in CI. Following the method, you discover setup caching is fine, but a broad band of tests shares a slow fixture helper — fixing that one helper cuts the suite meaningfully, which you confirm with a real CI run. ## Quick Start Analyze my CI pipeline performance and tell me where the time actually goes and what is worth fixing.

Frequently Asked Questions about ci-performance-evaluation

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I find out why my CI pipeline is slow?▼

Start with the step-level timing breakdown: list each job's steps and read their started_at and completed_at timestamps across several recent runs. Only the dominant step is worth profiling — if setup and install dominate, it is a caching problem, not a test problem.

How do I profile a slow test suite effectively?▼

Time each test file serially, sum the results, and sort them to find the serial total and the slowest single file. Then bucket all per-test durations: a few outliers indicate specific slow tests, while a broad band of similar durations points to a fixed cost in a shared fixture helper.

Why does my local test profile not match CI timing?▼

Local runs differ from CI runners in core count, warm caches, and git commit signing configuration. A session with signing enabled pays a round trip per fixture commit that CI never pays, so compare local totals against the CI step before trusting local numbers.

When does adding more parallel workers speed up tests?▼

More workers help only when wall clock time is well under user plus sys CPU time relative to core count, meaning the suite is waiting rather than computing. At or near core count the suite is CPU-bound, and additional parallelism buys nothing.

Why did my test optimization show no improvement in CI?▼

A change that halves one file often shows zero at suite level because other files were already keeping the cores busy. Always A/B against the whole suite with at least two runs per arm, and revert changes that show no measurable suite-level gain.