Summarize testdata changes

Parse git diffs to categorize Carbon testdata edits into input, STDERR, and STDOUT.

33.9k|1.7k|Updated Apr 27, 2020
One-click install
npx skills add https://github.com/carbon-language/carbon-lang --skill summarize-testdata-changes
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: Summarize testdata changes
Source: https://github.com/carbon-language/carbon-lang/tree/main/.agents/skills/summarize_testdata_changes
Command: npx skills add https://github.com/carbon-language/carbon-lang --skill summarize-testdata-changes

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) components.

What problem does it solve?

This skill provides a structured approach to summarizing changes made to Carbon's testdata files (toolchain/*/testdata) and correlating them with related code changes to improve traceability and review efficiency.

Core Features & Use Cases

  • Groups testdata changes by theme to reveal patterns across commits.
  • Captures both inputs and diagnostic outputs (STDERR/STDOUT) with file-level references for traceability.
  • Supports generating a report suitable for PRs, audits, and release notes.

Quick Start

Run the summarize_testdata_changes script to generate a grouped report of testdata changes.

Frequently Asked Questions about Summarize testdata changes

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I summarize testdata changes from a git diff for a code review?▼

This skill parses git diff outputs to categorize testdata changes into input, STDERR, and STDOUT, mapping them to related code changes and grouping them by theme for a structured code review report.

What is the best way to group testdata edits by theme during a release audit?▼

The best way to group testdata edits by theme is parsing git diff outputs to categorize changes into input, STDERR, and STDOUT, producing a structured report with file-level references for traceability.

Can I generate a structured report linking Carbon toolchain testdata updates to code changes?▼

Yes, you can generate a structured report linking Carbon toolchain testdata updates to code changes by running the summarize script to group edits by theme and detail file-level diagnostic outputs.

Does this approach capture diagnostic outputs like STDERR and STDOUT from testdata files?▼

Yes, this approach captures diagnostic outputs like STDERR and STDOUT from testdata files by parsing git diff outputs and categorizing edits into input, STDERR, and STDOUT with file-level references.

When do I need to map testdata edits to related code changes?▼

You need to map testdata edits to related code changes during code reviews and release audits where testdata changes occur, ensuring traceability and revealing patterns across commits through grouped themes.