synthesis-feedback

Analyze synthesis build artifacts to identify quality bottlenecks and generate harness improvement recommendations.

1|Updated Jul 12, 2026
One-click install
npx skills add https://github.com/Tyler-R-Kendrick/slm-training --skill synthesis-feedback
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: synthesis-feedback
Source: https://github.com/Tyler-R-Kendrick/slm-training/tree/main/.agents/skills/synthesis-feedback
Command: npx skills add https://github.com/Tyler-R-Kendrick/slm-training --skill synthesis-feedback

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill addresses the challenge of maintaining high-quality training data by providing a structured feedback loop that links build artifacts directly to harness improvements, preventing the degradation of data quality over time.

Core Features & Use Cases

  • Automated Quality Auditing: Analyzes build artifacts like quality_report.json and rejected.jsonl to identify specific failure points in the synthesis pipeline.
  • Evidence-Based Improvement: Provides actionable recommendations for fixing producers and synthesizers rather than loosening quality gates.
  • Use Case: When a training data build shows high rejection rates, use this Skill to parse the synthesis_feedback.json and generate a targeted plan to refine the synthesis harness and improve yield.

Quick Start

Run the synthesis-feedback skill to analyze the latest build artifacts and generate improvement recommendations for the training harness.

Frequently Asked Questions about synthesis-feedback

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I fix high rejection rates in my training data synthesis pipeline?▼

Analyze synthesis artifacts like rejected.jsonl and quality_report.json to trace failures back to specific synthesizer logic. This approach yields actionable harness adjustments rather than loosening strict data-gate invariants to improve yield.

What is a training data feedback loop and how does it prevent quality degradation?▼

A training data feedback loop prevents quality degradation by linking build artifacts directly to iterative harness improvements. It correlates rejection logs with synthesis logic adjustments to drive evidence-based refinement of producers and synthesizers.

How do I analyze rejected training data to improve my synthesis harness?▼

Analyze rejected training data by parsing synthesis_feedback.json to identify specific failure points in your synthesis pipeline. This generates a targeted plan to refine your training harness and improve build yield.

Does the synthesis feedback process require access to build output directories?▼

Yes, the synthesis feedback process requires access to build output directories to parse artifacts like rejected.jsonl and quality_report.json. It also mandates strict adherence to data-gate invariants to maintain quality assurance.

What is the best way to correlate rejection logs with synthesis logic adjustments?▼

The best way to correlate rejection logs with synthesis logic adjustments is using an automated quality auditing process. It evaluates quality reports against build artifacts to generate evidence-based recommendations for fixing producers.

Why should I refine the synthesis harness instead of loosening data quality gates?▼

You should refine the synthesis harness instead of loosening data quality gates because strict data-gate invariants prevent long-term quality degradation. Evidence-based improvements to producers and synthesizers increase yield without compromising training data integrity.