validation-quarantine

What problem does it solve?

This Skill addresses the challenge of unreliable external data sources by validating incoming data, scoring its quality, and quarantining suspicious records without halting the data pipeline.

Core Features & Use Cases

• Schema Validation: Ensures data conforms to a defined structure using Zod schemas.
• Quality Scoring: Assigns a quality score based on custom domain rules, identifying potentially problematic data.
• Quarantine Mechanism: Moves data with scores below a threshold to a quarantine area for manual review, preventing pipeline blockage.
• Batch Processing: Efficiently validates and categorizes large sets of data.
• Use Case: When processing user-submitted forms, this skill can validate the input against expected formats, score the completeness and relevance of the data, and quarantine entries that seem incomplete or unusual for a human to review later.

Quick Start

Use the validation-quarantine skill to validate a batch of raw articles against the ArticleSchema and scoreArticle function.