Data Validation Skill

What problem does it solve?

This Skill addresses the critical need to validate, clean, and score the quality of incoming data, preventing errors and ensuring reliable data for downstream processes.

Core Features & Use Cases

• Schema Validation: Enforces data structure and type correctness against predefined schemas (e.g., Pydantic, Pandera).
• Business Rule Enforcement: Applies custom logic to check for data reasonableness, consistency, and adherence to business policies.
• Data Quality Scoring: Generates a quantifiable score based on dimensions like completeness, accuracy, and uniqueness.
• Use Case: Automatically validate and score customer transaction data uploaded via SFTP before it enters the main analytics database, flagging or rejecting records that fail critical checks.

Quick Start

Use the validation skill to validate the attached CSV file against the AsgardFlowRecord schema.