data-import-parsers

What problem does it solve?

Memory-heavy data imports are risky and error-prone; this skill enables memory-safe streaming of records, validating and coercing types explicitly, and skipping irreparable rows while logging them to an error CSV that includes all original columns plus timestamp, file, line, and error details. It also ensures idempotent DB writes to enable safe re-runs and auditable processing.

Core Features & Use Cases

• Streaming, row-by-row processing to avoid loading entire datasets into memory.
• Explicit type validation and coercion per field to enforce data quality.
• Irreparable rows are skipped and logged with full context in an error CSV (including timestamp, file, line, and error).
• Idempotent persistence strategies (e.g., upserts, conflict handling) to prevent duplicates on re-runs.

Quick Start

Run the streaming import workflow on a sample dataset to verify memory usage, validation, and idempotent writes.