data-ingest

Ingest CSV/Excel property data into PostGIS with validation and geocoding.

Updated Dec 14, 2025
One-click install
npx skills add https://github.com/toobutta/maptelli --skill data-ingest-toobutta
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: data-ingest
Source: https://github.com/toobutta/maptelli/tree/main/.claude/skills/data-ingest
Command: npx skills add https://github.com/toobutta/maptelli --skill data-ingest-toobutta

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Ingest property data from CSV/Excel into a PostGIS-enabled backend, with robust validation, per-row error reporting, and geocoding fallback to enrich incomplete records.

Core Features & Use Cases

  • Strict column validation to ensure required fields are present before processing.
  • Per-row error collection with detailed context to diagnose issues without failing the entire file.
  • Geocoding fallback for missing coordinates using a free service, and PostGIS geometry creation from lat/lon for spatial storage.
  • Async processing for large files via Celery, with progress tracking and an import ID for polling.

Quick Start

Run a small sample CSV through the bulk import workflow to ingest data and verify results.

Frequently Asked Questions about data-ingest

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I ingest real estate data from Excel into a PostGIS database?▼

To ingest real estate data from Excel into a PostGIS database, you can use a bulk import workflow that handles strict column validation, geocoding fallbacks, and PostGIS geometry creation from latitude and longitude coordinates. It processes files into seed-ready data for development and analytics.

What is the best way to handle row-level errors during large CSV property data imports?▼

The best way to handle row-level errors during CSV property data imports is using per-row error collection with detailed context. This approach diagnoses data issues without failing the entire file, allowing valid records to process while isolating problematic rows for correction.

Can I automatically geocode missing coordinates when ingesting property data?▼

Yes, you can automatically geocode missing coordinates when ingesting property data. The ingestion workflow includes a geocoding fallback that uses a free service to enrich incomplete records, subsequently creating PostGIS geometry from the retrieved latitude and longitude values.

Does asynchronous processing support progress tracking for large real estate files?▼

Yes, asynchronous processing supports progress tracking for large real estate files via Celery. It provides an import ID for polling, allowing you to monitor bulk import status and track endpoint-based data processing without blocking the main application thread.

Why does column validation fail when importing CSV property data?▼

Column validation fails when importing CSV property data if required fields are missing before processing begins. Strict column validation ensures mandatory data points are present, triggering per-row error collection to provide detailed context for diagnosing incomplete records.