data-ingest

Ingest CSV/Excel property data into PostGIS with validation and geocoding.

Updated Dec 14, 2025
One-click install
npx skills add https://github.com/toobutta/maptelli --skill data-ingest-toobutta
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: data-ingest
Source: https://github.com/toobutta/maptelli/tree/main/.claude/skills/data-ingest
Command: npx skills add https://github.com/toobutta/maptelli --skill data-ingest-toobutta

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Ingest property data from CSV/Excel into a PostGIS-enabled backend, with robust validation, per-row error reporting, and geocoding fallback to enrich incomplete records.

Core Features & Use Cases

  • Strict column validation to ensure required fields are present before processing.
  • Per-row error collection with detailed context to diagnose issues without failing the entire file.
  • Geocoding fallback for missing coordinates using a free service, and PostGIS geometry creation from lat/lon for spatial storage.
  • Async processing for large files via Celery, with progress tracking and an import ID for polling.

Quick Start

Run a small sample CSV through the bulk import workflow to ingest data and verify results.

Frequently Asked Questions about data-ingest

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I ingest real estate data from Excel into a PostGIS database?

To ingest real estate data from Excel into a PostGIS database, you can use a bulk import workflow that handles strict column validation, geocoding fallbacks, and PostGIS geometry creation from latitude and longitude coordinates. It processes files into seed-ready data for development and analytics.

What is the best way to handle row-level errors during large CSV property data imports?

The best way to handle row-level errors during CSV property data imports is using per-row error collection with detailed context. This approach diagnoses data issues without failing the entire file, allowing valid records to process while isolating problematic rows for correction.

Can I automatically geocode missing coordinates when ingesting property data?

Yes, you can automatically geocode missing coordinates when ingesting property data. The ingestion workflow includes a geocoding fallback that uses a free service to enrich incomplete records, subsequently creating PostGIS geometry from the retrieved latitude and longitude values.

Does asynchronous processing support progress tracking for large real estate files?

Yes, asynchronous processing supports progress tracking for large real estate files via Celery. It provides an import ID for polling, allowing you to monitor bulk import status and track endpoint-based data processing without blocking the main application thread.

Why does column validation fail when importing CSV property data?

Column validation fails when importing CSV property data if required fields are missing before processing begins. Strict column validation ensures mandatory data points are present, triggering per-row error collection to provide detailed context for diagnosing incomplete records.