skills.rest
ticruz38
ticruz38COMMUNITY
Explore all skills by this author →
𝕏@DucheneThibGitHub

file-ingestion

Ingest structured files into databases with LLM-inferred schemas.

Updated Feb 10, 2026
Search Tags:#database#llm#ingest#redis-cache#schema-inference#secure-connectivity
One-click install
npx skills add https://github.com/ticruz38/skills --skill file-ingestion
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: file-ingestion
Source: https://github.com/ticruz38/skills/tree/main/skills/file-ingestion
Command: npx skills add https://github.com/ticruz38/skills --skill file-ingestion

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires requests, boto3, psycopg2, pymysql, pandas, and includes scripts (resource) components.

What problem does it solve?

In many data workflows, teams struggle to quickly convert diverse file formats (CSV, JSON, XML, Excel) into a structured database schema. This skill uses LLM-powered schema inference to automate the creation of database tables from sample data, reducing manual schema design and iteration.

Core Features & Use Cases

  • Auto-schema inference: samples data and generates a table schema with field types and nullability.
  • Secure data loading: supports SSL/TLS connections to databases and Redis caching for fast, repeatable ingestions.
  • Flexible sources: ingests from local files, HTTP(S), S3, or Google Drive, and can auto-create databases when needed.
  • Use Case: ingest daily CSV exports from a data lake into a relational database with minimal setup.

Quick Start

Ingest a sample file from a URL or local path to auto-create a database and table and load data.

Frequently Asked Questions about file-ingestion

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automatically create database tables and infer schemas from CSV files?▼

To infer schemas from CSV files, this Skill samples structured data and uses an LLM to auto-generate database tables with correct field types and nullability, eliminating manual schema design.

Can I ingest files from S3 and Google Drive directly into a relational database?▼

Yes, you can ingest files from S3 and Google Drive directly into a database. The Skill supports multiple sources including local files, HTTP(S), S3, and Google Drive for automated data loading.

How does LLM schema inference work for structured data ingestion?▼

LLM schema inference works by sampling your structured files like JSON or XML, then automatically generating a relational database schema with appropriate field types to streamline data ingestion.

Do I need to manually create a database before loading files with auto-generated schemas?▼

No, you do not need to manually create a database. The Skill can auto-create databases and tables during the file ingestion process when needed, supporting minimal setup workflows.

Does file ingestion support secure SSL connections and Redis caching?▼

Yes, file ingestion supports secure SSL/TLS connections to databases and optional Redis caching, ensuring fast repeatable ingestions and secure connectivity for your data loading workflows.

What is the best way to load daily CSV exports from a data lake into a database?▼

The best way to load daily CSV exports is using automated file ingestion with LLM-powered schema inference, which handles source connections and auto-creates database tables with minimal setup.

Related Skills

Explore More Data & Analytics Skills→
GDSDNGDSDN
3

db-env-check

Validate database environment variables, SSL mode, pooler config, and PostgreSQL connectivity.

Community
Intermediate
cenjiecenjie

query-caching-strategies

Cache database query results in Redis with TTL and invalidation.

Community
Intermediate
saajunaidsaajunaid

data-loader

Load Excel, JSON, CSV, Parquet, and XML data into SQL databases.

Community
Advanced
y1feng200156y1feng200156
33

db-migrate

Manage database schema migrations with Flyway and Atlas.

Community
Intermediate