data-importer

Import YAML-frontmatter Markdown files from .synnovator into SQLite via SQLAlchemy models.

1|1|Updated Jan 27, 2026
One-click install
npx skills add https://github.com/H2OSLabs/SynnovatorZero --skill data-importer
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: data-importer
Source: https://github.com/H2OSLabs/SynnovatorZero/tree/main/.claude/skills/data-importer
Command: npx skills add https://github.com/H2OSLabs/SynnovatorZero --skill data-importer

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires PyYAML, SQLAlchemy, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill automates importing Markdown data files that use YAML frontmatter from the .synnovator directory into a SQLite database via SQLAlchemy models. It enables test data population and migration of file-based content into relational storage.

Core Features & Use Cases

  • Import .synnovator/*.md files (YAML frontmatter + Markdown body) into SQLite via SQLAlchemy models.
  • Dependency-aware import order to ensure referential integrity during test data setup.
  • Incremental imports to skip existing records and batch processing for performance.
  • Use Case: initialize a dev/test database by importing sample data from .synnovator files and verify API endpoints with realistic data.

Quick Start

From project root, run: python scripts/cli.py import --source .synnovator --db data/synnovator.db --models backend/models

Frequently Asked Questions about data-importer

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I import YAML frontmatter Markdown files into a SQLite database?

You can import YAML frontmatter Markdown files into a SQLite database by running the provided CLI script. It parses the Markdown content and uses SQLAlchemy models to validate and persist the records into the database.

Does the data importer handle referential integrity when populating test data?

Yes, the data importer ensures referential integrity during test data population by applying a dependency-aware import order. This sequence guarantees that referenced records exist before their dependent records are inserted into the SQLite database.

Can I perform incremental imports into SQLite to skip existing records?

Yes, you can perform incremental imports to skip existing records in the SQLite database. The importer supports this feature alongside batch processing to optimize performance when migrating large sets of Markdown data files.

What Python dependencies do I need to migrate Markdown content into relational storage?

To migrate Markdown content into relational storage, you need Python 3.8 or higher, along with PyYAML and SQLAlchemy. These dependencies are required to parse the YAML frontmatter, validate the data, and persist it to SQLite.

What is the best way to initialize a development database from file-based content?

The best way to initialize a development database from file-based content is using an automated import script. This Skill populates a SQLite database from YAML-frontmatter Markdown records, enabling developers to verify API endpoints with realistic test data.