open-table-migrator

Automate Parquet/ORC to Apache Iceberg migration in Python, Java, or Scala projects.

2|Updated Apr 12, 2026
One-click install
npx skills add https://github.com/never-summer/open-table-migrator --skill open-table-migrator
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: open-table-migrator
Source: https://github.com/never-summer/open-table-migrator/tree/main/skills/open_table_migrator
Command: npx skills add https://github.com/never-summer/open-table-migrator --skill open-table-migrator

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires pyiceberg, pyarrow, tree-sitter, sqlglot, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill automates the migration of data from Parquet/ORC files to Apache Iceberg format in Python, Java, or Scala projects, reducing manual effort and improving consistency.

Core Features & Use Cases

  • Automated Detection: Identifies Parquet/ORC read/write operations in code.
  • Mapping and Resolution: Resolves each code operation to its corresponding Iceberg target table.
  • Worklist Generation: Generates a detailed worklist for manual review and execution.
  • Runbook Creation: Generates an operational runbook for post-migration steps.
  • Dependency Update: Updates project dependencies for Iceberg support.
  • Use Case: Imagine you have a Java project with multiple Parquet tables and you want to migrate them to Iceberg. The skill will automatically detect the tables, generate a migration plan, and provide a runbook for the cutover.

Quick Start

Use the open-table-migrator skill to convert this project.

Frequently Asked Questions about open-table-migrator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I migrate Parquet tables to Iceberg in a Python project?

To migrate Parquet tables to Iceberg in a Python project, you can automate code analysis, table mapping, and dependency updates. This detects Parquet read/write operations and generates a detailed migration worklist and operational runbook for execution.

Can I migrate ORC files to Apache Iceberg automatically in Java or Scala?

Yes, you can automatically migrate ORC files to Apache Iceberg in Java or Scala projects. The process identifies ORC operations in your code, resolves them to corresponding Iceberg target tables, and updates project dependencies to support Iceberg.

What dependencies are required to convert Parquet or ORC tables to Iceberg?

Converting Parquet or ORC tables to Iceberg requires pyiceberg and pyarrow to handle table formats, along with tree-sitter and sqlglot to perform code analysis and SQL parsing for resolving table operations during the migration.

What is the process for mapping code operations to Iceberg target tables?

Mapping code operations to Iceberg target tables involves analyzing your source code to identify existing Parquet or ORC read and write operations. It then resolves each operation to its corresponding Iceberg target table to generate a comprehensive migration worklist.

Does migrating to Apache Iceberg update my project dependencies automatically?

Yes, migrating to Apache Iceberg updates project dependencies automatically to support Iceberg. Alongside dependency updates, the migration process generates a detailed worklist for manual review and an operational runbook for post-migration cutover steps.