open-table-migrator
CommunityAutomate migration from Parquet/ORC to Iceberg for Python/Java/Scala projects.
Authornever-summer
Version1.0.0
Installs0
System Documentation
What problem does it solve?
This Skill automates the migration of data from Parquet/ORC files to Apache Iceberg format in Python, Java, or Scala projects, reducing manual effort and improving consistency.
Core Features & Use Cases
- Automated Detection: Identifies Parquet/ORC read/write operations in code.
- Mapping and Resolution: Resolves each code operation to its corresponding Iceberg target table.
- Worklist Generation: Generates a detailed worklist for manual review and execution.
- Runbook Creation: Generates an operational runbook for post-migration steps.
- Dependency Update: Updates project dependencies for Iceberg support.
- Use Case: Imagine you have a Java project with multiple Parquet tables and you want to migrate them to Iceberg. The skill will automatically detect the tables, generate a migration plan, and provide a runbook for the cutover.
Quick Start
Use the open-table-migrator skill to convert this project.
Dependency Matrix
Required Modules
pyicebergpyarrowtree-sittersqlglot
Components
scriptsreferences
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: open-table-migrator Download link: https://github.com/never-summer/open-table-migrator/archive/main.zip#open-table-migrator Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 620,000+ vetted skills library on demand.