r2-glacier-migration

Migrate Cloudflare R2 objects to AWS Glacier Deep Archive with checkpoint-based resume.

4.9k|974|Updated Apr 15, 2021
One-click install
npx skills add https://github.com/pollinations/pollinations --skill r2-glacier-migration
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: r2-glacier-migration
Source: https://github.com/pollinations/pollinations/tree/main/.claude/skills/r2-glacier-migration
Command: npx skills add https://github.com/pollinations/pollinations --skill r2-glacier-migration

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires @aws-sdk/client-s3, archiver, and includes scripts (resource) components.

What problem does it solve?

Archiving billions of objects cost-effectively by migrating from Cloudflare R2 to AWS Glacier Deep Archive, enabling long-term storage with significant cost savings.

Core Features & Use Cases

  • Streaming Transfer: Object streaming from R2 to Glacier archives with resume support.
  • Checkpointing: Save progress to resume interrupted transfers.
  • Dry-Run & Production Run: Support for dry-run estimates and full migrations.
  • Automation: CLI-driven workflows for batch transfers.

Quick Start

Run the migration with the provided script: node r2-to-glacier-streaming.js -b pollinations-text

Frequently Asked Questions about r2-glacier-migration

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I migrate data from Cloudflare R2 to AWS Glacier Deep Archive?

Migrate Cloudflare R2 objects to AWS Glacier Deep Archive using streaming transfer with batched archiving. The Skill handles large-scale migrations with checkpoint-based resume, concurrency-controlled downloads, and credential-based access to archive billions of objects cost-effectively for long-term storage.

Can I resume an R2 to Glacier migration if it gets interrupted?

Yes, the Skill supports checkpoint-based resume. Progress is saved automatically, allowing interrupted transfers to restart without reprocessing completed objects, essential for large-scale migrations across R2 buckets.

What's the best way to handle large-scale archiving without loading everything into memory?

Streaming transfer with batching is the optimal approach for large-scale archiving. The Skill streams objects from R2 directly into Glacier Deep Archive in batches (e.g., 50,000 objects per archive), eliminating memory overhead.

Does this Skill support dry-run before running a full migration?

Yes, dry-run mode is supported. Test your migration parameters and estimate costs without transferring actual data, then run the production migration when ready using CLI-driven workflows.

What credentials and setup do I need before migrating to Glacier?

You need Cloudflare R2 credentials and AWS S3 credentials with Glacier Deep Archive access. The Skill uses credential-based authentication for both platforms to enable secure streaming transfers.