dplaOfficial·18 Agent Skills Included

ingestion3

Cultural heritage metadata harvesting, enrichment, and pipeline monitoring

Runs end-to-end metadata ingestion for DPLA partner hubs, from OAI-PMH harvest through mapping, enrichment, JSONL export, and S3 sync. Eliminates manual log tailing, per-hub status checks, and error-prone EC2 orchestration with consolidated status views and automated Slack alerts. Handles debugging, retries, takedowns, and monthly partner scheduling emails so operators complete ingest cycles faster.

35|12

↗

npx skills add dpla/ingestion3 --all -g -y

Available:

Tells the agent how to set up the environment, route ingest requests to the right runbooks and skills, and enforce the Slack and email notification policy for pipeline failures.

All Skills in This Repository (18)

Pure Emerald Level Indicators

📦 In Repo

dpla

dpla-ingest-status

Aggregate ingest status across hubs from status logs and orchestrator state.

dpla-hub-info

Display i3.conf hub configuration details from the hub-info script.

dpla-monthly-emails

Generate and distribute monthly DPLA hub scheduling emails from i3.conf.

dpla-run-ingest

Automate hub ingest runs by selecting runbooks and verifying output artifacts.

dpla-verify-and-notify

Verify ingest outcomes and notify stakeholders via Slack or email.

dpla-monitor-ingest-remap

Monitor IngestRemap pipeline progress across hubs via _SUCCESS markers.

send-email

Send ingest summary emails to hub contacts from i3.conf mapping output.

dpla-oai-harvest-watch

Parse OAI harvest logs to report set-by-set progress and ETA.

dpla-ingest-debug

Diagnose and fix DPLA hub ingestion failures across pipeline stages.

dpla-s3-ops

Sync hub data to S3 and verify JSONL exports using the dpla profile.

dpla-community-webs-ingest

Automate Community Webs data harvesting and ingestion into the DPLA pipeline via EC2 and SSM.

dpla-script-workflow

Enforce POSIX bash compatibility and common.sh usage for shell and Python scripts.

Official

Intermediate

Frequently Asked Questions

FAQPage Schema

How to install ingestion3?▼

Run `npx skills add dpla/ingestion3 --all -g -y` in your terminal to install all skills in this suite globally.

How to run a DPLA hub ingest?▼

Ask your agent to ingest a hub by name, and it follows the correct runbook for that hub's harvest type, running harvest, mapping, enrichment, JSONL export, and S3 sync with verification at each stage.

How to check ingest status and debug failures?▼

The status skill shows all active and completed ingests in one table, while the debug skill classifies the failed stage, finds the escalation report, and re-runs only the necessary steps.

Does ingestion3 work with Claude Code and Cursor?▼

Yes. The skills ship in both .claude/skills and .cursor/skills formats and follow the universal SKILL.md standard, so they run in Claude Code, Cursor, and compatible agents.

Can it handle takedown requests and partner emails?▼

Yes. It safely removes items from the live search index and S3 with mandatory verification steps, and generates monthly scheduling emails to hub contacts via AWS SES.