dpla-run-ingest

Automate hub ingest runs by selecting runbooks and verifying output artifacts.

35|12|Updated Jan 10, 2017
One-click install
npx skills add https://github.com/dpla/ingestion3 --skill dpla-run-ingest
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: dpla-run-ingest
Source: https://github.com/dpla/ingestion3/tree/main/.cursor/skills/dpla-run-ingest
Command: npx skills add https://github.com/dpla/ingestion3 --skill dpla-run-ingest

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Automates end-to-end hub ingest runs by selecting the correct runbook and scripts, ensuring consistent execution and output verification for single-hub or manual ingests.

Core Features & Use Cases

  • Identify the hub and harvest type, select the appropriate runbook, and execute the corresponding scripts to complete harvest, remap, or the full pipeline.
  • Verify outputs at each stage using standard artifacts (_SUCCESS, _MANIFEST, _SUMMARY) to confirm successful processing.

Quick Start

Specify the hub and run the corresponding ingest workflow using the correct runbook and scripts.

Frequently Asked Questions about dpla-run-ingest

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate a hub ingest run from start to finish?

To automate a hub ingest run, this Skill selects the correct runbook and scripts based on your hub and harvest type, executing the harvest, remap, or full pipeline automatically. It ensures consistent execution by validating outputs using _SUCCESS, _MANIFEST, and _SUMMARY artifacts at each stage.

What is the best way to identify the harvest type for a single-hub ingest?

The harvest type for a single-hub ingest is identified via the i3.conf file. This Skill reads the configuration to determine the correct harvest type, ensuring the appropriate runbook and corresponding scripts are selected for your manual or automated ingest workflow.

Does this approach support running individual harvest or remap stages independently?

Yes, this approach supports running individual harvest or remap stages independently across hubs. You can execute a specific stage or the full pipeline by selecting the appropriate runbook and scripts, with output verification confirming successful processing at each step.

How do I verify outputs after a manual hub ingest process?

To verify outputs after a manual hub ingest process, this Skill checks for standard artifacts including _SUCCESS, _MANIFEST, and _SUMMARY files. These artifacts confirm that each stage of the harvest, remap, or full pipeline executed successfully and produced valid outputs.

Can I use this method for both single-hub and manual ingests?

Yes, this method applies to both single-hub and manual ingests. It automates end-to-end hub ingest runs by selecting the correct runbook and scripts tailored to your specific hub, ensuring consistent execution and output verification regardless of scale.