dpla-community-webs-ingest

Automate Community Webs data harvesting and ingestion into the DPLA pipeline via EC2 and SSM.

35|12|Updated Jan 10, 2017

Search Tags:#automation #ec2 #ingest #ssm #community-webs #dpla

Ready to run

npx skills add https://github.com/dpla/ingestion3 --skill dpla-community-webs-ingest

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: dpla-community-webs-ingest
Source: https://github.com/dpla/ingestion3/tree/main/.cursor/skills/dpla-community-webs-ingest
Command: npx skills add https://github.com/dpla/ingestion3 --skill dpla-community-webs-ingest

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill automates the harvesting and ingestion of Community Webs data into the DPLA ingestion pipeline, reducing manual setup and processing steps.

Core Features & Use Cases

Prepares data for ingestion via the dpla-hub-ingest workflow.
Runs pre-processing on EC2 via SSM, with no local steps required.
Responds to trigger phrases like ingest community-webs or harvest community-webs to start workflows.

Quick Start

Instruct the system to ingest community-webs using the dpla-hub-ingest workflow.

Frequently Asked Questions about dpla-community-webs-ingest

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I automate Community Webs data harvesting and ingestion into the DPLA pipeline?▼

Automating Community Webs data harvesting and ingestion into the DPLA pipeline requires triggering workflows via specific phrases like ingest community-webs, which initiates the dpla-hub-ingest workflow on EC2 using SSM.

Do I need local processing steps to run Community Webs ingestion?▼

Running Community Webs ingestion requires no local processing steps because all pre-processing executes remotely on EC2 via SSM, preparing the data directly for the DPLA ingestion pipeline.

What trigger phrases start the Community Webs harvest workflow?▼

The trigger phrases harvest community-webs and ingest community-webs start the Community Webs harvest workflow, automating the data preparation and ingestion process into the DPLA pipeline.

Can I use EC2 and SSM to preprocess Community Webs data for ingestion?▼

You can use EC2 and SSM to preprocess Community Webs data for ingestion, as the automation runs pre-processing steps remotely on EC2 via SSM before entering the dpla-hub-ingest workflow.

What is the dpla-hub-ingest workflow used for in Community Webs data processing?▼

The dpla-hub-ingest workflow is used for preparing and ingesting harvested Community Webs data into the DPLA pipeline, serving as the required downstream workflow after EC2 and SSM preprocessing.

Are there limitations when automating Community Webs ingestion via SSM?▼

Automating Community Webs ingestion via SSM is limited by its dependency on the dpla-hub-ingest workflow and EC2 preprocessing, requiring clearly defined trigger phrases to function correctly.