skills.rest
dpla
dplaOFFICIAL
Explore all skills by this author →
WebsiteGitHub

dpla-community-webs-ingest

Automate Community Webs data harvesting and ingestion into the DPLA pipeline via EC2 and SSM.

35|12|Updated Jan 10, 2017
Search Tags:#automation#ec2#ingest#ssm#community-webs#dpla
One-click install
npx skills add https://github.com/dpla/ingestion3 --skill dpla-community-webs-ingest
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: dpla-community-webs-ingest
Source: https://github.com/dpla/ingestion3/tree/main/.cursor/skills/dpla-community-webs-ingest
Command: npx skills add https://github.com/dpla/ingestion3 --skill dpla-community-webs-ingest

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill automates the harvesting and ingestion of Community Webs data into the DPLA ingestion pipeline, reducing manual setup and processing steps.

Core Features & Use Cases

  • Prepares data for ingestion via the dpla-hub-ingest workflow.
  • Runs pre-processing on EC2 via SSM, with no local steps required.
  • Responds to trigger phrases like ingest community-webs or harvest community-webs to start workflows.

Quick Start

Instruct the system to ingest community-webs using the dpla-hub-ingest workflow.

Frequently Asked Questions about dpla-community-webs-ingest

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate Community Webs data harvesting and ingestion into the DPLA pipeline?▼

Automating Community Webs data harvesting and ingestion into the DPLA pipeline requires triggering workflows via specific phrases like ingest community-webs, which initiates the dpla-hub-ingest workflow on EC2 using SSM.

Do I need local processing steps to run Community Webs ingestion?▼

Running Community Webs ingestion requires no local processing steps because all pre-processing executes remotely on EC2 via SSM, preparing the data directly for the DPLA ingestion pipeline.

What trigger phrases start the Community Webs harvest workflow?▼

The trigger phrases harvest community-webs and ingest community-webs start the Community Webs harvest workflow, automating the data preparation and ingestion process into the DPLA pipeline.

Can I use EC2 and SSM to preprocess Community Webs data for ingestion?▼

You can use EC2 and SSM to preprocess Community Webs data for ingestion, as the automation runs pre-processing steps remotely on EC2 via SSM before entering the dpla-hub-ingest workflow.

What is the dpla-hub-ingest workflow used for in Community Webs data processing?▼

The dpla-hub-ingest workflow is used for preparing and ingesting harvested Community Webs data into the DPLA pipeline, serving as the required downstream workflow after EC2 and SSM preprocessing.

Are there limitations when automating Community Webs ingestion via SSM?▼

Automating Community Webs ingestion via SSM is limited by its dependency on the dpla-hub-ingest workflow and EC2 preprocessing, requiring clearly defined trigger phrases to function correctly.

Related Skills

Explore More Software Engineering Skills→
dpladpla
35

DPLA Hub Ingest

Automate DPLA hub ingest from harvest to S3 sync on EC2.

Official
Advanced
dpladpla
35

dpla-s3-ops

Sync hub data to S3 and verify JSONL exports using the dpla profile.

Official
Intermediate
dpladpla
35

dpla-s3-and-aws

Coordinate S3 data synchronization and AWS operations for the DPLA ingestion pipeline.

Official
Intermediate
TeamSparkAITeamSparkAI
18

mcpgraph

Build no-code MCP servers using YAML graphs with JSONata and JSON Logic.

Official
Advanced