skills.rest
dpla
dplaOFFICIAL
Explore all skills by this author →
WebsiteGitHub

dpla-staged-report

Identify hubs with newly staged JSONL data in S3 for a given month.

35|12|Updated Jan 10, 2017
Search Tags:#reporting#ingestion#slack#s3#jsonl#staged
One-click install
npx skills add https://github.com/dpla/ingestion3 --skill dpla-staged-report
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: dpla-staged-report
Source: https://github.com/dpla/ingestion3/tree/main/.cursor/skills/dpla-staged-report
Command: npx skills add https://github.com/dpla/ingestion3 --skill dpla-staged-report

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill reports which hubs have new JSONL data staged in S3 for a specified month, helping teams decide when to ingest or review changes.

Core Features & Use Cases

  • Scans s3://dpla-master-dataset/<hub>/jsonl/ for timestamped directories within the target month.
  • Generates a concise report of hubs with newly staged data and optional Slack posting.
  • Supports JSON output for scripting and automation, enabling integration with dashboards and alerts.

Quick Start

Run the staged report for the current month to see which hubs have new JSONL staged in S3.

Frequently Asked Questions about dpla-staged-report

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I check which hubs have newly staged JSONL data in S3 for a specific month?▼

To check for newly staged JSONL data in S3, scan the s3://dpla-master-dataset/<hub>/jsonl/ path for timestamped month directories. This Skill automates that scan and reports which hubs have new data staged for the specified month.

Can I automate S3 JSONL staging reports and send them directly to Slack?▼

Yes, you can automate S3 JSONL staging reports and send them to Slack. The Skill supports a --slack option to post the generated report directly, alongside --json output for integration into automated dashboards and alert pipelines.

What is the best way to identify ingestion readiness for JSONL data staged in S3?▼

The best way to identify ingestion readiness for JSONL data staged in S3 is to parse the timestamped directories under s3://dpla-master-dataset/<hub>/jsonl/. This reveals which hubs have fresh data available for the target month.

How does monthly reporting on S3 JSONL data ingestion work?▼

Monthly reporting on S3 JSONL data ingestion works by scanning hub directories for timestamped month folders. It determines staging readiness and highlights changes, helping teams decide when to review or ingest new data.

Do I need JSON output to integrate S3 staging reports into my existing data pipelines?▼

You need JSON output to integrate S3 staging reports into automated data pipelines. The Skill provides a --json option that formats the report of newly staged JSONL hubs for seamless ingestion by scripts and dashboards.

Related Skills

Explore More Data & Analytics Skills→
dpladpla
35

dpla-s3-ops

Sync hub data to S3 and verify JSONL exports using the dpla profile.

Official
Intermediate
shogo-labsshogo-labs
12

slack-mention-watch

Detect Slack mentions and keywords across channels and workspaces.

Official
Advanced
dpladpla
35

s3-latest

Identify and retrieve the most recent S3 exports for a specified hub.

Official
Basic
omniauraomniaura
17

S3 Analytics Skill

Fetch and analyze S3 time-series analytics data for KPI trend reports.

Official
Intermediate