harvard-artifacts-collection-data-engineering-analytics

Automate ETL, SQL analytics, and interactive dashboards for Harvard Art Museums API data.

5|1|Updated May 16, 2026
One-click install
npx skills add https://github.com/Aradotso/data-skills --skill harvard-artifacts-collection-data-engineering-analytics
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: harvard-artifacts-collection-data-engineering-analytics
Source: https://github.com/Aradotso/data-skills/tree/main/skills/harvard-artifacts-collection-data-engineering-analytics
Command: npx skills add https://github.com/Aradotso/data-skills --skill harvard-artifacts-collection-data-engineering-analytics

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires streamlit, pandas, requests, mysql-connector-python, plotly, python-dotenv, and includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve?

This Skill addresses the challenge of manually extracting and analyzing complex data from the Harvard Art Museums API, providing a streamlined process to automate ETL, SQL analytics, and visualization.

Core Features & Use Cases

  • End-to-End Data Engineering: Extracts, transforms, and loads data from the Harvard Art Museums API into SQL databases.
  • SQL Analytics: Performs a variety of analytical queries on the dataset, providing insights into the museum collection.
  • Visualizations: Creates interactive dashboards with Streamlit and Plotly for visual representation of data.
  • Use Case: An art historian could use this Skill to quickly analyze trends in museum artifacts by century or culture.

Quick Start

Use the 'harvard-artifacts-collection-data-engineering-analytics' skill to extract and visualize museum artifacts data from the Harvard Art Museums API.

Frequently Asked Questions about harvard-artifacts-collection-data-engineering-analytics

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate ETL workflows for Harvard Art Museums API data?

Automate ETL workflows for Harvard Art Museums API data by using this Skill to extract records via requests, transform them with pandas, and load them directly into a MySQL or TiDB Cloud database for structured analysis.

How do I build a Streamlit dashboard for SQL analytics on museum collections?

Build a Streamlit dashboard for SQL analytics by connecting your MySQL or TiDB Cloud database, executing complex SQL queries on the extracted museum artifacts, and rendering the results as interactive visualizations using Plotly.

Do I need a MySQL database to run SQL analytics on the Harvard Art Museums dataset?

Yes, you need a MySQL or TiDB Cloud database setup. The data engineering pipeline loads extracted Harvard Art Museums API records into a relational database to support complex SQL queries and subsequent Streamlit visualizations.

Can I use pandas and Plotly to visualize trends in Harvard Art Museums artifacts?

Yes, you can use pandas for data transformation and Plotly for interactive visualizations. The Skill generates a Streamlit dashboard to help you analyze specific trends in museum artifacts, such as distributions by century or culture.

What is the best way to extract and analyze Harvard Art Museums data without manual API calls?

The best way to analyze Harvard Art Museums data without manual API calls is to use an automated ETL pipeline. This Skill handles the requests, transformations, and SQL database loading, enabling immediate Streamlit-based SQL analytics.

Are there limitations when using Streamlit and Plotly for large-scale museum collection analytics?

Performance depends on your MySQL or TiDB Cloud database capacity and query optimization. While Plotly and Streamlit render interactive dashboards, executing highly complex SQL analytics on extremely large museum datasets may require database-level indexing to prevent loading latency.