Harvard Artifacts Collection Data Engineering

This is a complete reference implementation for building an ETL pipeline on top of the Harvard Art Museums API. You get the full stack: API client with pagination handling, transformation logic that flattens nested JSON into three normalized tables (metadata, media, colors), MySQL batch loading, and a Streamlit dashboard with Plotly visualizations. The code samples are detailed enough to actually use, showing exactly how to structure the database schema, handle the API's nested color and media arrays, and implement proper foreign key relationships. Good starting point if you need to build similar museum data pipelines or want a realistic example of API-to-warehouse data engineering without the usual tutorial hand-waving.

Install to Claude Code

npx -y skills add aradotso/data-skills --skill harvard-artifacts-collection-data-engineering --agent claude-code