Harvard Art Museum Data Pipeline

This is a complete ETL reference implementation for the Harvard Art Museums API that goes beyond toy examples. It shows you how to handle pagination and rate limiting when extracting thousands of artifacts, normalize nested JSON into a three-table relational schema (metadata, media, colors), and batch load into MySQL or TiDB Cloud. The included Streamlit dashboard with 20+ analytical queries gives you working examples of how to actually use the data once it's loaded. If you're learning data engineering or need a starting point for museum or cultural heritage data projects, this covers the full pipeline with production considerations like connection pooling and error handling. The schema design is sensible and the transform functions handle missing fields gracefully.

Install to Claude Code

npx -y skills add aradotso/data-skills --skill harvard-art-museum-data-pipeline --agent claude-code