Harvard Artifacts Etl Pipeline

Here's a solid reference implementation for building an ETL pipeline on top of the Harvard Art Museums API. It walks through the full stack: paginated API calls, transforming nested JSON into normalized SQL tables (metadata, media, colors), loading into MySQL/TiDB, and surfacing analytics through a Streamlit dashboard with Plotly charts. The code is practical and well-structured, showing real patterns like batch inserts with upsert logic and proper environment variable handling. If you're learning data engineering fundamentals or need a template for API-to-dashboard workflows, this covers the essentials without overcomplicating things. The museum domain makes it more interesting to work with than yet another e-commerce dataset.

Install to Claude Code

npx -y skills add aradotso/data-skills --skill harvard-artifacts-etl-pipeline --agent claude-code