Harvard Artifacts Data Engineering Analytics

If you're learning data engineering or need a reference implementation for API-to-database pipelines, this walks through the full stack with a real dataset. It pulls from Harvard Art Museums API, transforms nested JSON into a three-table relational schema (metadata, media, colors), batch loads into MySQL, and builds a Streamlit dashboard with 20+ analytical queries and Plotly visualizations. The code handles pagination and rate limiting properly, shows actual SQL DDL and insert patterns, and demonstrates end-to-end ETL flow. Best used as a template for similar API ingestion projects or as teaching material for Python/SQL workflows. The schema design is straightforward and the transformation logic is clear enough to adapt to other museum or catalog APIs.

Install to Claude Code

npx -y skills add aradotso/data-skills --skill harvard-artifacts-data-engineering-analytics --agent claude-code