Senior Data Engineer

This is a comprehensive data engineering skill that goes deep on production pipelines, ETL/ELT patterns, and data infrastructure. You get expertise across the modern data stack (Spark, Airflow, dbt, Kafka) plus actual implementation guidance for distributed processing, data quality validation, and pipeline orchestration. The skill covers both batch and real-time patterns, includes data modeling strategies, and handles DataOps concerns like monitoring and deployment. What stands out is the focus on scalability and production readiness rather than just getting pipelines running. Use this when you're building serious data infrastructure that needs to handle scale, not just proof-of-concept workflows.