Level 2 · Intermediate Smarter Pipelines¶
Goal: move beyond a single manual script — write advanced SQL, ingest from APIs, warehouse properly, orchestrate with Airflow, handle incremental loads, work with Parquet/Arrow, test pipelines, learn streaming basics, and use dbt.
Modules¶
- Advanced SQL for Pipelines
- Working with APIs for Ingestion
- Data Warehousing Concepts
- Airflow Hands-On
- Data Partitioning & Incremental Loads
- Working with Parquet/Arrow
- Testing Data Pipelines
- Streaming Basics (Kafka Concepts)
- dbt Basics
- Project — Orchestrated Multi-Step Pipeline
Coming soon
Full lesson content for this level is being written next. Start with Level 1 · Entry, which is complete.