Level 2 · Intermediate

Modules

1. Incremental Loads & Change Data Capture
2. Data Quality Checks & Validation
3. Partitioning Strategy for a Data Lake
4. Schema Evolution & Handling
5. Orchestration Tools Overview (Airflow DAGs)
6. Idempotent Pipeline Design
7. Backfills & Reprocessing
8. Monitoring & Alerting for Pipelines
9. Data Contracts Between Producers & Consumers
10. Project — Incremental, Validated Lake Pipeline