DataTalks.Club

Articles Slack Events Podcast Wiki Books Courses

Course Wiki

Module 2: Workflow Orchestration — Data Engineering Zoomcamp

Lessons, materials, and key concepts for module 2 of Data Engineering Zoomcamp.

Related Pages

Data Engineering Zoomcamp

Data Engineering Zoomcamp > Module 2: Workflow Orchestration

The lessons, homework, and materials of module 2 of Data Engineering Zoomcamp.

Lessons

LessonVideo
2.1.1 - What is Workflow Orchestration?video
2.1.2 - What is Kestra?video
2.2.1 - Installing Kestravideo
2.2.2 - Kestra Conceptsvideo
2.2.3 - Orchestrate Python Codevideo
2.3.1 - Getting Started Pipelinevideo
2.3.2 - Local DB: Load Taxi Data to Postgresvideo
2.3.3 - Scheduling and Backfillsvideo
2.4.1 - ETL vs ELTvideo
2.4.2 - Setup Google Cloud Platformvideo
2.4.3 - Create an ETL Pipeline with GCS and BigQuery in Kestravideo
2.4.4 - GCP Workflow: Schedule and Backfillsvideo
2.5.1 - Using AI for Data Engineeringvideo
2.5.2 - Context Engineering with ChatGPTvideo
2.5.3 - AI Copilot in Kestravideo

Key concepts

Homework and deadlines live in the course repository: data-engineering-zoomcamp.

Other modules in this course

DataTalks.Club. Hosted on GitHub Pages. Built with Rustkyll. We use cookies.