Course Wiki

Bruin

An end-to-end data platform that bundles ingestion, transformation, orchestration, quality, and lineage in one project.

Module 5 shows what happens when the pipeline tools merge: Bruin runs a complete data lifecycle from a single project — ingestion from sources to the warehouse, SQL and Python transformations, orchestration with scheduling and dependency management, built-in data quality checks, and metadata such as lineage and documentation.

The module’s hands-on work is a guided template: initialize a project, fill in the pipeline configuration and code, and deploy the result to BigQuery. The takeaway is architectural — the modern data stack’s separate tools (an orchestrator here, a transformation tool there, a quality checker elsewhere) can also arrive as one integrated platform.

Taught in

• Data Engineering Zoomcamp

  • Module 5: Data Platforms
    • Introduction to Bruin
    • Getting Started with Bruin
    • Using Bruin MCP with AI Agents
    • Deploying to Bruin Cloud
    • Projects
    • Commands ## Related concepts

• dbt

• BigQuery

• Workflow Orchestration

• dlt

• Docker