Course Wiki

PostgreSQL

The relational database running through the courses: local pipeline storage, streaming sinks, and app persistence.

Data Engineering Zoomcamp introduces PostgreSQL in Docker in module 1: pgAdmin and the database run as containers, the SQL refresher runs against them, and ingested taxi data lands in Postgres tables before the course moves to BigQuery. The streaming workshop’s PyFlink pipeline writes its real-time output into PostgreSQL as the sink.

AI Dev Tools Zoomcamp uses Postgres as the app database: the full-stack app starts on SQLite and graduates to Postgres via Docker Compose once integration tests and deployments need a real engine.

Taught in

• LLM Zoomcamp

  • Module 2: Vector Search
    • Vector Search
    • Vector Search with PGVector
  • Module 3: Orchestration
    • AI Copilot
  • Module 5: Monitoring
    • Monitoring
    • Storing Data in PostgreSQL
    • Streamlit Dashboard
    • Synthetic Data Generation
    • Grafana Dashboards
    • Docker Compose
    • Next Steps
  • Module 7: End-to-End Project
    • End-to-End Project Example
    • Monitoring and Containerization
    • Summary and Closing Remarks

• AI Dev Tools Zoomcamp

  • Module 2: Build and Ship an AI-Assisted Full-Stack App
    • Build and Ship an AI-Assisted Full-Stack App
  • Module 3: Test, Containerize, and Deploy an AI-Assisted App
    • Test, Containerize, and Deploy an AI-Assisted App

• MLOps Zoomcamp

  • Module 5: Model Monitoring
    • Debugging with test suites and reports

• Data Engineering Zoomcamp

  • Module 2: Workflow Orchestration
    • 2.3.2 - Local DB: Load Taxi Data to Postgres
  • Module 7: Streaming
    • Streaming ## Related concepts

• Docker

• Stream Processing

• Terraform

• BigQuery

• CI/CD