← Back to courses
DatabricksIntermediateUpcoming

Databricks Applied

Data Pipelines and Streaming Workloads

8 hours28 lessons Self-study
EE
Emmanuel Edegbo

Lead Data Engineer & Architect

About this course

Build Delta Live Tables pipelines, streaming ingestion, and orchestrated workflows for production data platforms.

Datasets used

SalesPYRetail dataset loaded as Delta tables for transformation and aggregation work.
FinancePYCompliance dataset for monitoring and aggregation pipelines on the Lakehouse.

Tools you'll need

  • Databricks Community Edition or paid workspace
  • PySpark
  • SQL

What you get when you enrol

  • Lifetime access to every lesson, exercise, and update — including future revisions to this course.
  • 12-month Azure SQL practice access against the same datasets used in the course (read-only). Renews on request for active learners.
  • Auto-graded labs in your browser — write SQL, hit Run, get instant feedback against the expected result.
  • AI-graded Professional Challenges — open-ended scenarios reviewed against a published rubric, not just a single right answer.
  • Course discussion + community — talk to other learners and ask the instructor questions inside the course.
  • Basic Certificate on demonstrated capability — awarded when you complete every Hands-On Lab and Module Readiness Check, plus the Professional Challenges. Confirms you can write, run, and defend course-level SQL against real datasets.
  • Optional Advanced Certificate on completion of SQL Core multi-project— a separate credential awarded when you complete all three capstone projects, each independently assessed and approved by an instructor. Each project is end-to-end query engineering against a real brief with defined acceptance criteria — proves competence at a level an employer can actually evaluate. The Basic Certificate alone confirms course mastery; the Advanced Certificate confirms you can deliver.
  • Optional live training upgrade — instructor-led cohort sessions with capped capacity, sold separately.

What you'll learn

  • Build Delta Live Tables (DLT) pipelines with expectations
  • Implement streaming ingestion with Auto Loader and Structured Streaming
  • Orchestrate multi-task workflows with dependencies
  • Apply SCD Type 1 and Type 2 patterns in DLT
  • Monitor pipeline health and implement quarantine patterns
  • Complete a production data pipeline project

Who this is for

Software testersAdvanced data analystsData engineersData scientists

Prerequisites

  • Databricks Core or equivalent lakehouse foundation

What learners say

How ratings work
4.7
38 ratings (time-weighted)
  1. 5
    27
  2. 4
    11
  3. 3
    0
  4. 2
    0
  5. 1
    0

Course discussion

Open to enrolled learners

Sign in to read and post in the course discussion.

Sign in