← Back to courses
DatabricksIntermediateUpcoming
Databricks Applied
Data Pipelines and Streaming Workloads
8 hours28 lessons Self-study
EE
Emmanuel Edegbo
Lead Data Engineer & Architect
About this course
Build Delta Live Tables pipelines, streaming ingestion, and orchestrated workflows for production data platforms.
Datasets used
| SalesPY | Retail dataset loaded as Delta tables for transformation and aggregation work. |
| FinancePY | Compliance dataset for monitoring and aggregation pipelines on the Lakehouse. |
Tools you'll need
- •Databricks Community Edition or paid workspace
- •PySpark
- •SQL
What you get when you enrol
- ✓Lifetime access to every lesson, exercise, and update — including future revisions to this course.
- ✓12-month Azure SQL practice access against the same datasets used in the course (read-only). Renews on request for active learners.
- ✓Auto-graded labs in your browser — write SQL, hit Run, get instant feedback against the expected result.
- ✓AI-graded Professional Challenges — open-ended scenarios reviewed against a published rubric, not just a single right answer.
- ✓Course discussion + community — talk to other learners and ask the instructor questions inside the course.
- ✓Basic Certificate on demonstrated capability — awarded when you complete every Hands-On Lab and Module Readiness Check, plus the Professional Challenges. Confirms you can write, run, and defend course-level SQL against real datasets.
- ✓Optional Advanced Certificate on completion of SQL Core multi-project— a separate credential awarded when you complete all three capstone projects, each independently assessed and approved by an instructor. Each project is end-to-end query engineering against a real brief with defined acceptance criteria — proves competence at a level an employer can actually evaluate. The Basic Certificate alone confirms course mastery; the Advanced Certificate confirms you can deliver.
- ✓Optional live training upgrade — instructor-led cohort sessions with capped capacity, sold separately.
What you'll learn
- ✓Build Delta Live Tables (DLT) pipelines with expectations
- ✓Implement streaming ingestion with Auto Loader and Structured Streaming
- ✓Orchestrate multi-task workflows with dependencies
- ✓Apply SCD Type 1 and Type 2 patterns in DLT
- ✓Monitor pipeline health and implement quarantine patterns
- ✓Complete a production data pipeline project
Who this is for
Software testersAdvanced data analystsData engineersData scientists
Prerequisites
- •Databricks Core or equivalent lakehouse foundation
What learners say
How ratings work4.7
38 ratings (time-weighted)
- 5★27
- 4★11
- 3★0
- 2★0
- 1★0
Course discussion
Open to enrolled learnersSign in to read and post in the course discussion.
Sign in