One Course
Every lesson, project and mock exam in Dagster.
Billed monthly. Cancel any time.
Level 1: Newcomer
0 points
Sign in to save your progress across devices.
Courses / Data and analytics tools
Learn Dagster by building pipelines as assets in a working Dagster workspace. Define assets and resources, schedule jobs, partition and backfill, react to events with sensors and add asset checks, with every run checked. Projects include a logistics pipeline with dbt and a payments incident.
Choose access here. Your course is already selected.
Build Juniper & Pine's daily revenue pipeline: partitions, metadata, a check, a job and a nightly schedule.
6 stepsProject · AdvancedDagster project: daily depot metrics for a courierBuild Larkspur Freight's daily depot metrics: partitions, a KPI with metadata, a warning check, a job, a schedule and a backfill.
6 stepsCase study · AdvancedDagster case study: a backfill that half failedA backfill of the late rate failed on some days. Find why, fix it, and rerun only what failed.
5 stepsCase study · ExpertDagster case study: a sensor that fired twiceThe north depot file was loaded twice after a deploy. Find the cause in the run history and make the sensor safe to re-evaluate.
5 stepsCase study · ExpertDagster case study: the partition gap nobody noticedA week later, finance finds a missing day. Fill it, explain why the schedule did not, and make the next gap visible.
4 stepsCase study · ExpertDagster case study: a secret that differs between environmentsStaging works and production fails on the shop API. Trace it to configuration and move every setting to the environment.
4 stepsProject · ExpertDagster project: daily merchant settlements for a payments companyBuild Tallyway's settlement pipeline: deduplication, settlements, a blocking check, freshness and a schedule.
5 stepsMock exam · ExpertDagster job test A (timed)A timed, 20-question Dagster job test: assets, selections, config, resources, schedules, partitions, sensors and checks.
20 questions · 40 minMock exam · ExpertDagster job test B (timed)A second timed, 20-question Dagster job test: automation, mappings, backfills, IO managers, testing and production questions.
20 questions · 40 minPractice data orchestration in a browser workspace that runs your Python definitions against a simulation of Dagster 1.13: the asset graph, runs and event logs, partitions and backfills, schedules, sensors, declarative automation, asset checks and a terminal with the dg command line. Start with your first asset and its dependencies, then add metadata, config, resources, partitions, sensors and data quality checks. Later levels cover automation conditions, retries, testing, dbt assets and production operations, with projects in retail, logistics and payments, incident case studies, interview sets and timed mock exams. Every task is checked on your data and on a hidden copy. No installation is needed.
Work one company brief through several tools. Your Dagster stage reads the tables from the stage before.
Explain what you've learned in a full-screen interview. Speak or type, then review your answers against the rubric for your level.
Interview loops by jobBeginner
Define assets, connect them and materialize the right selection.
Record metadata, log what matters, organize assets and select them precisely.
Parameterize runs, wire external systems as resources, keep secrets out of code and control storage.
Intermediate
Name selections as jobs and run them on cron schedules in the right time zone.
Partition assets by day, by a fixed list or both, map partitions between assets and backfill history.
Launch runs when files arrive or assets change, remember progress with cursors, alert on failures and add partitions at run time.
Test the data with asset checks, stop bad data with blocking checks, declare freshness and build a daily revenue pipeline.
Advanced
Keep assets up to date with eager, on_cron and composed automation conditions.
Write task-style jobs with ops, retry transient failures, fail fast on the rest and produce several assets at once.
Test assets directly, test the wiring with materialize, and test sensors and schedules with built contexts.
Load dbt models as assets, shape their keys and groups, build a partitioned courier pipeline and recover a half-failed backfill.
Expert
Code locations, the daemon, run queues and concurrency pools, and moving Airflow DAGs to assets.
Diagnose duplicate runs, partition gaps and environment secrets, then build a settlement pipeline with the safeguards a payments company needs.
Interview questions at three levels and two timed Dagster job tests with explanations.