Country or region and language

    Choose your country or region and your language.

    Suggested for you

      All countries and regions

        Choose your character

        It shows in the top bar and on your profile. Change it any time.

        Courses / Data and analytics tools

        Dagster tutorial with practice pipelines

        Learn Dagster by building pipelines as assets in a working Dagster workspace. Define assets and resources, schedule jobs, partition and backfill, react to events with sensors and add asset checks, with every run checked. Projects include a logistics pipeline with dbt and a payments incident.

        Start lesson 1Practice interviewTake the assessmentPractice the first unit of every course. No account needed.
        64lessons
        355checked exercises
        12projects, cases and exams
        Prepares you for Data engineer and analytics engineer interviews and orchestration job tests

        Keep going in Dagster

        Choose access here. Your course is already selected.

        One Course

        Every lesson, project and mock exam in Dagster.

        Loading price/ month

        Billed monthly. Cancel any time.

        All Access

        Every course, exam and project, plus the Interview Hub.

        Loading price/ month

        Billed monthly. Cancel any time.

        Projects, case studies and mock exams

        Project · IntermediateDagster project: a daily revenue pipeline for a shop

        Build Juniper & Pine's daily revenue pipeline: partitions, metadata, a check, a job and a nightly schedule.

        6 steps
        Project · AdvancedDagster project: daily depot metrics for a courier

        Build Larkspur Freight's daily depot metrics: partitions, a KPI with metadata, a warning check, a job, a schedule and a backfill.

        6 steps
        Case study · AdvancedDagster case study: a backfill that half failed

        A backfill of the late rate failed on some days. Find why, fix it, and rerun only what failed.

        5 steps
        Case study · ExpertDagster case study: a sensor that fired twice

        The north depot file was loaded twice after a deploy. Find the cause in the run history and make the sensor safe to re-evaluate.

        5 steps
        Case study · ExpertDagster case study: the partition gap nobody noticed

        A week later, finance finds a missing day. Fill it, explain why the schedule did not, and make the next gap visible.

        4 steps
        Case study · ExpertDagster case study: a secret that differs between environments

        Staging works and production fails on the shop API. Trace it to configuration and move every setting to the environment.

        4 steps
        Project · ExpertDagster project: daily merchant settlements for a payments company

        Build Tallyway's settlement pipeline: deduplication, settlements, a blocking check, freshness and a schedule.

        5 steps
        Mock exam · ExpertDagster job test A (timed)

        A timed, 20-question Dagster job test: assets, selections, config, resources, schedules, partitions, sensors and checks.

        20 questions · 40 min
        Mock exam · ExpertDagster job test B (timed)

        A second timed, 20-question Dagster job test: automation, mappings, backfills, IO managers, testing and production questions.

        20 questions · 40 min

        Practice data orchestration in a browser workspace that runs your Python definitions against a simulation of Dagster 1.13: the asset graph, runs and event logs, partitions and backfills, schedules, sensors, declarative automation, asset checks and a terminal with the dg command line. Start with your first asset and its dependencies, then add metadata, config, resources, partitions, sensors and data quality checks. Later levels cover automation conditions, retries, testing, dbt assets and production operations, with projects in retail, logistics and payments, incident case studies, interview sets and timed mock exams. Every task is checked on your data and on a hidden copy. No installation is needed.

        Interview practice

        Explain what you've learned in a full-screen interview. Speak or type, then review your answers against the rubric for your level.

        Interview loops by job

        Beginner

        FreeNo account or card needed. Every lesson in this unit is yours to practice.

        Assets and the asset graph

        Define assets, connect them and materialize the right selection.

        5 lessons

        Metadata, logs and selection

        Record metadata, log what matters, organize assets and select them precisely.

        5 lessons

        Config, resources and IO

        Parameterize runs, wire external systems as resources, keep secrets out of code and control storage.

        5 lessons

        Intermediate

        Jobs and schedules

        Name selections as jobs and run them on cron schedules in the right time zone.

        4 lessons

        Partitions and backfills

        Partition assets by day, by a fixed list or both, map partitions between assets and backfill history.

        6 lessons

        Sensors and events

        Launch runs when files arrive or assets change, remember progress with cursors, alert on failures and add partitions at run time.

        5 lessons

        Asset checks and freshness

        Test the data with asset checks, stop bad data with blocking checks, declare freshness and build a daily revenue pipeline.

        6 lessons

        Advanced

        Declarative automation

        Keep assets up to date with eager, on_cron and composed automation conditions.

        4 lessons

        Ops, retries and multi-assets

        Write task-style jobs with ops, retry transient failures, fail fast on the rest and produce several assets at once.

        4 lessons

        Testing pipelines

        Test assets directly, test the wiring with materialize, and test sensors and schedules with built contexts.

        4 lessons

        dbt and a logistics project

        Load dbt models as assets, shape their keys and groups, build a partitioned courier pipeline and recover a half-failed backfill.

        4 lessons

        Expert

        Production and migration

        Code locations, the daemon, run queues and concurrency pools, and moving Airflow DAGs to assets.

        3 lessons

        Incidents and a payments project

        Diagnose duplicate runs, partition gaps and environment secrets, then build a settlement pipeline with the safeguards a payments company needs.

        4 lessons

        Interviews and job tests

        Interview questions at three levels and two timed Dagster job tests with explanations.

        5 lessons

        Your Work Gym account

        Save your progress and pick up on another device. Your browser's progress comes with you.

        or

        You can keep practicing without an account.

        Change your plan

        Checking the price

        Help and feedback

        Ask a question, tell us what is not working, or share an idea. We reply by email.

        What is it about?

        We use it only to reply to you.