Who asked: Dana Whitlock, head of finance at Marigold Grocers (fictional).
The question: Why does the midnight report now load the wrong day, and how do you get every day from 1 November loaded correctly?
The data: marigold_daily_report.py, which loads ds into daily_sales; marigold.py (sales and the warehouse).
Done looks like: the midnight run on 9 November loads 8 November, the task code still uses ds, and daily_sales holds each day from 1 to 8 November exactly once.
Marigold upgraded from Airflow 2.10 to 3.3. Since then, finance says the daily sales report, which used to load "yesterday" at midnight, loads the day that has only just started. The Dag file did not change. The warehouse connection is set; the clock is 06:00 UTC on 9 November.