# Crawl window: Thu 11 Sep 04:00 UTC until the log says finished (the first collection on production)

**No deploy to production inside this window** (a deploy recreates the app container and kills the run).
Started by Stream E with rian's go-ahead ("do tonight's work", option a: verify stopped after three
shops, refresh first, verify after). Runs on **bwlive**, writing to the production database; staging
refreshes from the pulled dump later.

| Order | Sources | Note |
|---|---|---|
| 1 | avolta-lhr ath mad bcn zrh hkg yyz mex jfk eze | one process per host, in series (the 5 Sep run took about twelve hours) |
| 2 | the-loop-dublin-cork | |
| 3 | shopify-yul pty bog sal | a refusal at robots is recorded, never retried |
| 4 | ishopchangi-sin, shilla-icn, limit 20 each | the sidecar's first budgeted runs on production |
| 5 | verify --n 20 --mode after_collection | the tripwire, after the refresh |

Log on bwlive: `/srv/apps/dutyfreeprofessor/.logs/runs/night-refresh-2026-09-11.log` (pulled here with the backups at 04:15).

**Interrupted 09:00 UTC:** the droplet rebooted (unattended-upgrades' automatic reboot window, set
by the bootstrap) in the middle of avolta-zrh. Done before it: LHR 536, ATH 281, MAD 309, BCN 356
prices. Not run: ZRH HKG YYZ MEX JFK EZE, Dublin, the four Shopify, Changi, Seoul, the verify.
Automatic reboots are now off on bwlive; a daily check emails rian when a reboot is due
(`deploy/reboot-required-check.sh`). The remaining sources run in a second window.

## Second window: Fri 11 Sep 15:5x UTC until the log says finished (three lanes)

Rian's go, 11 Sep morning. **No production deploy, no migration, until `night-refresh-2026-09-11-lanes.log`
on bwlive ends with "=== finished".** `deploy/production.sh` refuses while a collection runs.

| Lane | Sources |
|---|---|
| A | avolta-zrh, avolta-hkg, avolta-yyz |
| B | avolta-mex, avolta-jfk, avolta-eze |
| C | the-loop-dublin-cork, shopify-yul, -pty, -bog, -sal, ishopchangi-sin 20, shilla-icn 20, extime-paris 200 |
| after all three | verify --n 20 --mode after_collection |

Beauty rides with every Avolta store: shelves one page deep, product pages for the forty targeted lines.