Detect partially downloaded or unzipped files, and retry. If Azure supports HTTP HEAD, we can check file sizes somewhat cheaply. It'd still not be ideal to hit the network unnecessarily -- so maybe we use data/manifest.csv as a local source of truth, and compare byte count or md5sum.
Detect partially downloaded or unzipped files, and retry. If Azure supports
HTTP HEAD, we can check file sizes somewhat cheaply. It'd still not be ideal to hit the network unnecessarily -- so maybe we usedata/manifest.csvas a local source of truth, and compare byte count or md5sum.