Skip to content

GitLab

Closed
Created by Adam Caprez@acaprez2Owner

chip-meta-download should support resuming

Downloading all ~14k individual experiment JSON files can take multiple hours. Right now if the download of a single file fails, the entire download has be started over from the beginning. To support resuming via a command-line option, add a check to see if each experiment JSON file exists and has non-zero size. If so, skip fetching it and go to the next in the list.