AGLOW issueshttps://git.astron.nl/astron-sdc/AGLOW/-/issues2020-05-29T11:58:08Zhttps://git.astron.nl/astron-sdc/AGLOW/-/issues/2Downloading issues2020-05-29T11:58:08ZTimothy ShimwellDownloading issuesBy far the most common errors in AGLOW runs are simpl edownloading errors. Easy to fix by just resetting the tokens and running again. However, particularly when processing poznan data (and more severe when not dysco compressed) in SARA ...By far the most common errors in AGLOW runs are simpl edownloading errors. Easy to fix by just resetting the tokens and running again. However, particularly when processing poznan data (and more severe when not dysco compressed) in SARA this gets quite tedious as many resets are needed before e.g. all 230 odd target files are successfully downloaded so generally almost every field fails (whilst poznan is the most severe case even processing sara data at sara regularly gives errors).
Would be great if we could improve this. Perhaps even something simply like increasing the number of retries before the tokens fail. Not sure if anyone has any ideas to make this more robust? I guess that submitting all 230 odd target tokens at the same time sometimes results in a very large number of simultaneous downloads which isn't great.