filter_skymodel.py crashing on final iteration with small /var or /tmp folders
The filter_skymodel.py
overrides any user-set TMPDIR: https://git.astron.nl/RD/rapthor/-/blob/master/rapthor/scripts/filter_skymodel.py#L100
# Try to set the TMPDIR evn var to a short path, to ensure we do not hit the length
# limits for socket paths (used by the mulitprocessing module). We try a number of
# standard paths (the same ones used in the tempfile Python library)
try:
old_tmpdir = os.environ["TMPDIR"]
except KeyError:
old_tmpdir = None
for tmpdir in ['/tmp', '/var/tmp', '/usr/tmp']:
if os.path.exists(tmpdir):
os.environ["TMPDIR"] = tmpdir
break
A reason is given for why this choice was made, but it is tripping me up in pipeline runs because /var or /tmp are not equipped to handle the amount of data that is copied in the final iteration since the whole MS is copied over to get the beam information from.