Skip to content

Run DP3 filter step before counts

Frits Sweijen requested to merge filter_before_count into master

This puts the filter step in the DP3 call first, such that subsequent count steps are consistent when they are ultimate used in the summary step.

Reported by Nadia Biava:

The pipeline, however, crashed at the job summary step. This is the summary_err.log:

Error.  nthreads cannot be larger than environment variable "NUMEXPR_MAX_THREADS" (64)Traceback (most recent call last):
 File "/home/nbiava/software/VLBI-cwl/vlbi/scripts/make_summary.py", line 242, in <module>
   main(flagFiles=args.flagFiles, pipeline=args.pipeline, run_type=args.run_type,
 File "/home/nbiava/software/VLBI-cwl/vlbi/scripts/make_summary.py", line 151, in main
   index = [i for (i, item) in enumerate(station_statistics) if item['station'] == antenna][0]
IndexError: list index out of range
Closing remaining open files:/data/nbiava/MS0735/vlbi-cwl/work/nmri_91v/stg60fe3013-0986-49ad-97c6-8c0346d4eb83/merged_addCS_selfcalcyle009_linearfulljones_ILTJ117.3+74.34_142MHz_uv.dp3-concat.copy.phaseup.h5....done

Merge request reports