LOFAR Pre-Processing Pipeline

The Low-Frequency Array (LOFAR) Pre-Processing Pipeline is a workflow meant to be run on raw LOFAR data (post-correlation), and includes initial flagging, removal of bright off-axis sources (demixing), averaging in time and frequency, and Dysco compression.

This is an implementation of the pre-processing pipeline in the Common Workflow Language (CWL), which is replacing the Generic Pipeline implementation.

Running the Pipeline

The pipeline is currently not in a state that should be run yet! However, if you would like to test the development version, please refer to tests/README.md.

Commissioning Notice

For commissioning purposes, there are a number of parameters exposed that will most like be removed at a later stage. This concerns the following parameters:

• msout_storagemanager: currently exposed for comparison
• dp3_checkparset
• dysco_databitrate
• dysco_weightbitrate
• dysco_distribution