LOFAR Pre-Processing Pipeline

The Low-Frequency Array (LOFAR) Pre-Processing Pipeline is a workflow meant to be run on raw LOFAR data (post-correlation), and includes initial flagging, removal of bright off-axis sources (demixing), averaging in time and frequency, and Dysco compression.

This is an implementation of the pre-processing pipeline in the Common Workflow Language (CWL), which is replacing the Generic Pipeline implementation.

Documentation

Documentation is available on Read the Docs.

Running the Pipeline

The pipeline is currently not in a state that should be run yet! However, if you would like to test the development version, please refer to tests/README.md.

Commissioning Notice

For commissioning purposes, there are a number of parameters exposed that will most like be removed at a later stage. This concerns the following parameters:

• msout_storagemanager: currently exposed for comparison
• dp3_checkparset
• dysco_databitrate
• dysco_weightbitrate
• dysco_distribution