Skip to content
Snippets Groups Projects
Select Git revision
  • e04a160395aa60db66afd2bcb3779b6d31ca54f2
  • master default protected
  • RAP-1185_do-not-compile-tests
  • RAP-1176_switch-git-image
  • mammoth_august
  • mammoth_september
  • flag_on_polarisation
  • 3c48_logSI
  • optimize_workflow
  • ingest_info
  • poppy_integration_v50
  • releases/v5.1 protected
  • releases/v5.1rc1 protected
  • reverse_versions
  • poppy_integration
  • releases/v5.0 protected
  • use-versioned-releases
  • releases/v5.0rc2 protected
  • releases/v5.0rc1 protected
  • releases/ldv_v407_atdb protected
  • ldv_v407_debug
  • v5.1
  • v5.0
  • v5.0rc2
  • v5.0rc1
  • ldv_v406_debug
  • ldv_v405_debug
  • ldv_v404
  • ldv_v403
  • ldv_v402
  • v4.0
  • ldv_v401
  • ldv_v40
  • ldv_v031
  • ldv_v03
  • ldv_v01
36 results

LINC

  • Open with
  • Download source code
  • Your workspaces

      A workspace is a virtual sandbox environment for your code in GitLab.

      No agents available to create workspaces. Please consult Workspaces documentation for troubleshooting.

  • Andre Offringa's avatar
    Andre Offringa authored
    CI fixes
    
    See merge request eosc/prefactor3-cwl!65
    
    Former-commit-id: dc198669
    Former-commit-id: 75f2456a
    Former-commit-id: 8496ac90
    e04a1603
    History

    prefactor

    The LOFAR pre-facet calibration pipeline

    prefactor is a pipeline to correct for various instrumental and ionospheric effects in both LOFAR HBA and LOFAR LBA observations. It will prepare your data so that you will be able to use any direction-dependent calibration software, like Rapthor, factor, or killMS.

    It includes:

    • removal of clock offsets between core and remote stations (using clock-TEC separation)
    • correction of the polarization alignment between XX and YY
    • robust time-independent bandpass correction
    • ionospheric RM corrections with RMextract
    • removal of the element beam
    • advanced flagging and removal of bad data
    • mitigation of broad-band RFI and bad stations
    • direction-independent phase correction of the target, using a global sky model from TGSS ADR or the new Global Sky Model GSM
    • detailled diagnostics

    The full documentation can be found at the prefactor webpage.

    WARNING: The current skymodel used for 3C295 is not using the Scaife&Heald flux density scale.

    Software requirements

    Installation

    Detailled installation instructions for prefactor are available at the prefactor documentation.

    It is recommended to use Docker or Singularity for the use of software containers.

    To download and install the repository run the following commands:

    git clone https://git.astron.nl/eosc/prefactor3-cwl.git prefactor --depth 1
    cd prefactor
    pip3 install --upgrade $PWD

    Running prefactor

    Instructions how to setup and run prefactor are also available at the prefactor documentation.

    Directory structure

    prefactor contains the following sub-directories:

    • Docker: contains the Dockerfile for creating the Docker image which contains all necessary software packages
    • docs: contains the documentation for prefactor
    • rfistrategies: strategies for statistical RFI mitigation using AOFlagger
    • scripts: scripts that the pipeline calls to process data, generate plots, etc.
    • skymodels: skymodels that are used by the pipeline (e.g. for demixing or calibrating the calibrator)
    • solutions: template solutions for the use of non-supported calibrator sources
    • steps: steps of the pipeline described in the Common Workflow Language (CWL)
    • test_jobs: descriptions for running continouos integration (CI)
    • workflows: pipeline workflow desriptions in the Common Workflow Language (CWL)

    prefactor and its scripts were developed by:

    • Alexander Drabent
    • David Rafferty
    • Mattia Mancini
    • Marcel Loose
    • Andreas Horneffer
    • Francesco de Gasperin
    • Marco Iacobelli
    • Emanuela Orru
    • Björn Adebahr
    • Martin Hardcastle
    • George Heald
    • Soumyajit Mandal
    • Carole Roskowinski
    • Jose Sabater Montes
    • Timothy Shimwell
    • Sarrvesh Sridhar
    • Reinout van Weeren
    • Wendy Williams

    Acknowledgements

    EU Flag EOSC-hub logo This work is co-funded by the EOSC-hub project (Horizon 2020) under Grant number 777536.

    This work was supported by the BMBF Verbundforschung under the grant 05A20STA.

    The Prefactor procedure is described in this paper:

    • de Gasperin, F.; Dijkema, T. J.; Drabent, A.; Mevius, M.; Rafferty, van Weeren, R., et al. 2019, A&A, 662, A5