Skip to content
Snippets Groups Projects
Select Git revision
  • releases/v0.6.0.tim_survey protected
  • compress_tim_survey
  • releases/v0.5.18 protected
  • v0.5.x
  • expose_elevation_for_parset
  • releases/v0.5.17 protected
  • releases/v0.6.0 protected
  • releases/v0.5.19 protected
  • master default protected
  • releases/v0.5.16 protected
  • releases/v0.5.15 protected
  • nico_testing_juelich
  • nightly_build_test
  • releases/v0.5.14 protected
  • releases/v0.5.13 protected
  • releases/v0.5.12 protected
  • releases/v0.5.11 protected
  • numberOfCorrelatedDataProducts
  • releases/v0.5.10 protected
  • releases/v0.5.9 protected
  • v0.6.0.tim_survey
  • v0.5.18
  • v0.5.17
  • v0.6.0
  • v0.5.16
  • v0.5.15
  • v0.5.14
  • v0.5.13
  • v0.5.12
  • v0.5.11
  • v0.5.10
  • v0.5.9
  • v0.5.8
  • v0.5.7
  • v0.5.6
  • v0.5.5
  • v0.5.4
  • v0.5.3
  • v0.5.2
  • v0.5.1
40 results

extract_sip_meta.cwl

Blame
  • Code owners
    Assign users and groups as approvers for specific file changes. Learn more.
    extract_sip_meta.cwl 2.25 KiB
    class: CommandLineTool
    cwlVersion: v1.1
    id: inspect_flagging_dataloss
    baseCommand:
      - bash
      - script.sh
    inputs:
      - id: msin
        type: Directory
        inputBinding:
          position: 0
      - id: compressed_file
        type: File
        inputBinding:
          position: 1
    outputs:
      - id: ingest
        type: Any
        outputBinding:
          glob: metadata.json
          loadContents: True
          outputEval: |
            ${
              return JSON.parse(self[0].contents)
             }
    label: inspect_flagging_dataloss
    hints:
      - class: DockerRequirement
        dockerPull: git.astron.nl:5000/ldv/imaging_compress_pipeline:v0.5.15
      - class: NetworkAccess
        networkAccess: true
    
    requirements:
      - class: InlineJavascriptRequirement
      - class: InitialWorkDirRequirement
        listing:
         - entryname: pipeline_info.json
           entry: |
            {
                "pipelineRun": {
                "_type": "AveragingPipeline",
                "demixing": "false",
                "pipelineName": "compress_pipeline",
                "strategyName": "Compression pipeline",
                "pipelineVersion": "v0.3.0",
                "strategyDescription": "Compression with system issues fix",
                "timeIntegrationStep": "1",
                "flagAutoCorrelations": "true",
                "frequencyIntegrationStep": "1",
                "numberOfCorrelatedDataProducts": "1"
              }
             }
         - entryname: dataproduct.json
           entry: |
             {
                "dataProduct":
                  {
                    "fileName": $(inputs.compressed_file.basename),
                    "size": $(inputs.compressed_file.size),
                    "fileFormat": "AIPS++/CASA",
                  }
             }
         - entryname: script.sh
           entry: |
             md5=`md5sum $2 | awk '{ print $1 }'`
             cat > md5_sum.json << EOF
             {
                 "dataProduct":
                   {
                     "fileName": $(inputs.compressed_file.basename),
                     "size": $(inputs.compressed_file.size),
                     "md5checksum": $md5
                   }
             }
             EOF
             lofar_sip_from_ms.py --json metadata.json $1
             lofar_sip_merge.py metadata.json pipeline_info.json --json metadata.json
             lofar_sip_merge.py metadata.json dataproduct.json --json metadata.json
             lofar_sip_merge.py metadata.json md5_sum.json --json metadata.json