Skip to content
GitLab
Explore
Sign in
Register
Primary navigation
Search or go to…
Project
LINC
Manage
Activity
Members
Labels
Plan
Issues
Issue boards
Milestones
Iterations
Wiki
Requirements
Jira
Code
Merge requests
Repository
Branches
Commits
Tags
Repository graph
Compare revisions
Snippets
Locked files
Build
Pipelines
Jobs
Pipeline schedules
Test cases
Artifacts
Deploy
Releases
Container registry
Model registry
Operate
Environments
Monitor
Incidents
Analyze
Value stream analytics
Contributor analytics
CI/CD analytics
Repository analytics
Code review analytics
Issue analytics
Insights
Model experiments
Help
Help
Support
GitLab documentation
Compare GitLab plans
Community forum
Contribute to GitLab
Provide feedback
Keyboard shortcuts
?
Snippets
Groups
Projects
Show more breadcrumbs
ResearchAndDevelopment
LINC
Commits
d91d41f6
Commit
d91d41f6
authored
4 years ago
by
alex
Browse files
Options
Downloads
Patches
Plain Diff
add pointingname
Former-commit-id:
398eac96
parent
325e562e
No related branches found
No related tags found
No related merge requests found
Changes
3
Show whitespace changes
Inline
Side-by-side
Showing
3 changed files
steps/get_targetname.cwl
+55
-0
55 additions, 0 deletions
steps/get_targetname.cwl
steps/h5parm_pointingname.cwl
+25
-17
25 additions, 17 deletions
steps/h5parm_pointingname.cwl
workflows/prefactor_target/finalize.cwl
+44
-7
44 additions, 7 deletions
workflows/prefactor_target/finalize.cwl
with
124 additions
and
24 deletions
steps/get_targetname.cwl
0 → 100644
+
55
−
0
View file @
d91d41f6
class: CommandLineTool
cwlVersion: v1.0
$namespaces:
lofar: 'https://git.astron.nl/eosc/ontologies/raw/master/schema/lofar.owl'
sbg: 'https://www.sevenbridges.com/'
id: get_targetname
baseCommand:
- python3
inputs:
- id: msin
type: Directory[]
doc: MS to compare with
inputBinding:
position: 0
arguments:
- '-c'
- |
import sys
import json
from getTargetName import main as getTargetName
mss = sys.argv[1:]
output = getTargetName(mss)
targetName = output['targetName']
cwl_output = {"targetName": targetName}
with open('./out.json', 'w') as fp:
json.dump(cwl_output, fp)
outputs:
- id: targetname
type: string
outputBinding:
loadContents: true
glob: 'out.json'
outputEval: $(JSON.parse(self[0].contents).targetName)
- id: logfile
type: File[]
outputBinding:
glob: 'get_targetname*.log'
requirements:
- class: InlineJavascriptRequirement
- class: InitialWorkDirRequirement
listing:
- entry: $(inputs.msin)
writable: true
hints:
- class: DockerRequirement
dockerPull: lofareosc/prefactor:HBAcalibrator
stdout: get_targetname.log
stderr: get_targetname_err.log
This diff is collapsed.
Click to expand it.
steps/h5parm_pointingname.cwl
+
25
−
17
View file @
d91d41f6
class: CommandLineTool
cwlVersion: v1.0
$namespaces:
lofar: 'https://git.astron.nl/eosc/ontologies/raw/master/schema/lofar.owl'
sbg: 'https://www.sevenbridges.com/'
id: h5parm_pointingname
baseCommand:
- python3
- /usr/local/bin/h5parm_pointingname.py
inputs:
- id: h5parm
- format: 'lofar:#H5Parm'
id: h5parmFile
type: File
inputBinding:
position: 1
doc: H5parm whose pointing direction should be corrected the solutions should be transferred.
- id: solsetName
position: 0
doc: List of h5parm files
- default: 'target'
id: solsetName
type: string?
inputBinding:
position: 0
prefix: '--solsetName'
doc: Name of the input h5parm solution set
- id: pointing
doc: Input solset name
- default: 'POINTING'
id: pointing
type: string?
inputBinding:
position: 0
prefix: '--pointing'
doc: Name of the
output h5parm solution set
doc: Name of the
pointing
outputs:
- id: outh5parm
doc: Output h5parm
type: File
outputBinding:
glob: $(inputs.h5parm.basename)
glob: $(inputs.h5parmFile.basename)
format: lofar:#H5Parm
- id: log
type: File[]
outputBinding:
glob: 'h5parm_name*.log'
stdout: h5parm_name.log
stderr: h5parm_name_err.log
glob: 'h5parm_pointingname*.log'
label: h5parm_pointingname
hints:
- class: DockerRequirement
dockerPull: 'lofareosc/prefactor:HBAcalibrator'
requirements:
- class: InlineJavascriptRequirement
- class: InitialWorkDirRequirement
listing:
- entry: $(inputs.h5parm)
- entry: $(inputs.h5parm
File
)
writable: true
- class: InlineJavascriptRequirement
hints:
- class: DockerRequirement
dockerPull: lofareosc/prefactor:HBAcalibrator
stdout: h5parm_pointingname.log
stderr: h5parm_pointingname_err.log
$schema:
- 'https://git.astron.nl/eosc/ontologies/raw/master/schema/lofar.owl'
This diff is collapsed.
Click to expand it.
workflows/prefactor_target/finalize.cwl
+
44
−
7
View file @
d91d41f6
...
...
@@ -50,7 +50,7 @@ outputs:
'sbg:y': 0
- id: solutions
outputSource:
-
write_solutions
/outh5parm
-
h5parm_pointingname
/outh5parm
type: File
'sbg:x': 1000
'sbg:y': 200
...
...
@@ -77,8 +77,10 @@ steps:
source: gsmcal_step
valueFrom: $(self+'000')
- id: soltab_out
source: gsmcal_step
valueFrom: $(inputs.skymodel_source+self)
source:
- skymodel_source
- gsmcal_step
valueFrom: $(self.join(''))
- id: filter
source: process_baselines_target
- id: bad_antennas
...
...
@@ -106,8 +108,10 @@ steps:
- id: databitrate
source: compression_bitrate
- id: correction
source: gsmcal_step
valueFrom: $(inputs.skymodel_source+self)
source:
- skymodel_source
- gsmcal_step
valueFrom: $(self.join(''))
- id: solset
default: 'target'
- id: msout_name
...
...
@@ -129,8 +133,10 @@ steps:
- id: outsolset
default: target
- id: insoltab
source: gsmcal_step
valueFrom: $(inputs.skymodel_source+self)
source:
- skymodel_source
- gsmcal_step
valueFrom: $(self.join(''))
- id: input_file
source: insolutions
- id: squeeze
...
...
@@ -146,6 +152,23 @@ steps:
label: write_solutions
'sbg:x': 200
'sbg:y': 500
- id: h5parm_pointingname
in:
- id: h5parmFile
source: write_solutions/outh5parm
- id: outsolset
default: 'target'
- id: solsetName
default: 'target'
- id: pointing
source: get_targetname/targetname
out:
- id: outh5parm
- id: log
run: ../../steps/h5parm_pointingname.cwl
label: h5parm_pointingname
'sbg:x': 400
'sbg:y': 200
- id: concat_logfiles_applygsm
in:
- id: file_list
...
...
@@ -167,6 +190,8 @@ steps:
- inh5parm_logfile
- add_missing_stations/log
- write_solutions/log
- get_targetname/logfile
- h5parm_pointingname/log
- id: file_prefix
default: losoto_gsmcal
out:
...
...
@@ -175,6 +200,18 @@ steps:
label: concat_logfiles_solutions
'sbg:x': 500
'sbg:y': 500
- id: get_targetname
in:
- id: msin
linkMerge: merge_flattened
source: msin
out:
- id: targetname
- id: logfile
run: ../../steps/get_targetname.cwl
label: get_targetname
'sbg:x': 200
'sbg:y': 200
requirements:
- class: SubworkflowFeatureRequirement
- class: ScatterFeatureRequirement
...
...
This diff is collapsed.
Click to expand it.
Preview
0%
Loading
Try again
or
attach a new file
.
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Save comment
Cancel
Please
register
or
sign in
to comment