Tags

Export median_dataloss alongside rfi_percent

Rename the quality field to summary in outputs.json after aggregation

- Sow std as percentage of median in noise plot title
- Fix aggregation failing on h5 join if only one dataset was provided

Export quality as outputs.json from aggregation script

Prevent NaN values in plot tiltes

Release precision restriction on numbers in plot titles (prevent showing 'std: 0.0' for example)

Add weighted_sum to title of dataloss plot
Add medain and std to noise plot

Allow for h5 join if some attributes are missing

Remove --exclusive flag from toil slurm arguments to prevent long wait times in slurm queue

Fix issues with toil runner for aggregation script
 - use absolute paths
 - specify job store and log dir

Run on aggregation script using python3.9 instead of 3.11 for better matching the available software on surf-sara.

Allow for distributed runs using ATDB's aggregator

Fix QA plots missing for some datasets due to QUALITY_TIME_STATISTIC missing from MS

Add title to dataloss plot

Fix unwarranted appearance of LV614 in 'antennas_not_available'

Fix incorrect DStDev values in output json and match them with the noise plot, attempt two

Fix incorrect DStDev values in output json and match them with the noise plot

Attempt to adhere to atdb standards for rfi_percent and quality column

Fix degree_incompleteness_array

Fix `TypeError: 'NoneType' object is not iterable` on:
File "/usr/local/lib/python3.10/dist-packages/lofar_quality/inspect/v2.py", line 226, in array_high_data_loss_on_dutch_important_pair
	    antenna_dataloss = {name: loss for (name, loss) in zip(antenna_names, dataloss_per_antenna)}