Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ice post-processing script required #28

Closed
aidanheerdegen opened this issue Mar 12, 2024 · 3 comments
Closed

Ice post-processing script required #28

aidanheerdegen opened this issue Mar 12, 2024 · 3 comments

Comments

@aidanheerdegen
Copy link
Member

We have replaced the original COSIMA sync_data.sh script with the new payu syncing facility.

However the original sync script also contained some nco commands to concatenate daily ice files that are very wasteful of space as there is a lot of duplication of coordinate data:

https://github.com/COSIMA/1deg_jra55_ryf/blob/master/sync_data.sh#L87-L108

We need to duplicate the core of that functionality, perhaps in a separate script in tools, but that has the downside of requiring duplication across all the configs.

Could that functionality be rolled into the payu driver, or expressed one-line command and called directly as a userscript?

There is a related issue to install the nco dependency

ACCESS-NRI/payu-condaenv#23

@aidanheerdegen
Copy link
Member Author

At some stages sub-daily ice outputs were also concatenated using another script

#16 (comment)

@aidanheerdegen
Copy link
Member Author

We could make a package and install it as a dependency in the payu conda environment, but that seems like a fair bit of work for a small thing.

@aidanheerdegen
Copy link
Member Author

I have "installed" the om2-scripts repo in vk83.

The ice concatenation script is available at this path:

/g/data/vk83/apps/om2-scripts/concatenate_ice/concat_ice_daily.sh

I have done some testing at it works as a sync userscript

ACCESS-NRI/om2-scripts#2

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant