Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
* add: Make icon.py fit for async * ref: don't use arguments to main, rather store info in config * GitHub Action: Apply Pep8-formatting * add:ref: model becomes workflow + get job dependencies from cfg - No need to travel with `model_cfg`. The relevant part is now in `cfg.worflow` and the former `cfg.model` is now `cfg.workflow_name` - A method is added to Config to generate the dependency part of the sbatch command - Some other minor improvements like recursive abs path or recursive attributes from dictionnaries of any depth - NOTHING TESTED YET !!! * fix: leftover from model => workflow_name * ref: remove dependencies for prepare_data, not needed * fix:add: get_dep_cmd was buggy, add wait_for_previous method * GitHub Action: Apply Pep8-formatting * add: cycling mechanism for async workflows * GitHub Action: Apply Pep8-formatting * ref: some reorganization of files - move `class Config` in its own `config.py` - mov workflow.yaml one level up becuase the `config` dir becomes confusing with `config.py`. Also not really needed to have that folder with only this file in it. * GitHub Action: Apply Pep8-formatting * ref: start using pathlib and make 2 introspective methods recurive * ref: continue using pathlib, remove work_root arg (already in cfg) * GitHub Action: Apply Pep8-formatting * ref(prepare_data): continue using pathlib, replace setattr * ref:add:fix: some more slurm integration - use `is_async` instead of python keyword `async` - add potential user provided dependency to `get_dep_xxx` methods. This allows for internal dependencies between subjobs of a particular task, like prepare_data. - add a submit method to the `Config` class - Start slurm integration for prepare_data. Continue the same way for the rest of it. - replace some `setattr` calls by direct assignments - move `jobs`, `startdate` and `enddate` to the Config object and remove them from the arguments of `restart_runs_xxx` functions --------- Co-authored-by: github-actions <[email protected]>
- Loading branch information
