Releases: roocs/daops
Releases · roocs/daops
v0.4.0
v0.4.0 (2021-02-23)
Breaking Changes
- In
daops.utils.normalise
ResultSet().file_paths
has been changed tofile_uris
to allow file paths and URLs to be collected. clisops
>=0.6.1 androocs-utils
>=0.2.1 used.- New dev dependency: GitPython==3.1.12
consolidate_dset
has been removed indaops.utils.consolidate
asdset_to_filepaths
fromroocs_utils.project_utils
is now used to find the file paths.
New Features
daops.utils.core.is_characterised
implemented - datasets are looked up in the character store.apply_fixes
option now added todaops.ops.subset.subset
,daops.utils.normalise.normalise
anddaops.utils.core.open_dataset
. The default in all cases is to apply fixes (True).
Other Changes
- Changes to allow datasets without a time dimension to be processed.
- Swapped from travis CI to GitHub actions
- Test data no longer a submodule - the data is retrieved from GitHub when the tests are run.
- Use of
DatasetMapper
functions indaops.consolidate
anddaops.core
to ensure all datasets are mapped to ids/file paths correctly.
v0.3.0
v0.3.0 (2020-11-19)
Updating doc strings and documentation.
Breaking Changes
clisops
>=0.4.0 androocs-utils
>=0.1.4 used.data_refs
parameter ofdaops.ops.subset.subset
renamed tocollection
.space
parameter ofdaops.ops.subset.subset
renamed toarea
.chunk_rules
parameter ofdaops.ops.subset.subset
renamed tosplit_method
.filenamer
parameter ofdaops.ops.subset.subset
renamed tofile_namer
.output_type
parameter option added todaops.ops.subset.subset
.data_root_dir
parameter in no longer neededdaops.ops.subset.subset
.data_root_dir
no longer a parameter ofdaops.utils.consolidate.consolidate
.
New Features
- Added notebook with example usage.
- Config file now exists at
daops.etc.roocs.ini
. This can be overwritten by setting the environment variable
ROOCS_CONFIG
to the file path of a config file. split_method
implemented to split output files by if they exceed the memory limit provided in
clisops.etc.roocs.ini
namedfile_size_limit
.
Currently only thetime:auto
exists which splits evenly on time ranges.file_namer
implemented in subset operation. This hassimple
andstandard
options.
simple
numbers output files whereasstandard
names them according to the input dataset.- Directories, file paths and dataset ids can now be used as inputs to the subset operation.
- Fixer class now looks up fixes on our elasticsearch index.
Other Changes
- Updated documentation.
- Functions that take the
data_refs
parameter have been changed to usecollection
parameter instead. - Functions that take the
data_ref
parameter have been changed to usedset
parameter instead.