Reduce pinning #65
Merged
Reduce pinning #65
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
@doutriaux1 Please review. |
|
@muryanto1 @downiec @danlipsa let's rebuild with this for @xylar . Feel free to either increase the build number or remove existing 8.2 and replace with these |
|
Please don't remove existing builds. Please bump build numbers. Removing existing builds can break attempts to build environments from yaml files. It isn't a good practice. |
|
@xylar I know this, but these build are not official. They are only here in preparation of 8.2 release. |
|
Also packages names contain year-month-day-hour-min so we don't have conflicts. We use this instead of build numbers. |
|
@danlipsa that's for nightly builds, for official build we want to remove the timestamp though |
|
@doutriaux1 Here are the new packages: |
|
@danlipsa and @doutriaux1, this fix does, indeed, seem to fix my problem. For E3SM-Unified, I would specifically need a new build of (As an aside, if there were a |
|
@xylar it's worth trying again, but last I tried the recipe took too long too build and could never pass the time outs from conda-forge, hence never made it to conda-forge... |
|
Ah, I had forgotten that the timeout was the problem for this one. |
|
@doutriaux1, @danlipsa, Thank you for the pull requests. @doutriaux1, As brought up by Xylar, to support |
|
@chengzhuzhang I tried to build it last week, but was not able to due to not having the needed sdk. I then went on vacation. Will try to do it now. |
|
@chengzhuzhang, @xylar Linux and OSX version for 8.2.0.8.1 are uploaded. https://anaconda.org/cdat/vtk-cdat/files |
|
@muryanto1, thank you for making these. Could you add the v81 label to these? |
|
@chengzhuzhang, these will only work for us if you were to create a new release that loosens the constraints you currently have on the vtk-cdat version to not specifically require rc2. |
|
@muryanto1 Thank you! @xylar yes, I'm testing the new build right now. And will make a new release with the new build. |
|
@chengzhuzhang, I tried it and found conflicts between versions. Let me know if you have better luck |
|
|
@xylar, I'm under conda 4.6.11, it also works for me. |
|
Hi @muryanto1 and @chengzhuzhang. I'm using conda 4.7.11 and I have strict channel order turned on (which I think is necessary for e3sm-unified and a good practice in general). |
|
If I turn off |
|
I switched the order of the labels and things do seem to work for me: However, note that I get different versions of many packages than @muryanto1 for the same install command. This is why |
|
But now you’re getting vcs, cdms, etc.. .from v8.2… Which is not officially out yet 😊
C.
From: Xylar Asay-Davis <[email protected]>
Sent: Monday, September 9, 2019 2:54 PM
To: CDAT/conda-recipes <[email protected]>
Cc: Doutriaux, Charles <[email protected]>; Mention <[email protected]>
Subject: Re: [CDAT/conda-recipes] Reduce pinning (#65)
I switched the order of the labels and things do seem to work for me:
$ conda create -n test -c conda-forge -c cdat/label/v82 -c cdat/label/v81 "vtk-cdat>=8.2.0.8.1" "cdms2>=3.0.1" "cdp>=1.4.1" "cdtime>=3.0" "cdutil>=8.0" "dv3d>=8.0" "genutil>=8.0" "vcs>=8.0" "vcsaddons>=8.0"
Collecting package metadata (current_repodata.json): done
Solving environment: done
## Package Plan ##
environment location: /home/xylar/miniconda3/envs/test
added / updated specs:
- cdms2[version='>=3.0.1']
- cdp[version='>=1.4.1']
- cdtime[version='>=3.0']
- cdutil[version='>=8.0']
- dv3d[version='>=8.0']
- genutil[version='>=8.0']
- vcs[version='>=8.0']
- vcsaddons[version='>=8.0']
- vtk-cdat[version='>=8.2.0.8.1']
The following packages will be downloaded:
package | build
…---------------------------|-----------------
cdat_info-8.2 | py_2 15 KB conda-forge
cdms2-3.1.3 | py37ha6f5e91_1 682 KB conda-forge
cdp-1.6.0 | py_0 17 KB conda-forge
cdtime-3.1.2 | py37h7eb8c7e_3 54 KB conda-forge
cdutil-8.1 | py_1 451 KB conda-forge
dask-2.3.0 | py_0 4 KB conda-forge
dask-core-2.3.0 | py_0 574 KB conda-forge
distarray-2.12.2 | py_1 10 KB conda-forge
distributed-2.3.2 | py_1 370 KB conda-forge
dv3d-8.2 | py_0 7.9 MB cdat/label/v82
esmf-7.1.0 | h9a7cb89_1007 23.6 MB conda-forge
esmpy-7.1.0 | py37h24bf2e0_3 160 KB conda-forge
fsspec-0.4.4 | py_0 39 KB conda-forge
g2clib-1.6.0 | hf3f1b0b_9 56 KB conda-forge
genutil-8.2 | py37h3010b51_0 129 KB conda-forge
ghostscript-9.22 | hf484d3e_1001 18.1 MB conda-forge
hdf5-1.10.5 |nompi_h3c11f04_1103 3.1 MB conda-forge
jasper-1.900.1 | h07fcdf6_1006 286 KB conda-forge
lazy-object-proxy-1.4.2 | py37h516909a_0 27 KB conda-forge
libcdms-3.1.2 | h7dcd879_3 1.5 MB conda-forge
libcf-1.0.3 | py37h52de6d6_0 264 KB conda-forge
libdrs-3.1.2 | h8c6403c_3 538 KB conda-forge
libdrs_f-3.1.2 | h322d3c2_3 532 KB conda-forge
libgcc-7.2.0 | h69d50b8_2 304 KB conda-forge
libnetcdf-4.6.2 | h303dfb8_1003 1.3 MB conda-forge
mpich-3.2.1 | hc99cbb1_1014 5.9 MB conda-forge
netcdf-fortran-4.4.5 | h0789656_1004 1.2 MB conda-forge
numpy-1.17.2 | py37h95a1406_0 5.2 MB conda-forge
openblas-0.3.6 | h6e990d7_6 8.2 MB conda-forge
output_viewer-1.3.0 | py_1 86 KB conda-forge
pandas-0.25.1 | py37hb3f55d8_0 11.4 MB conda-forge
vcs-8.2 | py_0 4.0 MB cdat/label/v82
vcsaddons-8.2 | py37h14c3975_0 93 KB cdat/label/v82
vtk-cdat-8.2.0.8.1 | py37h3df8362_0 39.9 MB cdat/label/v82
------------------------------------------------------------
Total: 135.8 MB
The following NEW packages will be INSTALLED:
_libgcc_mutex pkgs/main/linux-64::_libgcc_mutex-0.1-main
asn1crypto conda-forge/linux-64::asn1crypto-0.24.0-py37_1003
attrs conda-forge/noarch::attrs-19.1.0-py_0
bokeh conda-forge/linux-64::bokeh-1.3.4-py37_0
bzip2 conda-forge/linux-64::bzip2-1.0.8-h516909a_0
ca-certificates conda-forge/linux-64::ca-certificates-2019.6.16-hecc5488_0
cdat_info conda-forge/noarch::cdat_info-8.2-py_2
cdms2 conda-forge/linux-64::cdms2-3.1.3-py37ha6f5e91_1
cdp conda-forge/noarch::cdp-1.6.0-py_0
cdtime conda-forge/linux-64::cdtime-3.1.2-py37h7eb8c7e_3
cdutil conda-forge/noarch::cdutil-8.1-py_1
certifi conda-forge/linux-64::certifi-2019.6.16-py37_1
cffi conda-forge/linux-64::cffi-1.12.3-py37h8022711_0
chardet conda-forge/linux-64::chardet-3.0.4-py37_1003
click conda-forge/noarch::click-7.0-py_0
cloudpickle conda-forge/noarch::cloudpickle-1.2.1-py_0
cryptography conda-forge/linux-64::cryptography-2.7-py37h72c5cf5_0
curl conda-forge/linux-64::curl-7.65.3-hf8cf82a_0
cytoolz conda-forge/linux-64::cytoolz-0.10.0-py37h516909a_0
dask conda-forge/noarch::dask-2.3.0-py_0
dask-core conda-forge/noarch::dask-core-2.3.0-py_0
decorator conda-forge/noarch::decorator-4.4.0-py_0
distarray conda-forge/noarch::distarray-2.12.2-py_1
distributed conda-forge/noarch::distributed-2.3.2-py_1
dv3d cdat/label/v82/noarch::dv3d-8.2-py_0
esmf conda-forge/linux-64::esmf-7.1.0-h9a7cb89_1007
esmpy conda-forge/linux-64::esmpy-7.1.0-py37h24bf2e0_3
expat conda-forge/linux-64::expat-2.2.5-he1b5a44_1003
ffmpeg conda-forge/linux-64::ffmpeg-4.2-h167e202_0
freetype conda-forge/linux-64::freetype-2.10.0-he983fc9_1
fsspec conda-forge/noarch::fsspec-0.4.4-py_0
future conda-forge/linux-64::future-0.17.1-py37_1000
g2clib conda-forge/linux-64::g2clib-1.6.0-hf3f1b0b_9
genutil conda-forge/linux-64::genutil-8.2-py37h3010b51_0
ghostscript conda-forge/linux-64::ghostscript-9.22-hf484d3e_1001
gmp conda-forge/linux-64::gmp-6.1.2-hf484d3e_1000
gnutls conda-forge/linux-64::gnutls-3.6.5-hd3a4fd2_1002
hdf4 conda-forge/linux-64::hdf4-4.2.13-h9a582f1_1002
hdf5 conda-forge/linux-64::hdf5-1.10.5-nompi_h3c11f04_1103
heapdict conda-forge/linux-64::heapdict-1.0.0-py37_1000
idna conda-forge/linux-64::idna-2.8-py37_1000
ipython_genutils conda-forge/noarch::ipython_genutils-0.2.0-py_1
jasper conda-forge/linux-64::jasper-1.900.1-h07fcdf6_1006
jinja2 conda-forge/noarch::jinja2-2.10.1-py_0
jpeg conda-forge/linux-64::jpeg-9c-h14c3975_1001
jsonschema conda-forge/linux-64::jsonschema-3.0.2-py37_0
jupyter_core conda-forge/noarch::jupyter_core-4.4.0-py_0
krb5 conda-forge/linux-64::krb5-1.16.3-h05b26f9_1001
lame conda-forge/linux-64::lame-3.100-h14c3975_1001
lazy-object-proxy conda-forge/linux-64::lazy-object-proxy-1.4.2-py37h516909a_0
libblas conda-forge/linux-64::libblas-3.8.0-11_openblas
libcblas conda-forge/linux-64::libcblas-3.8.0-11_openblas
libcdms conda-forge/linux-64::libcdms-3.1.2-h7dcd879_3
libcf conda-forge/linux-64::libcf-1.0.3-py37h52de6d6_0
libcurl conda-forge/linux-64::libcurl-7.65.3-hda55be3_0
libdrs conda-forge/linux-64::libdrs-3.1.2-h8c6403c_3
libdrs_f conda-forge/linux-64::libdrs_f-3.1.2-h322d3c2_3
libedit conda-forge/linux-64::libedit-3.1.20170329-hf8c457e_1001
libffi conda-forge/linux-64::libffi-3.2.1-he1b5a44_1006
libgcc conda-forge/linux-64::libgcc-7.2.0-h69d50b8_2
libgcc-ng pkgs/main/linux-64::libgcc-ng-9.1.0-hdf63c60_0
libgfortran-ng pkgs/main/linux-64::libgfortran-ng-7.3.0-hdf63c60_0
libiconv conda-forge/linux-64::libiconv-1.15-h516909a_1005
liblapack conda-forge/linux-64::liblapack-3.8.0-11_openblas
libnetcdf conda-forge/linux-64::libnetcdf-4.6.2-h303dfb8_1003
libopenblas conda-forge/linux-64::libopenblas-0.3.6-h6e990d7_6
libpng conda-forge/linux-64::libpng-1.6.37-hed695b0_0
libssh2 conda-forge/linux-64::libssh2-1.8.2-h22169c7_2
libstdcxx-ng pkgs/main/linux-64::libstdcxx-ng-9.1.0-hdf63c60_0
libtiff conda-forge/linux-64::libtiff-4.0.10-h57b8799_1003
libuuid conda-forge/linux-64::libuuid-2.32.1-h14c3975_1000
locket conda-forge/noarch::locket-0.2.0-py_2
lz4-c conda-forge/linux-64::lz4-c-1.8.3-he1b5a44_1001
markupsafe conda-forge/linux-64::markupsafe-1.1.1-py37h14c3975_0
mpi conda-forge/linux-64::mpi-1.0-mpich
mpich conda-forge/linux-64::mpich-3.2.1-hc99cbb1_1014
msgpack-python conda-forge/linux-64::msgpack-python-0.6.1-py37h6bb024c_0
nbformat conda-forge/noarch::nbformat-4.4.0-py_1
ncurses conda-forge/linux-64::ncurses-6.1-hf484d3e_1002
netcdf-fortran conda-forge/linux-64::netcdf-fortran-4.4.5-h0789656_1004
nettle conda-forge/linux-64::nettle-3.4.1-h1bed415_1002
numpy conda-forge/linux-64::numpy-1.17.2-py37h95a1406_0
olefile conda-forge/noarch::olefile-0.46-py_0
openblas conda-forge/linux-64::openblas-0.3.6-h6e990d7_6
openh264 conda-forge/linux-64::openh264-1.8.0-hdbcaa40_1000
openssl conda-forge/linux-64::openssl-1.1.1c-h516909a_0
output_viewer conda-forge/noarch::output_viewer-1.3.0-py_1
packaging conda-forge/noarch::packaging-19.0-py_0
pandas conda-forge/linux-64::pandas-0.25.1-py37hb3f55d8_0
partd conda-forge/noarch::partd-1.0.0-py_0
pillow conda-forge/linux-64::pillow-6.1.0-py37h6b7be26_1
pip conda-forge/linux-64::pip-19.2.3-py37_0
psutil conda-forge/linux-64::psutil-5.6.3-py37h516909a_0
pycparser conda-forge/linux-64::pycparser-2.19-py37_1
pyopenssl conda-forge/linux-64::pyopenssl-19.0.0-py37_0
pyparsing conda-forge/noarch::pyparsing-2.4.2-py_0
pyrsistent conda-forge/linux-64::pyrsistent-0.15.4-py37h516909a_0
pysocks conda-forge/linux-64::pysocks-1.7.0-py37_0
python conda-forge/linux-64::python-3.7.3-h33d41f4_1
python-dateutil conda-forge/noarch::python-dateutil-2.8.0-py_0
pytz conda-forge/noarch::pytz-2019.2-py_0
pyyaml conda-forge/linux-64::pyyaml-5.1.2-py37h516909a_0
readline conda-forge/linux-64::readline-8.0-hf8c457e_0
requests conda-forge/linux-64::requests-2.22.0-py37_1
setuptools conda-forge/linux-64::setuptools-41.2.0-py37_0
six conda-forge/linux-64::six-1.12.0-py37_1000
sortedcontainers conda-forge/noarch::sortedcontainers-2.1.0-py_0
sqlite conda-forge/linux-64::sqlite-3.29.0-hcee41ef_1
tblib conda-forge/noarch::tblib-1.4.0-py_0
tk conda-forge/linux-64::tk-8.6.9-hed695b0_1002
toolz conda-forge/noarch::toolz-0.10.0-py_0
tornado conda-forge/linux-64::tornado-6.0.3-py37h516909a_0
traitlets conda-forge/linux-64::traitlets-4.3.2-py37_1000
udunits2 conda-forge/linux-64::udunits2-2.2.27.6-h4e0c4b3_1001
urllib3 conda-forge/linux-64::urllib3-1.25.3-py37_0
vcs cdat/label/v82/noarch::vcs-8.2-py_0
vcsaddons cdat/label/v82/linux-64::vcsaddons-8.2-py37h14c3975_0
vtk-cdat cdat/label/v82/linux-64::vtk-cdat-8.2.0.8.1-py37h3df8362_0
wheel conda-forge/linux-64::wheel-0.33.6-py37_0
x264 conda-forge/linux-64::x264-1!152.20180806-h14c3975_0
xz conda-forge/linux-64::xz-5.2.4-h14c3975_1001
yaml conda-forge/linux-64::yaml-0.1.7-h14c3975_1001
zict conda-forge/noarch::zict-1.0.0-py_0
zlib conda-forge/linux-64::zlib-1.2.11-h516909a_1005
zstd conda-forge/linux-64::zstd-1.4.0-h3b9ef0a_0
Proceed ([y]/n)? y
Downloading and Extracting Packages
netcdf-fortran-4.4.5 | 1.2 MB | ##################################### | 100%
cdutil-8.1 | 451 KB | ##################################### | 100%
jasper-1.900.1 | 286 KB | ##################################### | 100%
fsspec-0.4.4 | 39 KB | ##################################### | 100%
genutil-8.2 | 129 KB | ##################################### | 100%
libnetcdf-4.6.2 | 1.3 MB | ##################################### | 100%
libdrs-3.1.2 | 538 KB | ##################################### | 100%
pandas-0.25.1 | 11.4 MB | ##################################### | 100%
lazy-object-proxy-1. | 27 KB | #################################################################################################################################################################################################################### | 100%
hdf5-1.10.5 | 3.1 MB | #################################################################################################################################################################################################################### | 100%
libgcc-7.2.0 | 304 KB | #################################################################################################################################################################################################################### | 100%
output_viewer-1.3.0 | 86 KB | #################################################################################################################################################################################################################### | 100%
cdms2-3.1.3 | 682 KB | #################################################################################################################################################################################################################### | 100%
vcs-8.2 | 4.0 MB | #################################################################################################################################################################################################################### | 100%
distarray-2.12.2 | 10 KB | #################################################################################################################################################################################################################### | 100%
cdtime-3.1.2 | 54 KB | #################################################################################################################################################################################################################### | 100%
vcsaddons-8.2 | 93 KB | #################################################################################################################################################################################################################### | 100%
dv3d-8.2 | 7.9 MB | #################################################################################################################################################################################################################### | 100%
numpy-1.17.2 | 5.2 MB | #################################################################################################################################################################################################################### | 100%
cdat_info-8.2 | 15 KB | #################################################################################################################################################################################################################### | 100%
dask-2.3.0 | 4 KB | #################################################################################################################################################################################################################### | 100%
g2clib-1.6.0 | 56 KB | #################################################################################################################################################################################################################### | 100%
ghostscript-9.22 | 18.1 MB | #################################################################################################################################################################################################################### | 100%
cdp-1.6.0 | 17 KB | #################################################################################################################################################################################################################### | 100%
vtk-cdat-8.2.0.8.1 | 39.9 MB | #################################################################################################################################################################################################################### | 100%
mpich-3.2.1 | 5.9 MB | #################################################################################################################################################################################################################### | 100%
libcf-1.0.3 | 264 KB | #################################################################################################################################################################################################################### | 100%
dask-core-2.3.0 | 574 KB | #################################################################################################################################################################################################################### | 100%
esmpy-7.1.0 | 160 KB | #################################################################################################################################################################################################################### | 100%
distributed-2.3.2 | 370 KB | #################################################################################################################################################################################################################### | 100%
openblas-0.3.6 | 8.2 MB | #################################################################################################################################################################################################################### | 100%
esmf-7.1.0 | 23.6 MB | #################################################################################################################################################################################################################### | 100%
libdrs_f-3.1.2 | 532 KB | #################################################################################################################################################################################################################### | 100%
libcdms-3.1.2 | 1.5 MB | #################################################################################################################################################################################################################### | 100%
Preparing transaction: done
Verifying transaction: done
Executing transaction: done
#
# To activate this environment, use
#
# $ conda activate test
#
# To deactivate an active environment, use
#
# $ conda deactivate
However, note that I get different versions of many packages than @muryanto1<https://github.com/muryanto1> for the same install command. This is why strict order is important.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub<#65?email_source=notifications&email_token=AAVHB4LYRWEARX2AFXL64Q3QI3AZHA5CNFSM4ITSAAY2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD6JE7YQ#issuecomment-529682402>, or mute the thread<https://github.com/notifications/unsubscribe-auth/AAVHB4NRQSV4Q4QIIF6DFTDQI3AZHANCNFSM4ITSAAYQ>.
|
Yes, that was exactly my point. I think this would be solved by adding the |
|
But the newly built package is different from v81, why would we add v81 on it?
From: Xylar Asay-Davis <[email protected]>
Sent: Monday, September 9, 2019 3:05 PM
To: CDAT/conda-recipes <[email protected]>
Cc: Doutriaux, Charles <[email protected]>; Mention <[email protected]>
Subject: Re: [CDAT/conda-recipes] Reduce pinning (#65)
But now you’re getting vcs, cdms, etc.. .from v8.2… Which is not officially out yet 
Yes, that was exactly my point. I think this would be solved by adding the v81 label to the newly built packages.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub<#65?email_source=notifications&email_token=AAVHB4JQDPGDC5QIVIKRWJLQI3CAPA5CNFSM4ITSAAY2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD6JFYDI#issuecomment-529685517>, or mute the thread<https://github.com/notifications/unsubscribe-auth/AAVHB4JPXVE3Z5334TAKYCDQI3CAPANCNFSM4ITSAAYQ>.
|
My request was just for a rebuild of the exact same package as in Looking at the VTK source, it seems like some very iffy software practices have been going on where the packages aren't based on releases. This means it's unlikely to be possible to create a new build of what is currently |
|
@xylar official version of cdat/vcs have an associated tag and label associated with them, everything else is "nightly" and should be used "as-is" and probably not in production since it is subject to change before the next release. |
Okay, so what is the procedure for getting new builds made of old packages where the source code is fine but the package build is broken? On |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.