vcs.download_sample_data_files() keeps on downloading th_yr.nc #392
Comments
|
You're right looks like these files are either corrupted or missing, I'll take a look. Thanks for reporting.
From: Jean-Yves Peterschmitt <[email protected]>
Reply-To: CDAT/vcs <[email protected]>
Date: Tuesday, March 12, 2019 at 6:59 AM
To: CDAT/vcs <[email protected]>
Cc: "Doutriaux, Charles" <[email protected]>, Mention <[email protected]>
Subject: [CDAT/vcs] vcs.download_sample_data_files() keeps on downloading th_yr.nc (#392)
@doutriaux1<https://github.com/doutriaux1> I wonder if there is a problem with a) vcs.download_sample_data_files() or with b) th_yr.nc
When I execute a) in a CDAT version where it has already been executed, it apparently sees that the files are already here, except for b) that it downloads 3 times. Same thing if I re-execute a)
…-rw-r--r-- 1 jypeter lsce 332776 Mar 12 14:44 th_yr.nc
(cdatm18_py2) jypeter@obelix2 - ...jypeter - 61 >python -c 'import vcs; vcs.download_sample_data_files(); print "\nFinished downloading sample data to", vcs.sample_data'
Downloading: 'th_yr.nc' from 'https://cdat.llnl.gov/cdat/sample_data/' in: /home/share/unix_files/cdat/miniconda3/envs/cdatm18_py2/share/cdat/sample_data/th_yr.nc
Downloading: 'th_yr.nc' from 'https://cdat.llnl.gov/cdat/sample_data/' in: /home/share/unix_files/cdat/miniconda3/envs/cdatm18_py2/share/cdat/sample_data/th_yr.nc
Downloading: 'th_yr.nc' from 'https://cdat.llnl.gov/cdat/sample_data/' in: /home/share/unix_files/cdat/miniconda3/envs/cdatm18_py2/share/cdat/sample_data/th_yr.nc
Finished downloading sample data to /home/share/unix_files/cdat/miniconda3/envs/cdatm18_py2/share/cdat/sample_data
(cdatm18_py2) jypeter@obelix2 - ...jypeter - 62 >ls -ltr /home/share/unix_files/cdat/miniconda3/envs/cdatm18_py2/share/cdat/sample_data | tail
-rw-r--r-- 1 jypeter lsce 3216 Mar 7 16:27 tas_gavg_rnl_ecm.nc
-rw-r--r-- 1 jypeter lsce 510144 Mar 7 16:27 tas_ecm_1979.nc
-rw-r--r-- 1 jypeter lsce 128360 Mar 7 16:27 tas_cru_1979.nc
-rw-r--r-- 1 jypeter lsce 2107996 Mar 7 16:27 psl_6h.nc
-rw-r--r-- 1 jypeter lsce 366116 Mar 7 16:27 ts_da.nc
-rw-r--r-- 1 jypeter lsce 2678584 Mar 7 16:27 tas_mo.nc
-rw-r--r-- 1 jypeter lsce 159468 Mar 7 16:27 tas_mo_clim.nc
-rw-r--r-- 1 jypeter lsce 6280312 Mar 7 16:27 tas_6h.nc
-rw-r--r-- 1 jypeter lsce 34487602 Mar 7 16:27 geos5-sample.nc
-rw-r--r-- 1 jypeter lsce 332776 Mar 12 14:46 th_yr.nc
(cdatm18_py2) jypeter@obelix2 - ...jypeter - 63 >python -c 'import vcs; vcs.download_sample_data_files(); print "\nFinished downloading sample data to", vcs.sample_data'
Downloading: 'th_yr.nc' from 'https://cdat.llnl.gov/cdat/sample_data/' in: /home/share/unix_files/cdat/miniconda3/envs/cdatm18_py2/share/cdat/sample_data/th_yr.nc
Downloading: 'th_yr.nc' from 'https://cdat.llnl.gov/cdat/sample_data/' in: /home/share/unix_files/cdat/miniconda3/envs/cdatm18_py2/share/cdat/sample_data/th_yr.nc
Downloading: 'th_yr.nc' from 'https://cdat.llnl.gov/cdat/sample_data/' in: /home/share/unix_files/cdat/miniconda3/envs/cdatm18_py2/share/cdat/sample_data/th_yr.nc
Finished downloading sample data to /home/share/unix_files/cdat/miniconda3/envs/cdatm18_py2/share/cdat/sample_data
(cdatm18_py2) jypeter@obelix2 - ...jypeter - 64 >ls -ltr /home/share/unix_files/cdat/miniconda3/envs/cdatm18_py2/share/cdat/sample_data | tail
-rw-r--r-- 1 jypeter lsce 3216 Mar 7 16:27 tas_gavg_rnl_ecm.nc
-rw-r--r-- 1 jypeter lsce 510144 Mar 7 16:27 tas_ecm_1979.nc
-rw-r--r-- 1 jypeter lsce 128360 Mar 7 16:27 tas_cru_1979.nc
-rw-r--r-- 1 jypeter lsce 2107996 Mar 7 16:27 psl_6h.nc
-rw-r--r-- 1 jypeter lsce 366116 Mar 7 16:27 ts_da.nc
-rw-r--r-- 1 jypeter lsce 2678584 Mar 7 16:27 tas_mo.nc
-rw-r--r-- 1 jypeter lsce 159468 Mar 7 16:27 tas_mo_clim.nc
-rw-r--r-- 1 jypeter lsce 6280312 Mar 7 16:27 tas_6h.nc
-rw-r--r-- 1 jypeter lsce 34487602 Mar 7 16:27 geos5-sample.nc
-rw-r--r-- 1 jypeter lsce 332776 Mar 12 14:56 th_yr.nc
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub<#392>, or mute the thread<https://github.com/notifications/unsubscribe-auth/ACpw8XIOui6ZfwT9ZhMW2dZ8ydP2LPxwks5vV7KkgaJpZM4bq99j>.
|
|
The file I got seems valid enough. You can compare my md5sum below with the one of the source file |
|
@jypeter it's possible the |
|
@downiec @jasonb5 I have just noticed the problem again and almost created a new issue ! I'm using the latest stable vcs (and cdms) I have downloaded the full sample data to a new installation But each time I execute The file has not changed (according to md5sum), or course Well, you can even see this in the output of the tutorials !! e.g. https://cdat.llnl.gov/Jupyter-notebooks/vcs/VCS_Example/VCS_Example.html I'm afraid that, if people execute the notebooks on a server where CDAT and the data files were installed by somebody else, the notebook may fail when the download tries to write the data file in somebody else's directory where they don't have write access |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
@doutriaux1 I wonder if there is a problem with a)
vcs.download_sample_data_files()or with b)th_yr.ncWhen I execute a) in a CDAT version where it has already been executed, it apparently sees that the files are already here, except for b) that it downloads 3 times. Same thing if I re-execute a)
The text was updated successfully, but these errors were encountered: