You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently when running the ingest process it will check to see if a file already exists locally. If it does then the script will skip over that file and now pull it from object storage.
The check should also make sure that the file is valid, not 0 bytes in size, and has at least on row of data. if not then it should be re-downloaded.
The text was updated successfully, but these errors were encountered:
Currently when running the ingest process it will check to see if a file already exists locally. If it does then the script will skip over that file and now pull it from object storage.
The check should also make sure that the file is valid, not 0 bytes in size, and has at least on row of data. if not then it should be re-downloaded.
The text was updated successfully, but these errors were encountered: