0.15.0

Fixed

• removed DOWNLOAD_PREVIEW_ONLY as its unreliable with CSVs and corrupted Excel files
• removed SUMMARY_STATS_WITH_PREVIEW, which doesn't make sense without DOWNLOAD_PREVIEW_ONLY

Full Changelog: 0.14.1...0.15.0

0.14.1

What Changed

• made a mistake publishing 0.14.0, neglecting to bump setup version.
• add a note about using glibc-2.31 version of qsv if the Linux distro running it has an older version of GNU C library (e.g. Ubuntu 18.04 and Debian 11)

Full Changelog: 0.14.0...0.14.1

0.14.0

Added

• More robust file format detection b754668, also now prompts the user to specify the file format if it cannot infer it from the server's content-type header or the file's extension.

Changed

• Minimum QuickSilver version is now 0.108.0, which features a more robust and faster input command DP+ uses for transcoding and normalization of CSVs

Fixed

• Fixed file format detection b754668
• Removed SNIFF_DELIMITER setting which was causing DP+ to periodically sniff non-comma delimiters even if the file was using comma delimiters

Full Changelog: 0.13.2...0.14.0

0.13.2

Fixed

• Added tzdata dependency and missing logging import by @minhajuddin2510 in #99

Full Changelog: 0.13.1...0.13.2

0.13.1

Changed

• Reordered imports for clarity #97
• Minor Download improvements to make streaming download more robust as we're doing streaming downloads when using preview rows by doing request in a with clause. #97
• added vscode setting to use black formatter

Fixed

• added missing dependencies for pytz and python-dateutil. These new dependencies are required because of the fix in 0.13.0 that checked if a resource's metadata has been modified (c8d1a36), allowing a DP+ job even if the file hash has not changed (e.g. when the Data Dictionary data types are changed and the user wants the resource file re-pushed to use the new data types).

Full Changelog: 0.13.0...0.13.1

0.13.0

Added

• Add unsafe headers configuration settings. Resolves #93. This allows DP+ to use an alternate unsafe prefix when sanitizing column names. #94
• Add SNIFF_DELIMITER setting. Implements #70. This allows DP+ to automatically infer the delimiter used by a CSV file if its not a comma. #96 and 59c36d4
• The inferred Data Dictionary now also has a "Unit" column. Note that you'll still need to modify your CKAN theme to expose the Unit field in the Data Dictionary tab.

Changed

• set minimum qsv version to 0.107.0 d863b14 and 29886e8

Fixed

• Allow url parameters. Resolves #77. This allows DP+ to process links with URL parameters. Just be sure to specify the resource format to one of the supported DP+ formats so it will be processed. #95
• Properly handle when there is no timezone info when checking if a resource is updated c8d1a36

Full Changelog: 0.12.0...0.13.0

0.12.0

Changed

• Use single source of configuration by @bluepython508 in #82
• Containerfile dependencies by @bluepython508 in #81

Fixed

• Don't crash when not given content-length header by @bluepython508 in #85
• Use --prefer-dmy with qsv instead of --prefer_dmy by @bluepython508 in #83
• Don't crash on missing original column name by @bluepython508 in #84
• Allow reupload of file if resource metadata has changed (Fixes #88) 0e39e15.
• Reset resource.preview_rows to False if existing resource falls below preview_rows threshold 3e60765

New Contributors

• @bluepython508 made their first contribution in #85

Full Changelog: 0.11.0...0.12.0

0.11.0

Added

• Added-link-to-datapusher-plus-docker by @minhajuddin2510 in #67
• Added uninstallation procedure
• Added more comments in the main jobs.py process where all the main work is done
• Added details about what qsv analysis enables

Changed

• Revamped documentation to streamline installation
• set config.py to more conservative defaults
• set minimum QSV version to 0.99.0

Fixed

• Container packaging fixes by @EricSoroos in #71
• Fix error handling in validate by @Zharktas in #74
• pinned ckanserviceprovider to 1.1.0 and APScheduler to 3.9.1.post1 to fix #64

New Contributors

• @EricSoroos made their first contribution in #71
• @Zharktas made their first contribution in #74

Full Changelog: 0.10.1...0.11.0

0.10.1

What's Changed

• add separate AUTO_UNIQUE_INDEX setting #62
• improved Development Installation procedure
• improved Datapusher+ Configuration section, with heavily commented dot-env.template
• bumped qsv from 0.87.0 to 0.87.1, with improved safenames sanitizing...
• added qsv version checks

Full Changelog: 0.9.0...0.10.1

0.9.0

What's Changed

• Updated the readme to include locale installation by @minhajuddin2510 in #51
• Initial implementation of PII screening by @jqnatividad in #56

New Contributors

• @minhajuddin2510 made their first contribution in #51

Full Changelog: 0.8.0...0.9.0