Skip to content

Releases: ONSdigital/research-and-development

0.5.3

12 Dec 10:17
31bc632
Compare
Choose a tag to compare

What's Changed

Full Changelog: 0.5.1-alpha-release...0.5.3-alpha-release

Version 0.5.1

05 Dec 14:58
b221421
Compare
Choose a tag to compare

What's Changed

  • Remove unnecessary mapper and duplicate output #151
  • Remove duplication of the status filtered output #151
  • Fix conditional paths for construction #151
  • Bug fix for TAU output weighted values #154
  • Update MoR trimming to not use nulls #153
  • 566 & 569 headcount and 604 bugfixes #155
  • Remove instance 0 from outputs #156
  • Postcode top-up for TAU #158
  • Fix constructed records missing from SAS and TAU outputs #158

Version 0.5.0

28 Nov 13:51
8e3094d
Compare
Choose a tag to compare

Includes the following new features:
556 manual trimming output
519 numeric PG codes are updated for SAS GB output
Nulls are replaced with zeros in clear target variables
501 Manual imputation trimming is implemented
Output bus are fixed:
#532 postcode mapper should be read in though not validated when reading from feather
#536 and #543 filter status in weigthed_df to include imputed statuses
#542 remove records that don't do R&D from Tau and Sas (but leave for long and short forms)
#546 remove references to 4xx cols in all outputs (FTE data was missing in Tau and Sas)
#547 check filtering by status within output functions
548 Mean of ratios bug fix
100 Construction is implemented. Additions and amendments are disabled
541 Postcodes are corrected to improve the linking to region codes
537 Short form expansion fall-back

v0.4.0 - Fixes to run in DAP

21 Nov 09:50
e6594e7
Compare
Choose a tag to compare

What's Changed

Full Changelog: 0.3.6-alpha-release...0.4.0-alpha-release

0.3.6-alpha-release: Merge pull request #131 from ONSdigital/RDRP-531

17 Nov 17:35
39d15c4
Compare
Choose a tag to compare

0.3.5-alpha-release

15 Nov 13:59
5595f8a
Compare
Choose a tag to compare
Merge pull request #125 from ONSdigital/505_fix_hdfs_path

FIX: 505 fix hdfs path

0.3.4 Imputation bug fixes

10 Nov 13:40
d5bd310
Compare
Choose a tag to compare

This branch implements several fixes for the imputation module:

  • Expansion imputation (step 4 TMI long forms): where there are zeros in the target variables, the breakdown cols were nulls. This is fixed by removing division by zero and entering zeros for the breakdown cols instead.
  • MoR carry forwards: removed "postcode only" rows from the backdata before merging, also resetting the index at the end of the process.
    Census imputation for short forms: methodology advised that "P" selection entries should not after all be included in the calculation of values to impute.
  • Short form expansion imputation: removed division by zero error to ensure breakdown columns are not null.
  • Short form expansion imputation: include trimmed short form rows in the calculations and in the evaluations
  • Also staging_main has been re-structured, and the postcode evaluation is now contained in the feather file.

What's Changed

Full Changelog: 0.3.1-alpha-release...0.3.4-alpha-release

0.3.1-alpha-release: Merge pull request #116 from ONSdigital/495-export-config

02 Nov 16:36
f47ee18
Compare
Choose a tag to compare

v0.3.0

30 Oct 16:17
ebd8a25
Compare
Choose a tag to compare

This release includes:

  • Expansion imputation
  • Further outputs
  • Post code fix

What's Changed

Full Changelog: 0.2.7-alpha-release...0.3.0-alpha-release

Imputation through the whole pipeline

26 Oct 08:04
6fbbb67
Compare
Choose a tag to compare

The results of TMI imputation (long forms only) now feed through to the outputs.

Outlier-detection and Estimation modules have been updated to deal with short forms in long-form format.

Output schemas have been moved from the outputs folder to the config folder.