Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make source message generator into separate process #22

Merged
merged 3 commits into from
Aug 12, 2024

Conversation

jeremyestein
Copy link
Collaborator

No description provided.

Copy link

PR checklist

Default guide for a PR (if multiple PRs for the work, only keep one version of it and link to it on the other PRs)

  • From the UCLH data science desktop, a validation run has been set off
  • load times
    in UCL teams has been populated with the run information
  • During the run, glowroot has been checked for any queries which are taking a substantial proportion of the
    total processing time. This can be useful to identify indexes that are required.
  • After the run, look for any unexpected errors in the etl_per_message_logging table, the error_search.sql file
    on the shared drive can be used for this \\sharefs6\UCLH6\EMAP\Shared\EmapSqlScripts\devops\error_search.sql.
    Create an issue if you find an unexpected exception and is not related to the changes you've made, otherwise
    fix them!
  • After the run, populate the end time in
    load times
  • Let Aasiyah know about the completed validation and give her information on the changes and where to start
    with the validation
  • Check validation report and give any feedback to Aasiyah if there are any changes needed on her side,
    iterate on getting the validation to match at least 99% (validation and emap code).

Copy link
Contributor

@skeating skeating left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks like a good start to me,
.

message stream. Use a quick, ad hoc text format for the time being -
convert to real HL7 later. This demonstrates the acceptable
performance of sending large amounts of text over the network and
then parsing it.

Some hardening of the docker compose init process - add rabbitmq
healthcheck.
@jeremyestein jeremyestein changed the base branch from develop to sk/waveform-dev August 8, 2024 14:48
@jeremyestein jeremyestein marked this pull request as ready for review August 9, 2024 09:08
@jeremyestein jeremyestein changed the title Waveform data Make source message generator into separate process Aug 9, 2024
@jeremyestein jeremyestein requested a review from skeating August 9, 2024 09:45
@jeremyestein jeremyestein merged commit 5eecc32 into sk/waveform-dev Aug 12, 2024
@jeremyestein jeremyestein deleted the jeremy/hf-data branch August 12, 2024 09:42
@jeremyestein jeremyestein restored the jeremy/hf-data branch August 12, 2024 09:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants