Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Initial methods to skip already-processed images. #374

Merged
merged 9 commits into from
Apr 1, 2024
Merged

Conversation

mihow
Copy link
Collaborator

@mihow mihow commented Mar 26, 2024

  • Adds method to store and check what images and what detections have been processed by what algorithms
  • Updates the ML backend schema to nest detections and classifications under the source image response, to more readability associate related objects
  • Add new tests
  • Fix related bugs & add new logging related to these features

Future work:

  • Populate the algorithm metadata to all existing classifications so they won't be reprocessed
  • Add support for reusing detections if only the classification algorithm has changed
  • Reduce logging related to this change

IMPORTANT: the current ML backend is the "api-only-prototype" branch in the ami-data-companion repo. Launch with the ami api command. This is running on gpu-4 in the Arbutus cloud.
RolnickLab/ami-data-companion#56

Copy link

netlify bot commented Mar 26, 2024

Deploy Preview for ami-storybook canceled.

Name Link
🔨 Latest commit b3031bb
🔍 Latest deploy log https://app.netlify.com/sites/ami-storybook/deploys/660b4125fbf5a100086231b3

Copy link

netlify bot commented Mar 26, 2024

Deploy Preview for ami-web canceled.

Name Link
🔨 Latest commit b3031bb
🔍 Latest deploy log https://app.netlify.com/sites/ami-web/deploys/660b4125f46b6b0008a07f27

@mihow mihow marked this pull request as ready for review April 1, 2024 23:08
@mihow mihow merged commit 5f35664 into main Apr 1, 2024
6 checks passed
@mihow mihow deleted the feat/dont-reprocess branch April 1, 2024 23:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant