Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improved training tracking: compute metrics, save predictions #294

Open
jdeschamps opened this issue Dec 6, 2024 · 0 comments
Open

Improved training tracking: compute metrics, save predictions #294

jdeschamps opened this issue Dec 6, 2024 · 0 comments
Labels
feature New feature or request
Milestone

Comments

@jdeschamps
Copy link
Member

jdeschamps commented Dec 6, 2024

Problem

Currently, only the loss on validation images is reported during training. We should allow the possibility to compute metrics (scale invariant PSNR, MicroSSIM) if applicable, and save predictions on a validation image.

Ideally, this would be compatible with the three supported logger:

  • CSVLogger: metrics should be reported.
  • WandB: metrics and prediction should be saved.
  • TensorBoard: same as WandB.

Finally, predictions could be saved to a user-defined folder.

Potential solution

Firstly, we now have the capacity to predict during training, although the solution is pretty hacky: #266.

Secondly, PyTorch Lightning should have all the engineering required to save the metrics and the predictions in the relevant loggers:

Linked issues

#299: better convenience functions for N2V

@jdeschamps jdeschamps added the feature New feature or request label Dec 6, 2024
@jdeschamps jdeschamps changed the title Improved training tracking: compute metrics, save prediction Improved training tracking: compute metrics, save predictions Dec 6, 2024
@jdeschamps jdeschamps added this to the v0.2.0 milestone Dec 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant