Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add faster validation to improve training speed #46

Closed
MiXaiLL76 opened this issue Jun 16, 2022 · 3 comments
Closed

Add faster validation to improve training speed #46

MiXaiLL76 opened this issue Jun 16, 2022 · 3 comments
Assignees
Labels
enhancement New feature or request

Comments

@MiXaiLL76
Copy link

Describe the feature

Faster implementation of the COCOeval function written in C++

Motivation

I often work with the mmdet project and use datasets in COCO format. There are a large number of objects in my datasets (more than 3000 for 1 photo). I would like to get validation after each epoch, but at the same time not delay training. The standard COCOeval algorithm with such a number of objects is slow, but there is a faster implementation, which I cleaned out of dependencies (torch / detectron2) and use in my work.
I am ready to open a PR and transfer the developments to the project.

Related resources

The original implementation of the library is in detectron2
Also, at some point, christofferedlund started working on clearing the library of facebook dependencies, but abandoned the project without putting the source codes on github.
I found the source codes on the Internet and continued his work. faster_coco_eval

Additional context

I benchmarked the validation on the original coco val dataset and presented the results in the project repository.

Visualization of testing comparison.ipynb available in comparison
Tested with yolo3 model (bbox eval) and yoloact model (segm eval)

Type COCOeval COCOeval_faster Profit
bbox 22.854 sec. 8.714 sec. more than 2x
segm 35.356 sec. 18.403 sec. 2x
@RangiLyu RangiLyu added the enhancement New feature or request label Jun 17, 2022
@RangiLyu
Copy link
Member

We will opensource a repo for evaluation recently, we may add this feature to that repo.

@MiXaiLL76
Copy link
Author

We will opensource a repo for evaluation recently, we may add this feature to that repo.

It's a good idea

@RangiLyu RangiLyu transferred this issue from open-mmlab/mmdetection Oct 31, 2022
@MiXaiLL76
Copy link
Author

#120

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants