Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

masked_loss and different GIoU coefficient #21

Open
hazby2002 opened this issue May 19, 2024 · 0 comments
Open

masked_loss and different GIoU coefficient #21

hazby2002 opened this issue May 19, 2024 · 0 comments

Comments

@hazby2002
Copy link

I want to know why the model calls masked_loss when calculating box loss and cycle loss. The last bounding box of a batch is almost ignored because of a low coefficient when calculating loss as a result.

https://github.com/NExT-ChatV/NExT-Chat/blob/main/mllm/models/nextchat/nextchat_base.py#L360


Besides, I also wonder why the coefficient of $GIoU(b, b_{gt})$ in the code is 0.2, which is different from the 0.8 in the paper.

https://github.com/NExT-ChatV/NExT-Chat/blob/main/mllm/models/nextchat/nextchat_base.py#L358

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant