Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Enhancement] Add grad check #262

Open
wants to merge 2 commits into
base: develop
Choose a base branch
from

Conversation

Birdylx
Copy link
Collaborator

@Birdylx Birdylx commented Mar 9, 2023

  1. Add grad check to validate if there some trainable parameters got empty grad after backward.

@nepeplwu nepeplwu self-assigned this Feb 1, 2024
@nepeplwu
Copy link
Collaborator

nepeplwu commented Feb 6, 2024

建议添加一个开关控制是否进行检查(例如某些情况下,用户可能多写了一个没有用到的Layer,那么就会触发这个报错逻辑)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants