New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

pai-bert-tiny-zh模型不收敛 #32

Open

wxh001qq opened this issue Jan 20, 2021 · 1 comment

wxh001qq commented Jan 20, 2021

这个模型根本训练不起来....比随机初始化还差

Collaborator

ScarletPan commented Jan 20, 2021

小模型的话采用大一点的learning rate，如1e-4，更大的epoch数，如10个，再试一下？这个模型在实际业务中已经证明是有效的。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment