Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

GPU memory required for training #10

Open
qiuzidian opened this issue Aug 31, 2024 · 5 comments
Open

GPU memory required for training #10

qiuzidian opened this issue Aug 31, 2024 · 5 comments

Comments

@qiuzidian
Copy link

Hello! Can I train it on a 24GB 3090?
@Orange-Ctrl
Copy link

Hi, were you able to successfully run the code on an 3090?

@qiuzidian
Copy link
Author

no, according to the wandb log, it seems that need 48G to train

@Orange-Ctrl
Copy link

no, according to the wandb log, it seems that need 48G to train

I run on 8 24G gpus and failed. I have no ideas what went wrong.

@qiuzidian
Copy link
Author

each GPU's memory should not be less than 40G

@Orange-Ctrl
Copy link

each GPU's memory should not be less than 40G

got it, thank you!

@Orange-Ctrl Orange-Ctrl mentioned this issue Dec 16, 2024
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@Orange-Ctrl @qiuzidian