Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add automated novel concept training for SD to a new executor #114

Open
AmericanPresidentJimmyCarter opened this issue Sep 19, 2022 · 2 comments

Comments

@AmericanPresidentJimmyCarter
Copy link
Contributor

Basically run this notebook but as an executor: https://colab.research.google.com/github/huggingface/notebooks/blob/main/diffusers/sd_textual_inversion_training.ipynb

The concepts could be automatically uploaded to huggingface or piped directly as docarrays to stable executors.

@AmericanPresidentJimmyCarter
Copy link
Contributor Author

Turns out this is already out of date lol. Apparently the better implementation is here: https://github.com/XavierXiao/Dreambooth-Stable-Diffusion

@AmericanPresidentJimmyCarter
Copy link
Contributor Author

OK -- looking into this more, the dreambooth method finetunes the actual model and so is not portable. This is fine -- lstein has a good, lower memory implementation of the training script that works with the weights from the checkpoint we use otherwise. Then we can just automate the uploading step to huggingface according to the diffusers script above.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant