Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Diffusion Momentum #4

Open
tom-doerr opened this issue May 7, 2022 · 0 comments
Open

Diffusion Momentum #4

tom-doerr opened this issue May 7, 2022 · 0 comments

Comments

@tom-doerr
Copy link

I think the human-in-the-loop part could be much enhanced by adding momentum to the diffusion phase. That way it might be much easier to get significant and meaningful changes in the images.
As pseudocode:

def diffusion(image):
    momentum = 0
    while True:
        diffused_images = diffuse(image.latent_encoding + momentum)
        new_image = user_choice(diffused_images)
        momentum += new_image.latent_encoding - image.latent_encoding
        if stop_diffusion:
            break

Any chance we could get something like that or is it already possible to access the latent encoding so I can implement it myself?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant