Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Variance Scheduler #144

Open
sai-advaith opened this issue Nov 25, 2023 · 2 comments
Open

Variance Scheduler #144

sai-advaith opened this issue Nov 25, 2023 · 2 comments

Comments

@sai-advaith
Copy link

I am using DeepFloyd locally with Stage I medium, T5 medium, and stage II medium. I noticed that if I were to modify the variance scheduler for sampling to linear from cosine, the sample results are much worse than with a cosine scheduler.

Is there a reason why this happens? And, is there a way DeepFloyd can work well with a linear scheduler too?

@ShaochengShen
Copy link

i discover the same question too.Do u have any progress on this issue?

@bghira
Copy link

bghira commented Apr 28, 2024

DeepFloyd was trained with a cosine schedule.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants