Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

About the proof of introducing a small uniform noise helps preventing trivial posterior. #40

Open
Ma-Weijian opened this issue Dec 19, 2023 · 1 comment

Comments

@Ma-Weijian
Copy link

Hi.

Fantastic work about discrete diffusion but i still have something not so clear.

You've mentioned in your paper that introducing a small uniform noise instead of totally masking helps preventing from model collapse. In the paper you said that the proof is in the supplementary. But in the supplementary I have only found the proof of Equation 8. I wonder where the actural proof of your claim is, or how to come up with your claim from the proof of Equation 8.

A million thanks.

@Ma-Weijian
Copy link
Author

Anyone can give me some hints? I'm in urgent need of this. Anything helps!

Thanks a lot!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant