Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Usage of BCE for likelihood of gaussian distributed data? #16

Open
chedatomasz opened this issue Jun 6, 2023 · 0 comments
Open

Usage of BCE for likelihood of gaussian distributed data? #16

chedatomasz opened this issue Jun 6, 2023 · 0 comments

Comments

@chedatomasz
Copy link

In the code for non-convolutional VQ-VAE, you seem to use BCE loss as the reconstruction loss for images. If I understand correctly, that would correspond to assuming that the image pixels follow a Bernoulli distribution, instead of the regular Gaussian assumption underlying MSE loss. Is this a deliberate choice? In the convolutional VQ-VAE operating on the same MNIST dataset, you use MSE.
The relevant line: https://github.com/nadavbh12/VQ-VAE/blob/a360e77d43ec43dd5a989f057cbf8e0843bb9b1f/vq_vae/auto_encoder.py#LL158C50-L158C50

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant