Codebook for different levels

[SURABHI-GUPTA]

@rosinality Is it that there is single codebook for all latent levels, or is it separate for each level ? Also what will be the affect of reducing the number of codebook embeddings, (in paper it is 512)? Will it help to more compact latent representaton ?

[rosinality]

1. Each level has separated codebooks.
2. It is depend on how you will define the meaning of compact representation. Reducing the size of codebook will not decrease the size of latent or bottleneck feature maps. But definitely it will reduce the size of the codes that needed to represents the feature map.