Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Some problems in section 3.1 #42

Open
juan19941228 opened this issue Jun 6, 2023 · 4 comments
Open

Some problems in section 3.1 #42

juan19941228 opened this issue Jun 6, 2023 · 4 comments

Comments

@juan19941228
Copy link

The equation (2) for calculating memory access does not include the pointwise convolution.

@JierunChen
Copy link
Owner

JierunChen commented Jul 13, 2023

@juan19941228 Yes, equation (2) only compares the memory access for spatial feature extraction and does not account for the memory access by the pointwise convolution (PWConv).

@abcsimple
Copy link

Is formula 2 only applicable to MobileNet v2, or can it be used with other models as well? This is an important question because in some cases, such as when DWConv is implemented before Conv 1*1, the memory access can be calculated using the formula h * w * 2c + k^2 * c, which results in lower memory usage compared to a regular Conv.

@JierunChen
Copy link
Owner

@abcsimple Hi, the comparison of equations (2) and (3) is based on a reasonable assumption that the width or the number of channels when using DWConv is generally higher than that when using Conv.

@abcsimple
Copy link

@JierunChen Thank you for your response. The number of channels in DWConv is increased by the Pointwise Convolution. If DWConv is implemented before Pointwise Convolution, the channel should be the same as the input feature map. Please let me know if I have misunderstood anything.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants