New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

What is the attention technique applied to this paper? #14

Open

yongyongdown opened this issue Aug 24, 2020 · 0 comments

yongyongdown commented Aug 24, 2020

Hello, thank you for your interesting research.

I've been studying to understand the attention technique featured in this paper, but I'm not sure how exactly it works.

I studied RNN, LSTM, ATTENTION, Self-Attention (Transformer), etc.

However, these are explained in terms of natural language processing.

I saw that the attention technique was used on the vision side, but I didn't understand in detail yet. How exactly does attention work in this paper?

If you let me know, it will be very helpful to me. Thank you.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment