Does MuLan require attention masking for the audio part of the tower? #65
Unanswered
14leeyuchieh
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I was taking a look at the
forward
implementation ofAudioSpectrogramTransformer
and notice it does not intake an attention mask or pass it to the underlying transformerIs this a bug? Or does Mulan handle attention masking when batching audio of arbitrary length via just padding?
Beta Was this translation helpful? Give feedback.
All reactions