Skip to content

Commit

Permalink
πŸ› add supported attention
Browse files Browse the repository at this point in the history
  • Loading branch information
jgrss committed Jul 31, 2024
1 parent c685fa5 commit 85dc5d0
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions src/cultionet/nn/modules/convolution.py
Original file line number Diff line number Diff line change
Expand Up @@ -356,6 +356,7 @@ def __init__(
assert self.attention_weights in [
AttentionTypes.FRACTAL,
AttentionTypes.SPATIAL_CHANNEL,
AttentionTypes.NATTEN,
], "The attention method is not supported."

self.gamma = nn.Parameter(torch.ones(1))
Expand Down

0 comments on commit 85dc5d0

Please sign in to comment.