Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pyramid Vision Transformer #17596

Closed
2 tasks done
danielhoshizaki opened this issue Jun 8, 2022 · 5 comments · Fixed by #24720
Closed
2 tasks done

Pyramid Vision Transformer #17596

danielhoshizaki opened this issue Jun 8, 2022 · 5 comments · Fixed by #24720

Comments

@danielhoshizaki
Copy link

danielhoshizaki commented Jun 8, 2022

Model description

I would like to add the Pyramid Vision Transformer model.

Paper Abstract

Pyramid Vision Transformer~(PVT), has several merits compared to prior arts. (1) Different from ViT that typically has low-resolution outputs and high computational and memory cost, PVT can be not only trained on dense partitions of the image to achieve high output resolution, which is important for dense predictions but also using a progressive shrinking pyramid to reduce computations of large feature maps. (2) PVT inherits the advantages from both CNN and Transformer, making it a unified backbone in various vision tasks without convolutions by simply replacing CNN backbones. (3) We validate PVT by conducting extensive experiments, showing that it boosts the performance of many downstream tasks

Open source status

  • The model implementation is available
  • The model weights are available

Provide useful links for the implementation

Model Implementation: https://github.com/whai362/PVT

Pretrained model weights for semantic segmentation: https://github.com/whai362/PVT/tree/v2/segmentation (based on ADE20K)

@satpalsr
Copy link

Hey @danielhoshizaki, Can I join you?

@andy1122
Copy link

@danielhoshizaki , I would love to contribute for this new model.

@danielhoshizaki
Copy link
Author

Thanks for offering to help and sorry about the late response.
I'm going to have a go at this model and if I need any help I will let you know.

@satpalsr
Copy link

Sure @danielhoshizaki

@BakingBrains
Copy link
Contributor

anyone working on this?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

4 participants