Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Refactor] Support batch inference with shape clustering #1668

Merged
merged 4 commits into from
Feb 8, 2023
Merged

[Refactor] Support batch inference with shape clustering #1668

merged 4 commits into from
Feb 8, 2023

Conversation

lzhangzz
Copy link
Collaborator

Refactor NetModule to support batch inference with shape clustering and split large batch (larger than model's max batch size) automatically.

@lzhangzz lzhangzz added the SDK label Jan 18, 2023
@lvhan028 lvhan028 requested review from irexyc and lvhan028 February 1, 2023 07:46
@lvhan028 lvhan028 merged commit f5a05b5 into open-mmlab:master Feb 8, 2023
lzhangzz added a commit to lzhangzz/mmdeploy that referenced this pull request Feb 8, 2023
@lzhangzz
[Refactor] Support batch inference with shape clustering (open-mmlab#…
ca1fd1f 
…1668)

* refactor `NetModule`

* name

* fix sorting

* fix indices

(cherry picked from commit f5a05b5)
@irexyc irexyc mentioned this pull request Feb 15, 2023
Closed
3 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@irexyc irexyc irexyc approved these changes

@lvhan028 lvhan028 lvhan028 approved these changes

Assignees
No one assigned
Labels
SDK
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@lzhangzz @lvhan028 @irexyc