Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Prepare RNNT to switch to Numba loss for compatibility #1995

Merged
merged 7 commits into from
Apr 2, 2021

Conversation

titu1994
Copy link
Collaborator

Changelog

  • Add rnnt loss switching capability.
  • Enable passing arbitrary kwargs to the inner loss function.
  • Add jenkins tests (commented out until 21.04 container is released which supports minimum numba version 0.53 for CUDA 11.2)
  • Enable all RNNT model tests using the numba default loss

Signed-off-by: smajumdar [email protected]

@titu1994 titu1994 force-pushed the add_rnnt_loss_support branch from c689da2 to e19d920 Compare March 31, 2021 23:59
@titu1994 titu1994 requested a review from VahidooX April 1, 2021 00:09
@titu1994 titu1994 force-pushed the add_rnnt_loss_support branch from 16fb51d to 0e53390 Compare April 1, 2021 20:17
@lgtm-com
Copy link

lgtm-com bot commented Apr 1, 2021

This pull request fixes 2 alerts when merging 4848e4c into 094b58b - view on LGTM.com

fixed alerts:

  • 2 for Unused import

@lgtm-com
Copy link

lgtm-com bot commented Apr 2, 2021

This pull request fixes 2 alerts when merging 0d2c041 into 094b58b - view on LGTM.com

fixed alerts:

  • 2 for Unused import

@titu1994 titu1994 force-pushed the add_rnnt_loss_support branch from 0d2c041 to b281d1f Compare April 2, 2021 01:16
@lgtm-com
Copy link

lgtm-com bot commented Apr 2, 2021

This pull request fixes 2 alerts when merging b281d1f into 682e90d - view on LGTM.com

fixed alerts:

  • 2 for Unused import

@titu1994 titu1994 merged commit 0b54c7e into NVIDIA:main Apr 2, 2021
@titu1994 titu1994 deleted the add_rnnt_loss_support branch April 2, 2021 01:43
vadam5 pushed a commit to vadam5/NeMo that referenced this pull request Apr 9, 2021
* Prepare RNNT to switch to Numba loss for compatibility

Signed-off-by: smajumdar <[email protected]>

* Update tests for RNNT

Signed-off-by: smajumdar <[email protected]>

* Address comments

Signed-off-by: smajumdar <[email protected]>

* Address comments

Signed-off-by: smajumdar <[email protected]>

* Fix wrong resolution of gradient calculation

Signed-off-by: smajumdar <[email protected]>

* Fix wrong resolution of gradient calculation

Signed-off-by: smajumdar <[email protected]>

* Drop WarpRNNT requirement

Signed-off-by: smajumdar <[email protected]>
Signed-off-by: Virginia Adams <[email protected]>
vadam5 pushed a commit to vadam5/NeMo that referenced this pull request Apr 12, 2021
* Prepare RNNT to switch to Numba loss for compatibility

Signed-off-by: smajumdar <[email protected]>

* Update tests for RNNT

Signed-off-by: smajumdar <[email protected]>

* Address comments

Signed-off-by: smajumdar <[email protected]>

* Address comments

Signed-off-by: smajumdar <[email protected]>

* Fix wrong resolution of gradient calculation

Signed-off-by: smajumdar <[email protected]>

* Fix wrong resolution of gradient calculation

Signed-off-by: smajumdar <[email protected]>

* Drop WarpRNNT requirement

Signed-off-by: smajumdar <[email protected]>
Signed-off-by: Virginia Adams <[email protected]>
michalivne pushed a commit to michalivne/NeMo that referenced this pull request Jun 23, 2021
* Prepare RNNT to switch to Numba loss for compatibility

Signed-off-by: smajumdar <[email protected]>

* Update tests for RNNT

Signed-off-by: smajumdar <[email protected]>

* Address comments

Signed-off-by: smajumdar <[email protected]>

* Address comments

Signed-off-by: smajumdar <[email protected]>

* Fix wrong resolution of gradient calculation

Signed-off-by: smajumdar <[email protected]>

* Fix wrong resolution of gradient calculation

Signed-off-by: smajumdar <[email protected]>

* Drop WarpRNNT requirement

Signed-off-by: smajumdar <[email protected]>
Signed-off-by: Micha Livne <[email protected]>
mousebaiker pushed a commit to mousebaiker/NeMo that referenced this pull request Jul 8, 2021
* Prepare RNNT to switch to Numba loss for compatibility

Signed-off-by: smajumdar <[email protected]>

* Update tests for RNNT

Signed-off-by: smajumdar <[email protected]>

* Address comments

Signed-off-by: smajumdar <[email protected]>

* Address comments

Signed-off-by: smajumdar <[email protected]>

* Fix wrong resolution of gradient calculation

Signed-off-by: smajumdar <[email protected]>

* Fix wrong resolution of gradient calculation

Signed-off-by: smajumdar <[email protected]>

* Drop WarpRNNT requirement

Signed-off-by: smajumdar <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants