New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Enable int4 to int4 CPU STBE in fbgemm_gpu TBE API #2994

Closed

excelle08 wants to merge 3 commits into pytorch:main from excelle08:export-D61305978

Contributor

excelle08 commented Aug 15, 2024

Summary: Enable int4 to int4 sequential CPU TBE in codegen template so that fbgemm_gpu's IntNBitTableBatchedEmbeddingBagsCodegen could support it

Differential Revision: D61305978

facebook-github-bot added the cla signed label

netlify bot commented Aug 15, 2024 •

edited

Loading

✅ Deploy Preview for pytorch-fbgemm-docs ready!

Name	Link
🔨 Latest commit	`e971c91`
🔍 Latest deploy log	https://app.netlify.com/sites/pytorch-fbgemm-docs/deploys/66c7a74c7a55c50008d22fa8
😎 Deploy Preview	https://deploy-preview-2994--pytorch-fbgemm-docs.netlify.app
📱 Preview on mobile	Toggle QR Code... Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

Contributor

facebook-github-bot commented Aug 15, 2024

This pull request was exported from Phabricator. Differential Revision: D61305978

facebook-github-bot added the fb-exported label

Contributor

facebook-github-bot commented Aug 15, 2024

This pull request was exported from Phabricator. Differential Revision: D61305978

excelle08 added a commit to excelle08/FBGEMM that referenced this pull request


          Enable int4 to int4 CPU STBE in fbgemm_gpu TBE API (pytorch#2994)

2bd52c1

Summary:
Pull Request resolved: pytorch#2994

X-link: facebookresearch/FBGEMM#89

Enable int4 to int4 sequential CPU TBE in codegen template so that fbgemm_gpu's `IntNBitTableBatchedEmbeddingBagsCodegen` could support it

Differential Revision: D61305978

excelle08 force-pushed the export-D61305978 branch from 6453fb6 to 2bd52c1 Compare

August 15, 2024 00:19

Contributor

facebook-github-bot commented Aug 15, 2024

This pull request was exported from Phabricator. Differential Revision: D61305978

excelle08 added a commit to excelle08/FBGEMM that referenced this pull request


          Enable int4 to int4 CPU STBE in fbgemm_gpu TBE API (pytorch#2994)

Summary:
Pull Request resolved: pytorch#2994

X-link: facebookresearch/FBGEMM#89

Enable int4 to int4 sequential CPU TBE in codegen template so that fbgemm_gpu's `IntNBitTableBatchedEmbeddingBagsCodegen` could support it

Differential Revision: D61305978

excelle08 force-pushed the export-D61305978 branch from 2bd52c1 to 4512390 Compare

August 15, 2024 00:27

Contributor

facebook-github-bot commented Aug 15, 2024

This pull request was exported from Phabricator. Differential Revision: D61305978

excelle08 force-pushed the export-D61305978 branch from 4512390 to b2e0bca Compare

August 15, 2024 17:23

excelle08 added a commit to excelle08/FBGEMM that referenced this pull request


          Enable int4 to int4 CPU STBE in fbgemm_gpu TBE API (pytorch#2994)

b2e0bca

Summary:
Pull Request resolved: pytorch#2994

X-link: facebookresearch/FBGEMM#89

Enable int4 to int4 sequential CPU TBE in codegen template so that fbgemm_gpu's `IntNBitTableBatchedEmbeddingBagsCodegen` could support it

Differential Revision: D61305978

Contributor

facebook-github-bot commented Aug 15, 2024

This pull request was exported from Phabricator. Differential Revision: D61305978

excelle08 added a commit to excelle08/FBGEMM that referenced this pull request


          Enable int4 to int4 CPU STBE in fbgemm_gpu TBE API (pytorch#2994)

94df08b

Summary:
Pull Request resolved: pytorch#2994

X-link: facebookresearch/FBGEMM#89

Enable int4 to int4 sequential CPU TBE in codegen template so that fbgemm_gpu's `IntNBitTableBatchedEmbeddingBagsCodegen` could support it

Differential Revision: D61305978

excelle08 force-pushed the export-D61305978 branch from b2e0bca to 94df08b Compare

August 15, 2024 20:27

Contributor

facebook-github-bot commented Aug 15, 2024

This pull request was exported from Phabricator. Differential Revision: D61305978

excelle08 added a commit to excelle08/FBGEMM that referenced this pull request


          Enable int4 to int4 CPU STBE in fbgemm_gpu TBE API (pytorch#2994)

f0d5570

Summary:
Pull Request resolved: pytorch#2994

X-link: facebookresearch/FBGEMM#89

Enable int4 to int4 sequential CPU TBE in codegen template so that fbgemm_gpu's `IntNBitTableBatchedEmbeddingBagsCodegen` could support it

Differential Revision: D61305978

excelle08 force-pushed the export-D61305978 branch from 94df08b to f0d5570 Compare

August 15, 2024 20:32

Contributor

facebook-github-bot commented Aug 15, 2024

This pull request was exported from Phabricator. Differential Revision: D61305978

excelle08 added a commit to excelle08/FBGEMM that referenced this pull request


          Enable int4 to int4 CPU STBE in fbgemm_gpu TBE API (pytorch#2994)

3ef9e61

Summary:
Pull Request resolved: pytorch#2994

X-link: facebookresearch/FBGEMM#89

Enable int4 to int4 sequential CPU TBE in codegen template so that fbgemm_gpu's `IntNBitTableBatchedEmbeddingBagsCodegen` could support it

Reviewed By: sryap

Differential Revision: D61305978

excelle08 force-pushed the export-D61305978 branch from f0d5570 to 3ef9e61 Compare

August 15, 2024 20:36

Contributor

facebook-github-bot commented Aug 17, 2024

This pull request was exported from Phabricator. Differential Revision: D61305978

excelle08 force-pushed the export-D61305978 branch from 3ef9e61 to 7a23006 Compare

August 17, 2024 00:50

excelle08 added a commit to excelle08/FBGEMM that referenced this pull request


          Enable int4 to int4 CPU STBE in fbgemm_gpu TBE API (pytorch#2994)

7a23006

Summary:
Pull Request resolved: pytorch#2994

X-link: facebookresearch/FBGEMM#89

Enable int4 to int4 sequential CPU TBE in codegen template so that fbgemm_gpu's `IntNBitTableBatchedEmbeddingBagsCodegen` could support it

Reviewed By: sryap

Differential Revision: D61305978

Contributor

facebook-github-bot commented Aug 18, 2024

This pull request was exported from Phabricator. Differential Revision: D61305978

excelle08 added a commit to excelle08/FBGEMM that referenced this pull request


          Enable int4 to int4 CPU STBE in fbgemm_gpu TBE API (pytorch#2994)

d2b060f

Summary:
Pull Request resolved: pytorch#2994

X-link: facebookresearch/FBGEMM#89

Enable int4 to int4 sequential CPU TBE in codegen template so that fbgemm_gpu's `IntNBitTableBatchedEmbeddingBagsCodegen` could support it

Reviewed By: sryap

Differential Revision: D61305978

excelle08 force-pushed the export-D61305978 branch from 7a23006 to d2b060f Compare

August 18, 2024 05:06

Contributor

facebook-github-bot commented Aug 18, 2024

This pull request was exported from Phabricator. Differential Revision: D61305978

excelle08 force-pushed the export-D61305978 branch from d2b060f to de69773 Compare

August 18, 2024 05:10

excelle08 force-pushed the export-D61305978 branch from de69773 to 9c7aed9 Compare

August 18, 2024 05:15

Contributor

facebook-github-bot commented Aug 19, 2024

This pull request was exported from Phabricator. Differential Revision: D61305978

excelle08 added a commit to excelle08/FBGEMM that referenced this pull request


          Enable int4 to int4 CPU STBE in fbgemm_gpu TBE API (pytorch#2994)

e6b6e03

Summary:
Pull Request resolved: pytorch#2994

X-link: facebookresearch/FBGEMM#89

Enable int4 to int4 sequential CPU TBE in codegen template so that fbgemm_gpu's `IntNBitTableBatchedEmbeddingBagsCodegen` could support it

Reviewed By: sryap

Differential Revision: D61305978

excelle08 force-pushed the export-D61305978 branch from 9c7aed9 to e6b6e03 Compare

August 19, 2024 21:07

Contributor

facebook-github-bot commented Aug 20, 2024

This pull request was exported from Phabricator. Differential Revision: D61305978

excelle08 added a commit to excelle08/FBGEMM that referenced this pull request


          Enable int4 to int4 CPU STBE in fbgemm_gpu TBE API (pytorch#2994)

7abfc80

Summary:
Pull Request resolved: pytorch#2994

X-link: facebookresearch/FBGEMM#89

Enable int4 to int4 sequential CPU TBE in codegen template so that fbgemm_gpu's `IntNBitTableBatchedEmbeddingBagsCodegen` could support it

Reviewed By: sryap

Differential Revision: D61305978

excelle08 force-pushed the export-D61305978 branch from e6b6e03 to 7abfc80 Compare

August 20, 2024 15:45

excelle08 added a commit to excelle08/FBGEMM that referenced this pull request


          Enable int4 to int4 CPU STBE in fbgemm_gpu TBE API (pytorch#2994)

f5528fb

Summary:
Pull Request resolved: pytorch#2994

X-link: facebookresearch/FBGEMM#89

Enable int4 to int4 sequential CPU TBE in codegen template so that fbgemm_gpu's `IntNBitTableBatchedEmbeddingBagsCodegen` could support it

Reviewed By: sryap

Differential Revision: D61305978

excelle08 force-pushed the export-D61305978 branch from 7abfc80 to f5528fb Compare

August 20, 2024 15:49

Contributor

facebook-github-bot commented Aug 20, 2024

This pull request was exported from Phabricator. Differential Revision: D61305978

1 similar comment

Contributor

facebook-github-bot commented Aug 20, 2024

This pull request was exported from Phabricator. Differential Revision: D61305978

excelle08 added a commit to excelle08/FBGEMM that referenced this pull request


          Enable int4 to int4 CPU STBE in fbgemm_gpu TBE API (pytorch#2994)

e248443

Summary:
Pull Request resolved: pytorch#2994

X-link: facebookresearch/FBGEMM#89

Enable int4 to int4 sequential CPU TBE in codegen template so that fbgemm_gpu's `IntNBitTableBatchedEmbeddingBagsCodegen` could support it

Reviewed By: sryap

Differential Revision: D61305978

excelle08 force-pushed the export-D61305978 branch from f5528fb to e248443 Compare

August 20, 2024 15:54

excelle08 added a commit to excelle08/FBGEMM that referenced this pull request


          Enable int4 to int4 CPU STBE in fbgemm_gpu TBE API (pytorch#2994)

fc4cdfc

Summary:
Pull Request resolved: pytorch#2994

X-link: facebookresearch/FBGEMM#89

Enable int4 to int4 sequential CPU TBE in codegen template so that fbgemm_gpu's `IntNBitTableBatchedEmbeddingBagsCodegen` could support it

Reviewed By: sryap

Differential Revision: D61305978

excelle08 force-pushed the export-D61305978 branch from e248443 to fc4cdfc Compare

August 22, 2024 02:43

Contributor

facebook-github-bot commented Aug 22, 2024

This pull request was exported from Phabricator. Differential Revision: D61305978

wsu added 2 commits

August 22, 2024 13:44


          Add a CPU nbit to float dequantization op that supports torch.quintMx…

0432ecd

…N type and QuantizedCPU backend

Differential Revision: D61305979


          Add int4 to int4 CPU Sequence TBE kernel

ea074b4

Differential Revision: D61305980

Contributor

facebook-github-bot commented Aug 22, 2024

This pull request was exported from Phabricator. Differential Revision: D61305978

excelle08 force-pushed the export-D61305978 branch from fc4cdfc to 61a2ecb Compare

August 22, 2024 20:50

Contributor

facebook-github-bot commented Aug 22, 2024

This pull request was exported from Phabricator. Differential Revision: D61305978

excelle08 added a commit to excelle08/FBGEMM that referenced this pull request


          Enable int4 to int4 CPU STBE in fbgemm_gpu TBE API (pytorch#2994)

1d63bd2

Summary:
Pull Request resolved: pytorch#2994

X-link: facebookresearch/FBGEMM#89

Enable int4 to int4 sequential CPU TBE in codegen template so that fbgemm_gpu's `IntNBitTableBatchedEmbeddingBagsCodegen` could support it

Reviewed By: sryap

Differential Revision: D61305978

excelle08 force-pushed the export-D61305978 branch from 61a2ecb to 1d63bd2 Compare

August 22, 2024 20:56


          Enable int4 to int4 CPU STBE in fbgemm_gpu TBE API (pytorch#2994)

e971c91

Summary:
Pull Request resolved: pytorch#2994

X-link: facebookresearch/FBGEMM#89

Enable int4 to int4 sequential CPU TBE in codegen template so that fbgemm_gpu's `IntNBitTableBatchedEmbeddingBagsCodegen` could support it

Reviewed By: sryap

Differential Revision: D61305978

Contributor

facebook-github-bot commented Aug 22, 2024

This pull request was exported from Phabricator. Differential Revision: D61305978

excelle08 force-pushed the export-D61305978 branch from 1d63bd2 to e971c91 Compare

August 22, 2024 21:02

facebook-github-bot closed this in

46acf13

facebook-github-bot added the Merged label

Contributor

facebook-github-bot commented Aug 23, 2024

This pull request has been merged in 46acf13.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cla signed fb-exported Merged