Skip to content

Extract the res backend to a separate class and export to python side #4714

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

chouxi
Copy link
Contributor

@chouxi chouxi commented Aug 15, 2025

Summary:
X-link: https://github.com/facebookresearch/FBGEMM/pull/1738

We're extending the raw embedding streaming to tables with UVM_CACHING.

Extract the backend out to a standalone class under deeplearning/fbgemm/fbgemm_gpu/src/split_embeddings_cache folder, so the logic could be reused by SplitTableBatchedEmbeddingBagsCodegen that supports the UVM_CACHING tables.

Differential Revision: D79192671

Copy link

netlify bot commented Aug 15, 2025

Deploy Preview for pytorch-fbgemm-docs ready!

Name Link
🔨 Latest commit 2396172
🔍 Latest deploy log https://app.netlify.com/projects/pytorch-fbgemm-docs/deploys/68a3aeb51008ee0008b4ded7
😎 Deploy Preview https://deploy-preview-4714--pytorch-fbgemm-docs.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

@meta-cla meta-cla bot added the cla signed label Aug 15, 2025
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D79192671

chouxi added a commit to chouxi/FBGEMM that referenced this pull request Aug 15, 2025
…pytorch#4714)

Summary:

X-link: facebookresearch/FBGEMM#1738

We're extending the raw embedding streaming to tables with UVM_CACHING.

Extract the backend out to a standalone class under deeplearning/fbgemm/fbgemm_gpu/src/split_embeddings_cache folder, so the logic could be reused by [SplitTableBatchedEmbeddingBagsCodegen](https://www.internalfb.com/code/fbsource/fbcode/deeplearning/fbgemm/fbgemm_gpu/fbgemm_gpu/split_table_batched_embeddings_ops_training.py?lines=1349) that supports the UVM_CACHING tables.

Differential Revision: D79192671
chouxi added a commit to chouxi/FBGEMM that referenced this pull request Aug 15, 2025
…pytorch#4714)

Summary:

X-link: facebookresearch/FBGEMM#1738

We're extending the raw embedding streaming to tables with UVM_CACHING.

Extract the backend out to a standalone class under deeplearning/fbgemm/fbgemm_gpu/src/split_embeddings_cache folder, so the logic could be reused by [SplitTableBatchedEmbeddingBagsCodegen](https://www.internalfb.com/code/fbsource/fbcode/deeplearning/fbgemm/fbgemm_gpu/fbgemm_gpu/split_table_batched_embeddings_ops_training.py?lines=1349) that supports the UVM_CACHING tables.

Differential Revision: D79192671
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D79192671

chouxi added a commit to chouxi/FBGEMM that referenced this pull request Aug 15, 2025
…pytorch#4714)

Summary:
Pull Request resolved: pytorch#4714

X-link: facebookresearch/FBGEMM#1738

We're extending the raw embedding streaming to tables with UVM_CACHING.

Extract the backend out to a standalone class under deeplearning/fbgemm/fbgemm_gpu/src/split_embeddings_cache folder, so the logic could be reused by [SplitTableBatchedEmbeddingBagsCodegen](https://www.internalfb.com/code/fbsource/fbcode/deeplearning/fbgemm/fbgemm_gpu/fbgemm_gpu/split_table_batched_embeddings_ops_training.py?lines=1349) that supports the UVM_CACHING tables.

Differential Revision: D79192671
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D79192671

chouxi added a commit to chouxi/FBGEMM that referenced this pull request Aug 16, 2025
…pytorch#4714)

Summary:
Pull Request resolved: pytorch#4714

X-link: facebookresearch/FBGEMM#1738

We're extending the raw embedding streaming to tables with UVM_CACHING.

Extract the backend out to a standalone class under deeplearning/fbgemm/fbgemm_gpu/src/split_embeddings_cache folder, so the logic could be reused by [SplitTableBatchedEmbeddingBagsCodegen](https://www.internalfb.com/code/fbsource/fbcode/deeplearning/fbgemm/fbgemm_gpu/fbgemm_gpu/split_table_batched_embeddings_ops_training.py?lines=1349) that supports the UVM_CACHING tables.

Differential Revision: D79192671
@chouxi chouxi force-pushed the export-D79192671 branch 2 times, most recently from b94f1a2 to f43015e Compare August 18, 2025 18:15
chouxi added a commit to chouxi/FBGEMM that referenced this pull request Aug 18, 2025
…pytorch#4714)

Summary:

X-link: facebookresearch/FBGEMM#1738

We're extending the raw embedding streaming to tables with UVM_CACHING.

Extract the backend out to a standalone class under deeplearning/fbgemm/fbgemm_gpu/src/split_embeddings_cache folder, so the logic could be reused by [SplitTableBatchedEmbeddingBagsCodegen](https://www.internalfb.com/code/fbsource/fbcode/deeplearning/fbgemm/fbgemm_gpu/fbgemm_gpu/split_table_batched_embeddings_ops_training.py?lines=1349) that supports the UVM_CACHING tables.

Differential Revision: D79192671
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D79192671

chouxi added a commit to chouxi/FBGEMM that referenced this pull request Aug 18, 2025
…pytorch#4714)

Summary:

X-link: facebookresearch/FBGEMM#1738

We're extending the raw embedding streaming to tables with UVM_CACHING.

Extract the backend out to a standalone class under deeplearning/fbgemm/fbgemm_gpu/src/split_embeddings_cache folder, so the logic could be reused by [SplitTableBatchedEmbeddingBagsCodegen](https://www.internalfb.com/code/fbsource/fbcode/deeplearning/fbgemm/fbgemm_gpu/fbgemm_gpu/split_table_batched_embeddings_ops_training.py?lines=1349) that supports the UVM_CACHING tables.

Differential Revision: D79192671
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D79192671

chouxi added a commit to chouxi/FBGEMM that referenced this pull request Aug 18, 2025
…pytorch#4714)

Summary:

X-link: facebookresearch/FBGEMM#1738

We're extending the raw embedding streaming to tables with UVM_CACHING.

Extract the backend out to a standalone class under deeplearning/fbgemm/fbgemm_gpu/src/split_embeddings_cache folder, so the logic could be reused by [SplitTableBatchedEmbeddingBagsCodegen](https://www.internalfb.com/code/fbsource/fbcode/deeplearning/fbgemm/fbgemm_gpu/fbgemm_gpu/split_table_batched_embeddings_ops_training.py?lines=1349) that supports the UVM_CACHING tables.

Differential Revision: D79192671
chouxi added a commit to chouxi/FBGEMM that referenced this pull request Aug 18, 2025
…pytorch#4714)

Summary:

X-link: facebookresearch/FBGEMM#1738

We're extending the raw embedding streaming to tables with UVM_CACHING.

Extract the backend out to a standalone class under deeplearning/fbgemm/fbgemm_gpu/src/split_embeddings_cache folder, so the logic could be reused by [SplitTableBatchedEmbeddingBagsCodegen](https://www.internalfb.com/code/fbsource/fbcode/deeplearning/fbgemm/fbgemm_gpu/fbgemm_gpu/split_table_batched_embeddings_ops_training.py?lines=1349) that supports the UVM_CACHING tables.

Differential Revision: D79192671
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D79192671

chouxi added a commit to chouxi/FBGEMM that referenced this pull request Aug 18, 2025
…pytorch#4714)

Summary:

X-link: facebookresearch/FBGEMM#1738

We're extending the raw embedding streaming to tables with UVM_CACHING.

Extract the backend out to a standalone class under deeplearning/fbgemm/fbgemm_gpu/src/split_embeddings_cache folder, so the logic could be reused by [SplitTableBatchedEmbeddingBagsCodegen](https://www.internalfb.com/code/fbsource/fbcode/deeplearning/fbgemm/fbgemm_gpu/fbgemm_gpu/split_table_batched_embeddings_ops_training.py?lines=1349) that supports the UVM_CACHING tables.

Differential Revision: D79192671
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D79192671

chouxi added a commit to chouxi/FBGEMM that referenced this pull request Aug 18, 2025
…pytorch#4714)

Summary:
Pull Request resolved: pytorch#4714

X-link: facebookresearch/FBGEMM#1738

We're extending the raw embedding streaming to tables with UVM_CACHING.

Extract the backend out to a standalone class under deeplearning/fbgemm/fbgemm_gpu/src/split_embeddings_cache folder, so the logic could be reused by [SplitTableBatchedEmbeddingBagsCodegen](https://www.internalfb.com/code/fbsource/fbcode/deeplearning/fbgemm/fbgemm_gpu/fbgemm_gpu/split_table_batched_embeddings_ops_training.py?lines=1349) that supports the UVM_CACHING tables.

Differential Revision: D79192671
…pytorch#4714)

Summary:
Pull Request resolved: pytorch#4714

X-link: facebookresearch/FBGEMM#1738

We're extending the raw embedding streaming to tables with UVM_CACHING.

Extract the backend out to a standalone class under deeplearning/fbgemm/fbgemm_gpu/src/split_embeddings_cache folder, so the logic could be reused by [SplitTableBatchedEmbeddingBagsCodegen](https://www.internalfb.com/code/fbsource/fbcode/deeplearning/fbgemm/fbgemm_gpu/fbgemm_gpu/split_table_batched_embeddings_ops_training.py?lines=1349) that supports the UVM_CACHING tables.

Differential Revision: D79192671
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D79192671

chouxi added a commit to chouxi/FBGEMM that referenced this pull request Aug 19, 2025
…pytorch#4714)

Summary:

X-link: facebookresearch/FBGEMM#1738

We're extending the raw embedding streaming to tables with UVM_CACHING.

Extract the backend out to a standalone class under deeplearning/fbgemm/fbgemm_gpu/src/split_embeddings_cache folder, so the logic could be reused by [SplitTableBatchedEmbeddingBagsCodegen](https://www.internalfb.com/code/fbsource/fbcode/deeplearning/fbgemm/fbgemm_gpu/fbgemm_gpu/split_table_batched_embeddings_ops_training.py?lines=1349) that supports the UVM_CACHING tables.

Differential Revision: D79192671
chouxi added a commit to chouxi/FBGEMM that referenced this pull request Aug 19, 2025
…pytorch#4714)

Summary:

X-link: facebookresearch/FBGEMM#1738

We're extending the raw embedding streaming to tables with UVM_CACHING.

Extract the backend out to a standalone class under deeplearning/fbgemm/fbgemm_gpu/src/split_embeddings_cache folder, so the logic could be reused by [SplitTableBatchedEmbeddingBagsCodegen](https://www.internalfb.com/code/fbsource/fbcode/deeplearning/fbgemm/fbgemm_gpu/fbgemm_gpu/split_table_batched_embeddings_ops_training.py?lines=1349) that supports the UVM_CACHING tables.

Differential Revision: D79192671
chouxi added a commit to chouxi/FBGEMM that referenced this pull request Aug 19, 2025
…pytorch#4714)

Summary:

X-link: facebookresearch/FBGEMM#1738

We're extending the raw embedding streaming to tables with UVM_CACHING.

Extract the backend out to a standalone class under deeplearning/fbgemm/fbgemm_gpu/src/split_embeddings_cache folder, so the logic could be reused by [SplitTableBatchedEmbeddingBagsCodegen](https://www.internalfb.com/code/fbsource/fbcode/deeplearning/fbgemm/fbgemm_gpu/fbgemm_gpu/split_table_batched_embeddings_ops_training.py?lines=1349) that supports the UVM_CACHING tables.

Differential Revision: D79192671
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants