Skip to content

[rls-v3.11] fused sdpa training#4823

Open
syurkevi wants to merge 19 commits intorls-v3.11from
syurkevi/fused_sdpa_training_backport311
Open

[rls-v3.11] fused sdpa training#4823
syurkevi wants to merge 19 commits intorls-v3.11from
syurkevi/fused_sdpa_training_backport311

Conversation

@syurkevi
Copy link
Contributor

@syurkevi syurkevi commented Mar 12, 2026

Description

Backport of #4498.

syurkevi added 16 commits March 12, 2026 14:06
@syurkevi
common: sdpa: adds backwards sdpa primitives
7c94afc
@syurkevi
common: sdpa: prepares internal primitive for bwd testing
7624f46
@syurkevi
gtests: internals: adds sdpa training tests
dfc8ad1
@syurkevi
xe: sdpa: prepares config structs for bwd pass
acea9d0
@syurkevi
gpu: gemm: jit: allow LLR gemms
0cac8dc
@syurkevi
gpu: gemm: jit: enables ukernel with multiple kernel sources
094971f
@syurkevi
xe: sdpa: splits fwd/bwd gpu training primitives
0905774
@syurkevi
xe: sdpa: split gemm setup for backwards pass
1ee8ade
@syurkevi
xe: sdpa: calculates forward logusmexp to ws
e8a0c47
@syurkevi
xe: sdpa: updates tile_ops packed load/stores
c2cf346
@syurkevi
xe: sdpa: adds bwd kernel implementation
cb9dfe8
@syurkevi
xe: sdpa: adds create_sdpa_pd for backwards pass
fa5e7e8
@syurkevi
xe: sdpa: rename fwd/bwd primitives
112702e
@syurkevi
gtests: internals: separate sdpa from internals
4d972d3
@syurkevi
common: sdpa: move prop_kind param before attrs
fa8d5f6
@syurkevi
xe: sdpa: enable transpose_k for training
f0eadc9
@syurkevi syurkevi requested review from a team as code owners March 12, 2026 23:36
@github-actions github-actions bot added platform:gpu-intel Codeowner: @oneapi-src/onednn-gpu-intel backport component:graph-api Codeowner: @oneapi-src/onednn-graph component:tests Codeowner: @oneapi-src/onednn-arch component:common labels Mar 12, 2026
@syurkevi syurkevi force-pushed the syurkevi/fused_sdpa_training_backport311 branch from 985a7ad to 64b7220 Compare March 12, 2026 23:45
ElaineBao
ElaineBao approved these changes Mar 13, 2026
View reviewed changes
Copy link
Contributor

@ElaineBao ElaineBao left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM for graph related changes

@syurkevi syurkevi force-pushed the syurkevi/fused_sdpa_training_backport311 branch from 64b7220 to f0bb759 Compare March 13, 2026 05:19
@syurkevi syurkevi force-pushed the syurkevi/fused_sdpa_training_backport311 branch from f0bb759 to 9e9721e Compare March 13, 2026 05:32
@syurkevi
Copy link
Contributor Author

syurkevi commented Mar 13, 2026

make test
disable benchdnn_all
set test_scope=NIGHTLY
enable benchdnn_graph
disable test_device_cpu
enable test_device_gpu
enable arch_gpu_xe-hpc
enable arch_gpu_xe-lpg+
enable arch_gpu_xe2-hpg-bmg
enable arch_gpu_xe2-lpg

1 similar comment
@syurkevi
Copy link
Contributor Author

syurkevi commented Mar 18, 2026

make test
disable benchdnn_all
set test_scope=NIGHTLY
enable benchdnn_graph
disable test_device_cpu
enable test_device_gpu
enable arch_gpu_xe-hpc
enable arch_gpu_xe-lpg+
enable arch_gpu_xe2-hpg-bmg
enable arch_gpu_xe2-lpg

@syurkevi syurkevi force-pushed the syurkevi/fused_sdpa_training_backport311 branch from c093f3e to 69d9cbc Compare March 18, 2026 17:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@umar456 umar456 umar456 approved these changes

@ElaineBao ElaineBao ElaineBao approved these changes

@dzarukin dzarukin dzarukin approved these changes

Assignees

No one assigned

Labels

backport component:common component:graph-api Codeowner: @oneapi-src/onednn-graph component:tests Codeowner: @oneapi-src/onednn-arch platform:gpu-intel Codeowner: @oneapi-src/onednn-gpu-intel

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@syurkevi @umar456 @ElaineBao @dzarukin