Skip to content

Support output QK symbolic shape inference #25412

@derdeljan-msft

Description

@derdeljan-msft

Update GQA symbolic shape inference (

def _infer_GroupQueryAttention(self, node): # noqa: N802
) to account for newly added output QK optional output.

Metadata

Metadata

Labels

No labels
No labels

Type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions