Skip to content

Use flashinfer softmax in top_k_top_p_sampling_from_logits#1171

Open
lgeiger wants to merge 2 commits intoflashinfer-ai:mainfrom
lgeiger:fast-softmax
Open

Use flashinfer `softmax` in `top_k_top_p_sampling_from_logits`#1171
lgeiger wants to merge 2 commits intoflashinfer-ai:mainfrom
lgeiger:fast-softmax

Commits

Commits on Jun 26, 2025