Skip to content

Pull requests: flashinfer-ai/flashinfer

New pull request New
35 Open 922 Closed
35 Open 922 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

ensure graph is captured and executed on the same stream to avoid rep…
#1303 opened Jul 22, 2025 by elfiegg Loading…
8
minor: some fix and cleanup for trtllm-gen mha
#1302 opened Jul 22, 2025 by yyihuang Loading…
5 tasks done
4
3rparty: upgrade cutlass dependency to v4.1.0
#1299 opened Jul 22, 2025 by yzh119 Loading…
5 tasks
2
Add weight layout
#1297 opened Jul 21, 2025 by aleozlx • Draft
4 of 5 tasks
5
add mm_fp4 use cutlass backend for large bs
#1296 opened Jul 21, 2025 by ttyio Loading…
5 tasks done
9
Update cutlass fp4 moe kernels
#1294 opened Jul 21, 2025 by wenscarl Loading…
5 tasks
12
[fix] fix integer overflow in FA2 customized_mask & add buffer overflow warning.
#1290 opened Jul 19, 2025 by happierpig Loading…
5 tasks done
10
Add native cudnn_decode for improved cudnn decode performance
#1283 opened Jul 18, 2025 by Anerudhan Loading…
5 tasks done
12
ci: add github actions to upload sdist to pypi
#1270 opened Jul 16, 2025 by yzh119 Loading…
5 tasks
1
Bug fix: fix duplicate launch in POD
#1267 opened Jul 16, 2025 by Edenzzzz Loading…
5 tasks
2
use NVSHMEM4Py instead of custom bindings for NVSHMEM MNNVL Allreduce
#1263 opened Jul 15, 2025 by Amir-19 Loading…
5 tasks
12
feat(aot): add nvshmem module for aot compilation
#1261 opened Jul 15, 2025 by EmilienM Loading…
3 of 5 tasks
1
13
refactor: separate SM100 and legacy TRT-LLM comm modules
#1259 opened Jul 15, 2025 by EmilienM Loading…
3 of 5 tasks
1
13
feat: update cubins for dynamic scale factor interface and one-copy kvcache on trtllm-gen mla
#1248 opened Jul 14, 2025 by yyihuang • Draft
5 tasks done
4
bugfix: fix fp32 acc threshold for qk using math::inf according to dtype by AIDC-AI
#1247 opened Jul 14, 2025 by yongchaoding Loading…
5 tasks done
5
Add the keyword "template" to member template specialization appears after . or -> in a post-fix expression which is a requirement in C++ standard
#1246 opened Jul 14, 2025 by tomflinda Loading…
9
Mnnvl memory with custom communicator
#1245 opened Jul 14, 2025 by wenscarl • Draft
5 tasks
2
feat: expose python APIs for cutlass blackwell fmha fp8 kernels
#1238 opened Jul 10, 2025 by yzh119 • Draft
5 tasks
7
feat: Restore convenience FLASHINFER_ENABLE_AOT option
#1235 opened Jul 8, 2025 by mgorny Loading…
3 of 5 tasks
7
[Feature] Support batch prefill for POD Attention
#1231 opened Jul 8, 2025 by Edenzzzz Loading…
7 tasks
1
19
Add ruff to pre-commit
#1201 opened Jul 1, 2025 by cyx-6 • Draft
5 tasks
4
jit: supporting transform output in attention jit template
#1184 opened Jun 27, 2025 by yzh119 • Draft
5 tasks
4
Add mypy to pre-commit
#1179 opened Jun 26, 2025 by cyx-6 • Draft
5 tasks
5
Use flashinfer softmax in top_k_top_p_sampling_from_logits
#1171 opened Jun 24, 2025 by lgeiger Loading…
5 tasks done
11
[wip] Multimem allreduce cutlass dsl
#1169 opened Jun 23, 2025 by Amir-19 • Draft
5 tasks
11
ProTip! Follow long discussions with comments:>50.