Pinned Loading

1. xlite-dev/LeetCUDA xlite-dev/LeetCUDA Public

   📚LeetCUDA: Modern CUDA Learn Notes with PyTorch for Beginners🐑, 200+ CUDA Kernels, Tensor Cores, HGEMM, FA-2 MMA.🎉

   Cuda 6.3k 657

2. xlite-dev/lite.ai.toolkit xlite-dev/lite.ai.toolkit Public

   🛠 A lite C++ AI toolkit: 100+ models with MNN, ORT and TRT, including Det, Seg, Stable-Diffusion, Face-Fusion, etc.🎉

   C++ 4.2k 754

3. xlite-dev/Awesome-LLM-Inference xlite-dev/Awesome-LLM-Inference Public

   📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉

   Python 4.4k 299

4. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 55.7k 9.5k

5. xlite-dev/ffpa-attn xlite-dev/ffpa-attn Public

   🤖FFPA: Extend FlashAttention-2 with Split-D, ~O(1) SRAM complexity for large headdim, 1.8x~3x↑🎉 vs SDPA EA.

   Cuda 208 9

6. vipshop/cache-dit vipshop/cache-dit Public

   🤗An Unified and Training-free Cache Acceleration Toolbox for DiTs: Cache Acceleration with One-line Code ~ ♥️

   Python 172 4