Skip to content

Pinned Loading

  1. vllm vllm Public

    A high-throughput and memory-efficient inference and serving engine for LLMs

    Python 60.6k 10.7k

  2. llm-compressor llm-compressor Public

    Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

    Python 2.1k 264

  3. recipes recipes Public

    Common recipes to run vLLM

    Jupyter Notebook 169 60

Repositories

Showing 10 of 26 repositories
  • vllm-gaudi Public

    Community maintained hardware plugin for vLLM on Intel Gaudi

    vllm-project/vllm-gaudi’s past year of commit activity
    Python 12 Apache-2.0 54 1 63 Updated Oct 21, 2025
  • vllm Public

    A high-throughput and memory-efficient inference and serving engine for LLMs

    vllm-project/vllm’s past year of commit activity
    Python 60,611 Apache-2.0 10,687 1,851 (31 issues need help) 1,182 Updated Oct 21, 2025
  • semantic-router Public

    Intelligent Router for Mixture-of-Models

    vllm-project/semantic-router’s past year of commit activity
    Python 1,927 Apache-2.0 241 82 (15 issues need help) 24 Updated Oct 21, 2025
  • guidellm Public

    Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs

    vllm-project/guidellm’s past year of commit activity
    Python 655 Apache-2.0 90 82 (5 issues need help) 22 Updated Oct 21, 2025
  • vllm-ascend Public

    Community maintained hardware plugin for vLLM on Ascend

    vllm-project/vllm-ascend’s past year of commit activity
    Python 1,235 Apache-2.0 503 590 (9 issues need help) 185 Updated Oct 21, 2025
  • tpu-inference Public

    TPU inference for vLLM, with unified JAX and PyTorch support.

    vllm-project/tpu-inference’s past year of commit activity
    Python 111 Apache-2.0 14 4 (1 issue needs help) 34 Updated Oct 21, 2025
  • vllm-xpu-kernels Public

    The vLLM XPU kernels for Intel GPU

    vllm-project/vllm-xpu-kernels’s past year of commit activity
    C++ 9 Apache-2.0 14 0 5 Updated Oct 21, 2025
  • aibrix Public

    Cost-efficient and pluggable Infrastructure components for GenAI inference

    vllm-project/aibrix’s past year of commit activity
    Go 4,309 Apache-2.0 471 231 (20 issues need help) 22 Updated Oct 21, 2025
  • vllm-spyre Public

    Community maintained hardware plugin for vLLM on Spyre

    vllm-project/vllm-spyre’s past year of commit activity
    Python 35 Apache-2.0 26 5 15 Updated Oct 21, 2025
  • ci-infra Public

    This repo hosts code for vLLM CI & Performance Benchmark infrastructure.

    vllm-project/ci-infra’s past year of commit activity
    HCL 23 42 1 22 Updated Oct 21, 2025