Repositories list

• compressed-tensors

  Public

  vllm-project/compressed-tensors’s past year of commit activity
  A safetensors extension to efficiently store sparse quantized tensors on disk

  Python

  •

  Apache License 2.0

  •108108 forks•308308 stars•77 issues•4242 pull requests•Updated Jul 29, 2026Jul 29, 2026

• vllm-omni

  Public

  vllm-project/vllm-omni’s past year of commit activity
  A framework for efficient model inference with omni-modality models

  inferencepytorchtransformer+ 7

  inferencepytorchtransformerimage-generationdiffusionmodel-servingmultimodalvideo-generationaudio-generationworld-model

  Python

  •

  Apache License 2.0

  •1.4k1.4k forks•5.7k5.7k stars•630630 issues•681681 pull requests•Updated Jul 29, 2026Jul 29, 2026

• tpu-inference

  Public

  vllm-project/tpu-inference’s past year of commit activity
  TPU inference for vLLM, with unified JAX and PyTorch support.

  Python

  •

  Apache License 2.0

  •271271 forks•395395 stars•7373 issues•320320 pull requests•Updated Jul 29, 2026Jul 29, 2026

• vllm

  Public

  vllm-project/vllm’s past year of commit activity
  A high-throughput and memory-efficient inference and serving engine for LLMs

  amdcudainference+ 17

  amdcudainferencepytorchtransformeropenaimoellamagptmodel-serving+ 10

  Python

  •

  Apache License 2.0

  •20k20k forks•88k88k stars•2k2k issues•4.1k4.1k pull requests•Updated Jul 29, 2026Jul 29, 2026

• perf-eval

  Public

  vllm-project/perf-eval’s past year of commit activity
  Performance benchmark & accuracy evaluation for vLLM

  Python

  •1515 forks•1111 stars•00 issues•2323 pull requests•Updated Jul 29, 2026Jul 29, 2026

• vllm-ascend

  Public

  vllm-project/vllm-ascend’s past year of commit activity
  Community maintained hardware plugin for vLLM on Ascend

  inferencetransformermodel-serving+ 6

  inferencetransformermodel-servingmlopsascendllmllmopsllm-servingvllm

  C++

  •

  Apache License 2.0

  •1.9k1.9k forks•2.5k2.5k stars•1.5k1.5k issues•1k1k pull requests•Updated Jul 29, 2026Jul 29, 2026

• speculators

  Public

  vllm-project/speculators’s past year of commit activity
  A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM

  Python

  •

  Apache License 2.0

  •172172 forks•669669 stars•4040 issues•6666 pull requests•Updated Jul 29, 2026Jul 29, 2026

• vllm-project.github.io

  Public

  vllm-project/vllm-project.github.io’s past year of commit activity
  HTML

  •123123 forks•5858 stars•44 issues•1313 pull requests•Updated Jul 29, 2026Jul 29, 2026

• afd-plugin

  Public

  vllm-project/afd-plugin’s past year of commit activity
  vLLM plugin for attention-ffn disaggregation support

  Python

  •

  Apache License 2.0

  •1616 forks•5555 stars•1616 issues•66 pull requests•Updated Jul 29, 2026Jul 29, 2026

• guidellm

  Public

  vllm-project/guidellm’s past year of commit activity
  Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs

  Python

  •

  Apache License 2.0

  •201201 forks•1.4k1.4k stars•5050 issues•2020 pull requests•Updated Jul 29, 2026Jul 29, 2026

• llm-compressor

  Public

  vllm-project/llm-compressor’s past year of commit activity
  Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

  compressionquantization

  compressionquantization

  Python

  •

  Apache License 2.0

  •592592 forks•3.6k3.6k stars•4545 issues•7878 pull requests•Updated Jul 29, 2026Jul 29, 2026

• vllm-gaudi

  Public

  vllm-project/vllm-gaudi’s past year of commit activity
  Community maintained hardware plugin for vLLM on Intel Gaudi

  Python

  •

  Apache License 2.0

  •146146 forks•4949 stars•44 issues•6262 pull requests•Updated Jul 29, 2026Jul 29, 2026

• agentic-api

  Public

  vllm-project/agentic-api’s past year of commit activity
  Stateful API logic for agentic applications using vLLM

  Rust

  •

  Apache License 2.0

  •2323 forks•5757 stars•2525 issues•99 pull requests•Updated Jul 29, 2026Jul 29, 2026

• recipes

  Public

  vllm-project/recipes’s past year of commit activity
  Common recipes to run vLLM

  JavaScript

  •

  Apache License 2.0

  •349349 forks•939939 stars•3535 issues•109109 pull requests•Updated Jul 29, 2026Jul 29, 2026

• semantic-router

  Public

  vllm-project/semantic-router’s past year of commit activity
  Intelligent Mixture-of-Models Router for Efficient Heterogeneous LLMs Inference

  kubernetesrustgolang+ 15

  kubernetesrustgolangmcpfine-tuningpii-detectionmixture-of-modelshuggingface-transformersbert-classificationllm+ 8

  Go

  •

  Apache License 2.0

  •785785 forks•5.1k5.1k stars•191191 issues•8383 pull requests•Updated Jul 29, 2026Jul 29, 2026

• vllm-bnb-plugin

  Public

  vllm-project/vllm-bnb-plugin’s past year of commit activity
  vLLM Quantization plugin for bitsandbytes

  Python

  •

  Apache License 2.0

  •11 fork•22 stars•00 issues•11 pull request•Updated Jul 29, 2026Jul 29, 2026

• DeepGEMM

  Public

  vllm-project/DeepGEMM’s past year of commit activity
  DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling

  Cuda

  •

  MIT License

  •1.1k1.1k forks•00 stars•00 issues•00 pull requests•Updated Jul 29, 2026Jul 29, 2026

• vllm-xpu-kernels

  Public

  vllm-project/vllm-xpu-kernels’s past year of commit activity
  The vLLM XPU kernels for Intel GPU

  C++

  •

  Apache License 2.0

  •9292 forks•5656 stars•1212 issues•4949 pull requests•Updated Jul 29, 2026Jul 29, 2026

• vllm-dashboard

  Public

  vllm-project/vllm-dashboard’s past year of commit activity
  TypeScript

  •99 forks•1010 stars•11 issue•22 pull requests•Updated Jul 29, 2026Jul 29, 2026

• ci-infra

  Public

  vllm-project/ci-infra’s past year of commit activity
  This repo hosts code for vLLM CI & Performance Benchmark infrastructure.

  Python

  •

  Apache License 2.0

  •7474 forks•4545 stars•00 issues•5555 pull requests•Updated Jul 29, 2026Jul 29, 2026

• vllm-daily

  Public

  vllm-project/vllm-daily’s past year of commit activity
  vLLM Daily Summarization of Merged PRs

  55 forks•5151 stars•00 issues•00 pull requests•Updated Jul 29, 2026Jul 29, 2026

• aibrix

  Public

  vllm-project/aibrix’s past year of commit activity
  Cost-efficient and pluggable Infrastructure components for GenAI inference

  Go

  •

  Apache License 2.0

  •632632 forks•5k5k stars•312312 issues•3838 pull requests•Updated Jul 29, 2026Jul 29, 2026

• production-stack

  Public

  vllm-project/production-stack’s past year of commit activity
  vLLM’s reference system for K8S-native cluster-wide deployment with community-driven performance optimization

  Python

  •

  Apache License 2.0

  •454454 forks•2.5k2.5k stars•9898 issues•8282 pull requests•Updated Jul 28, 2026Jul 28, 2026

• vllm-metal

  Public

  vllm-project/vllm-metal’s past year of commit activity
  Community maintained hardware plugin for vLLM on Apple Silicon

  Python

  •

  Apache License 2.0

  •199199 forks•1.5k1.5k stars•88 issues•66 pull requests•Updated Jul 28, 2026Jul 28, 2026

• vllm-bench

  Public

  vllm-project/vllm-bench’s past year of commit activity
  High-performance Rust benchmark client for vLLM serving endpoints.

  Rust

  •

  Apache License 2.0

  •1111 forks•4949 stars•11 issue•33 pull requests•Updated Jul 28, 2026Jul 28, 2026

• vime

  Public

  vllm-project/vime’s past year of commit activity
  An LLM post-training framework with vLLM for RL Scaling

  Python

  •

  Apache License 2.0

  •6969 forks•393393 stars•3232 issues•1313 pull requests•Updated Jul 28, 2026Jul 28, 2026

• FlashKDA

  Public

  vllm-project/FlashKDA’s past year of commit activity
  Cuda

  •

  MIT License

  •00 forks•88 stars•00 issues•00 pull requests•Updated Jul 28, 2026Jul 28, 2026

• MSA

  Public

  vllm-project/MSA’s past year of commit activity
  Python

  •

  MIT License

  •4646 forks•00 stars•00 issues•11 pull request•Updated Jul 24, 2026Jul 24, 2026

• router

  Public

  vllm-project/router’s past year of commit activity
  A high-performance and light-weight router for vLLM large scale deployment

  Rust

  •

  Apache License 2.0

  •113113 forks•333333 stars•1919 issues•2727 pull requests•Updated Jul 24, 2026Jul 24, 2026

• flash-attention

  Public

  vllm-project/flash-attention’s past year of commit activity
  Fast and memory-efficient exact attention

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •2.9k2.9k forks•133133 stars•00 issues•4343 pull requests•Updated Jul 22, 2026Jul 22, 2026