Skip to content

Pull requests: vllm-project/vllm

New pull request New
3,259 Open 24,971 Closed
3,259 Open 24,971 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[CPU][Zen] Route Int8 MoE inference through zentorch on AMD cpu Related to CPU backends gpt-oss Related to GPT-OSS models rocm Related to AMD ROCm v1
#44834 opened Jun 8, 2026 by ganeshr10 Contributor • Draft
4 tasks
Fix: Populate prompt_tokens_details.cached_tokens in Rust frontend Usage rust
#44833 opened Jun 8, 2026 by charukeas-t Loading…
1
1
Bump the minor-update group across 1 directory with 148 updates ci/build dependencies Pull requests that update a dependency file nvidia rocm Related to AMD ROCm
#44832 opened Jun 8, 2026 by dependabot Bot Loading…
P2P NCCL connector: add hybrid SSM/Mamba model support kv-connector
#44831 opened Jun 8, 2026 by KonnyakuMatcha Loading…
3 of 4 tasks
5
[Kernel][Perf] Tune fused_moe FP8 config for Qwen3-Next-80B tp=4 on H100 (+25% at batch 96-512) qwen Related to Qwen models
#44830 opened Jun 8, 2026 by qyYue1389 Contributor Loading…
Bump actions/checkout from 6.0.1 to 6.0.3 ci/build dependencies Pull requests that update a dependency file github_actions Pull requests that update GitHub Actions code
#44829 opened Jun 8, 2026 by dependabot Bot Loading…
[BugFix] Use served model name in gemma4 audio-tower error message bug Something isn't working multi-modality Related to multi-modality (#4194) ready ONLY add when PR is ready to merge/full CI is needed
#44828 opened Jun 8, 2026 by llsj14 Contributor Loading…
4 tasks
5
[Platform] Replace torch.cuda.mem_get_info with torch.accelerator.mem_get_info intel-gpu Related to Intel GPU kv-connector nvidia v1
#44825 opened Jun 8, 2026 by jikunshang Member • Draft
4 tasks
[ROCm][CI] Defer AITER sampler import and isolate server test PYTHONPATH rocm Related to AMD ROCm v1
#44823 opened Jun 8, 2026 by AndreasKaratzas Member Loading…
Feature/cache accounting OpenAI anthropic api frontend
#44822 opened Jun 8, 2026 by ajayr4j Loading…
1
5
fix: prefix DeepSeek V4 MTP projections deepseek Related to DeepSeek models
#44821 opened Jun 8, 2026 by he-yufeng Contributor Loading…
1
3
[Bugfix][CI] Retry cached HF tokenizer load after transport failures bug Something isn't working
#44820 opened Jun 8, 2026 by AndreasKaratzas Member Loading…
[CI] Consolidate multimodal entrypoint tests. ci/build
#44819 opened Jun 8, 2026 by noooop Collaborator Loading…
4 tasks
3
[Perf] Add H200 BF16 fused MoE configs for Gemma4 (E=128,N=704)
#44818 opened Jun 8, 2026 by LucasWilkinson Collaborator Loading…
[Model Runner V2][Spec Decode]Support peagle spec decode needs-rebase v1
#44816 opened Jun 8, 2026 by wxsIcey Contributor Loading…
4 tasks
2
[Bugfix] Fix layerwise reload dropping params after a composed weight loader bug Something isn't working
#44814 opened Jun 7, 2026 by hallerite Contributor Loading…
[Bugfix] Replace sequential port scan with atomic port=0 in get_open_ports_list bug Something isn't working
#44813 opened Jun 7, 2026 by rguiu Loading…
3 of 4 tasks
1
fix: stop thinking budget at implicit tool calls qwen Related to Qwen models v1
#44812 opened Jun 7, 2026 by he-yufeng Contributor Loading…
1
fix: strip Gemma4 delimiters from dict keys tool-calling
#44811 opened Jun 7, 2026 by he-yufeng Contributor Loading…
1
feat: add optional torchembed RoPE backend ci/build
#44810 opened Jun 7, 2026 by py-ai-dev Loading…
5
[ROCm][CI] Re-route NixlConnector jobs ci/build kv-connector ready ONLY add when PR is ready to merge/full CI is needed rocm Related to AMD ROCm v1
#44809 opened Jun 7, 2026 by AndreasKaratzas Member Loading…
[Model] TEMP Fix for DFlash SWA PR (#40898) qwen Related to Qwen models speculative-decoding v1
#44807 opened Jun 7, 2026 by JDWarner • Draft
1
[ROCm][gpt-oss] Hybrid CDNA4 swizzle gate for A8W4 MoE gpt-oss Related to GPT-OSS models rocm Related to AMD ROCm
#44804 opened Jun 7, 2026 by xiaohuguo2023 Loading…
1
[Core][Spec Decode] SSD: async verify/draft overlap via OutcomePredictor (closes #36037) speculative-decoding v1
#44802 opened Jun 7, 2026 by buddywhitman Loading…
3 of 4 tasks
1
5
[Rust Frontend]: Add /get_world_size route with static parallel size rust v1
#44801 opened Jun 7, 2026 by coder3101 Loading…
4 tasks
1
ProTip! Find all pull requests that aren't related to any open issues with -linked:issue.