vllm v0.30.0
1mo
- Published
- Collected
v0.30.0 Highlights This release features 762 commits from 315 contributors (104 new)! New models: DeepSeek-V4.1-Flash (56214, 56228, 56208) with the whole KV stored in MXFP8 through the FlashMLA V4.1 record on SM100 (56893), DeepGEMM Mega-mHC (56962), and async Engram prefetch with Engram DP sharding (56512); DeepSeek-V4-Flash-Vision-Exp (54566), also on ROCm (55107) and with LoRA (55897); GLM-5.3-Flash (53906) with EPLB (55119)…
overfeed.news indexes and links. We publish a short excerpt — the full article stays at GitHub Releases (AI inference).
More from GitHub Releases (AI inference)
Log in to follow this sourcetransformers Patch release v5.22.1
Patch release v5.22.1 We just had to fix the documentation! [Fix] Remove WIP doc for Ml4 (https://github.com/huggingface/transformers/pull/50124) from @remi-or
transformers v5.22.0: Mistral Large 4 (Le Chonk)
New Models Mistral Large 4 (Le Chonk) Mistral Large 4 is Mistral's largest and most capable model to date: a 1 trillion-parameter natively multimodal Mixture-of-Experts model with 49 billion active parameters per token (52 billion including embeddings and output layers), trained from scratch on 3,800 NVIDIA Grace Blackwell GPUs in Mistral's own datacenters in Europe. Mistral Large 4 unifies instruction…
transformers Patch release v5.21.1
Patch release v5.21.1 Fix rope_scaling setter for configs that assign it during init (50080 ) We broke remote code loading in vllm, this fixes it sorry everyone!
ollama v0.40.13
LFM3 on Linux and Windows Liquid AI's [LFM3](https://ollama.com/library/lfm3) models, including text-to-speech in [lfm3-audio](https://ollama.com/library/lfm3-audio) and [lfm3-omni](https://ollama.com/library/lfm3-omni), now run on Linux and Windows as well as Apple silicon. Full Changelog: https://github.com/ollama/ollama/compare/v0.40.12...v0.40.13