transformers Patch release v5.22.1
Patch release v5.22.1 We just had to fix the documentation! [Fix] Remove WIP doc for Ml4 (https://github.com/huggingface/transformers/pull/50124) from @remi-or
GitHub Releases (AI inference)
16
transformers v5.22.0: Mistral Large 4 (Le Chonk)
New Models Mistral Large 4 (Le Chonk) Mistral Large 4 is Mistral's largest and most capable model to date: a 1 trillion-parameter natively multimodal Mixture-of-Experts model with 49 billion active parameters per token (52 billion including embeddings and output layers), trained from scratch on 3,800 NVIDIA Grace Blackwell GPUs in Mistral's own datacenters in Europe. Mistral Large 4 unifies instruction…
transformers Patch release v5.21.1
Patch release v5.21.1 Fix rope_scaling setter for configs that assign it during init (50080 ) We broke remote code loading in vllm, this fixes it sorry everyone!
ollama v0.40.13
LFM3 on Linux and Windows Liquid AI's [LFM3](https://ollama.com/library/lfm3) models, including text-to-speech in [lfm3-audio](https://ollama.com/library/lfm3-audio) and [lfm3-omni](https://ollama.com/library/lfm3-omni), now run on Linux and Windows as well as Apple silicon. Full Changelog: https://github.com/ollama/ollama/compare/v0.40.12...v0.40.13
ollama v0.40.12
Liquid AI LFM3 [LFM3](https://ollama.com/library/lfm3) is Liquid AI's new family of small models built for local agents, tool calling, and structured output, on Liquid's new tri-hybrid architecture. The family includes: - [lfm3](https://ollama.com/library/lfm3): a 1.7B text model with a 256K-token context window - [lfm3-vl](https://ollama.com/library/lfm3-vl): adds image understanding - [lfm3-audio](https://ollama.com/library/lfm3-audio): speech recognition, translation, and text-to-speech in 18 languages - [lfm3-omni](https://ollama.com/library/lfm3-omni): text, images, and…
transformers Release: v5.21.0
Release v5.21.0 New Model additions MiniCPM-OCR MiniCPM-OCR is a document-understanding model from OpenBMB's MiniCPM-V family. It keeps the MiniCPM-V 4.6 architecture, which pairs a SigLIP vision encoder and a window-attention merger with a Qwen3.5 language model. It is specialized for reading text-dense images such as scanned pages, screenshots, receipts and tables. Links: [Documentation](https://huggingface.co/docs/transformers/main/en/model_doc/minicpm_ocr) | [Paper](https://huggingface.co/papers/2509.18154) Feat test (49920) by @guarin…
ollama v0.40.11
Speech Ollama can now generate [speech](https://docs.ollama.com/capabilities/speech) on macOS. ollama run plays text or a chat model's reply aloud as the audio is generated, and apps can stream audio through the OpenAI-compatible /v1/audio/speech endpoint. sh ollama run phonon "Hello from Ollama." d3 decision models [d3](https://ollama.com/library/d3) brings vLLM Semantic Router's decision models to Ollama. Give a model text, structured state, or an…
ollama v0.40.10
NVIDIA Nemotron 3.5 Bolt E4B [Nemotron 3.5 Bolt E4B](https://ollama.com/library/nemotron-3.5-bolt) is NVIDIA’s smaller, Gemma 4-based vision-language model for fast local conversations, image understanding, and tool use. It supports a 128K-token context window. The model includes a DFlash draft for speculative decoding. ollama run nemotron-3.5-bolt:e4b Full Changelog: https://github.com/ollama/ollama/compare/v0.40.9...v0.40.10
ollama v0.40.9
Flint on Linux and Windows [Flint](https://ollama.com/library/flint) now runs on Linux and Windows as well as macOS. Other improvements - Streaming OpenAI Responses and Anthropic Messages requests now report generation failures instead of ending silently after partial output. - ollama launch now passes cloud models' context lengths and capabilities to coding tools, fixing incorrect context and compaction settings. - Anthropic-compatible web…
transformers Patch release v5.20.2
Patch release: v5.20.2 This patch notably solves an issue where some inputs could loose their original type inside prepare_inputs_for_generation in generate, leading to problems with multimodal models. It also fixes some other issues listed on the below commits. It contains the following commits: - Fix inputs dict casting in generate (49731) by @Cyrilvallez - Fix zero expert gradients in bfloat16…
vllm v0.32.0
v0.32.0 Highlights This release features 814 commits from 363 contributors (121 new)! Structured decisions and generic parsers: the new POST /v1/systemone endpoint answers choice, noul and score questions over a structured state (59299), is served by default (60677, 60696), and also runs on Cloudflare/clef-omni (61064), LiquidAI/d1-3B (60676) and DiffusionGemma (60466). The new hf tool and reasoning parser (--tool-call-parser hf, --reasoning-parser…
transformers Release v5.20.1
Release v5.20.1 Special surprise including the new model Beam from Reflection AI :partying_face: Beam is a token-efficient, frontier-scale model focused on coding and agentic use cases. It is built for teams that want to run a powerful model on their own hardware, infrastructure, or cloud, and customize it to their specific needs. Links: [Documentation](https://huggingface.co/docs/transformers/main/en/model_doc/beam) Fix small bu
vllm v0.31.0
v0.31.0 Highlights This release features 717 commits from 307 contributors (96 new)! DeepSeek-V4.1-Flash performance: FlashMLA mega attention with the V4.1 NVFP4 compressed KV cache is now the SM100 default (56935); DeepGEMM sparse MQA logits for the indexer (56254) and Mega-Gate fusing the gate GEMM with expert selection (56266); decoder boundaries fuse the TP all-reduce, mHC input preparation (57643) and the…
vllm v0.30.0
v0.30.0 Highlights This release features 762 commits from 315 contributors (104 new)! New models: DeepSeek-V4.1-Flash (56214, 56228, 56208) with the whole KV stored in MXFP8 through the FlashMLA V4.1 record on SM100 (56893), DeepGEMM Mega-mHC (56962), and async Engram prefetch with Engram DP sharding (56512); DeepSeek-V4-Flash-Vision-Exp (54566), also on ROCm (55107) and with LoRA (55897); GLM-5.3-Flash (53906) with EPLB (55119)…
vllm v0.29.0
v0.29.0 Highlights This release features 594 commits from 277 contributors (91 new)! Model Runner V2 is now the default for all models (53183), completing the rollout that began with pooling models (48290). MRV2 also gained CUDA graph memory profiling for KV cache auto-sizing (53306), batch-sharded sampling that cuts per-step logits memory by 1/TP (50465), prompt embeds (42963), extract_hidden_states speculation (49811)…
vllm v0.28.0
v0.28.0 Highlights This release features 584 commits from 270 contributors (76 new)! Kimi-K3 performance push: a major optimization effort for Kimi-K3 across the stack — Decode Context Parallel (DCP) support (50484), fused FlashKDA decode and prefill kernels (50654, 51311, 52458), SiTU activation support for MegaMoE (50510), GEMM-RS for sequence parallelism (52079), combined all-gathers with 1.5~3x kernel-level speedup (51070), an adaptive…