vllm v0.32.0
25d
- Published
- Collected
v0.32.0 Highlights This release features 814 commits from 363 contributors (121 new)! Structured decisions and generic parsers: the new POST /v1/systemone endpoint answers choice, noul and score questions over a structured state (59299), is served by default (60677, 60696), and also runs on Cloudflare/clef-omni (61064), LiquidAI/d1-3B (60676) and DiffusionGemma (60466). The new hf tool and reasoning parser (--tool-call-parser hf, --reasoning-parser…
overfeed.news indexes and links. We publish a short excerpt — the full article stays at GitHub Releases (AI inference).
More from GitHub Releases (AI inference)
Log in to follow this sourceollama v0.40.16
Ripple Preview [Ripple Preview](https://ollama.com/library/ripple-preview) from Ricursive Intelligence is a 65B dense model built for agentic coding. sh ollama run ripple-preview What's Changed - Qwen3.8 Flash Next uses about 27 GiB less memory on Apple silicon - ollama launch claude always routes Claude Code to the selected model - ollama launch explains when a cloud model has been retired - /v1/responses…
transformers Patch release v5.22.2
Patch release v5.22.2 Some in between patch for security and distributed fixes. See the included commits :hugs: - [Distributed] Set device_id only for NCCL (50281) by @michaelbenayoun and @3outeille - Harden our Jinja sandboxing (50431) by @Rocketknight1 Full Changelog: https://github.com/huggingface/transformers/compare/v5.22.1...v5.22.2
ollama v0.40.15
MiMo V2.6 Xiaomi MiMo's [mimo-v2.6](https://ollama.com/library/mimo-v2.6), a 9B model built for code and agent workflows, is now supported in Ollama. sh ollama run mimo-v2.6 AutoTrust decision models [AutoTrust](https://ollama.com/library/autotrust-jev) decision models read text and return choices, yes or no probabilities, and ratings for the questions you supply. The family includes 9b, 35b, and 27b-vl sizes — the 35b and 27b-vl sizes can…
ollama v0.40.14
What's Changed ollama launch claude now applies the model's output token limit for Claude Code, so cloud models no longer run into the 128k default cap Cloud web search responses on /api/chat are now decoded correctly, including compressed responses OpenAI-compatible endpoints no longer override a model's packaged sampler defaults — clients that send no temperature/top_p get the model's own values…