overfeed.news

Improved performance and model support with GGUF

Ollama Blog

4mo

Age

Published
Collected
Image: Ollama Blog

Ollama 0.30 is now available with improved performance and GGUF model compatibility through llama.cpp. This augments Ollama's MLX engine on Apple silicon, bringing support to more models on a wider range of hardware.

Read the full article at ollama.com

overfeed.news indexes and links. We publish a short excerpt — the full article stays at Ollama Blog.

Log in to follow this source
Ollama Blog

Speech models in Ollama

Ollama now supports speech models, starting with Phonon from Gradium. Read text aloud in five languages and dozens of voices, streamed as it is generated, over 100 times faster than real time on Apple Silicon.

Improved performance and model support with GGUF — overfeed.news