Minions: where local and cloud LLMs meet
1y
- Published
- Collected
Avanika Narayan, Dan Biderman, and Sabri Eyuboglu from Christopher Ré's Stanford Hazy Research lab, along with Avner May, Scott Linderman, James Zou, have developed a way to shift a substantial portion of LLM workloads to consumer devices by having small on-device models (such as Llama 3.2 with Ollama) collaborate with larger models in the cloud (such as GPT-4o).
overfeed.news indexes and links. We publish a short excerpt — the full article stays at Ollama Blog.
More from Ollama Blog
Log in to follow this source
Speech models in Ollama
Ollama now supports speech models, starting with Phonon from Gradium. Read text aloud in five languages and dozens of voices, streamed as it is generated, over 100 times faster than real time on Apple Silicon.
Clef is available on Ollama's cloud
Clef, a 27B multimodal decision model from Cloudflare, is now available on Ollama. Run it locally or on Ollama's cloud.
Reflection's Beam is freely available on Ollama for a limited time
Reflection's first open-weight model is now available on Ollama, and free for a limited time only. Beam is designed for software engineering, reasoning, and long-running agentic tasks. Access Beam through Ollama's cloud.
Run AI agents safely with Ollama and Fly.io
AI agents can now use Ollama's cloud models safely inside Fly.io's cloud computers.