New text-generation model. Tags: gguf, qwen3.8, uncensored, mtp, reasoning, roleplay, conversational, llama.cpp
Speech Ollama can now generate [speech](https://docs.ollama.com/capabilities/speech) on macOS. ollama run plays text or a chat model's reply aloud as the audio is generated, and apps can stream audio through the OpenAI-compatible /v1/audio/speech endpoint. sh ollama run phonon "Hello from Ollama." d3 decision models [d3](https://ollama.com/library/d3) brings vLLM Semantic Router's decision models to Ollama. Give a model text, structured state, or an…
Ollama now supports speech models, starting with Phonon from Gradium. Read text aloud in five languages and dozens of voices, streamed as it is generated, over 100 times faster than real time on Apple Silicon.
OpenAI will cut frontier models off from the internet weeks after one of its engineers said that solution wouldn't work.
Curious how local LLM deployment stacks up? This post explores benchmarking strategies, optimization tips, and what DevOps teams need to know about.
Explore Disco Diffusion on Runpod, an experimental art model beloved for its dreamlike style. Perfect for creative pros looking to generate high-concept.
Compare Google Colab Pro and Runpod across pricing, reliability, and GPU access. Which is the better deal for developers running real AI workloads?
Explore how to deploy and benchmark LLMs locally using tools like Ollama and NVIDIA NIMs. This deep dive covers performance, cost, and scaling insights.
New to serverless? This guide shows you how to deploy a basic "Hello World" API on Runpod Serverless using Docker, perfect for beginners testing their.
This follow-up to our “Hello World” tutorial walks through streaming output from a Runpod Serverless endpoint using WebSocket and base64 files.
Runpod's Clusters let you spin up multi-node GPU environments instantly, ideal for scaling LLM training or distributed inference workloads without config.
dstack is an open-source, GPU-native orchestrator that automates provisioning, scaling, and policies for ML teams, helping cut 3-7× GPU waste while.
Runpod’s new REST API lets you manage GPU workloads programmatically, launch, scale, and monitor pods without ever touching the dashboard.
Runpod's serverless platform keeps evolving, especially for LLM workloads. Learn what's new in 2025 and how to get the most from scalable deployments.
GLM-5.3 is now on Runpod's public endpoints at a lower price than elsewhere. Try it in the Playground, call it with curl, or use the OpenAI SDK in Python.
The robots, stomping their little feet and making tiny R2D2 noises, sat, fell down dead for a "nap," and summersaulted on voice command.
