What’s New for Serverless LLM Usage in Runpod (2025 Update)
Runpod's serverless platform keeps evolving, especially for LLM workloads. Learn what's new in 2025 and how to get the most from scalable deployments.
en
RunPod Blog
127
Getting started with GLM-5.3 on Runpod's public endpoint
GLM-5.3 is now on Runpod's public endpoints at a lower price than elsewhere. Try it in the Playground, call it with curl, or use the OpenAI SDK in Python.
en
GPU Cloud vs On-Prem Clusters: A Cost Breakdown
We crunched the numbers: deploying 4x A100s on Runpod's GPU cloud can save over $124,000 versus an on-prem cluster across 3 years. Learn why cloud beats.
en
How to Manage Funding Your Runpod Account
This guide breaks down everything you need to know about billing on Runpod, how credits are applied, what gets charged, and how to set up automatic or.
en
Runpod Global Networking Expands to 14 More Data Centers
Runpod’s global networking feature is now available in 14 new data centers, improving latency and accessibility across North America, Europe, and Asia.
en
Runpod Slashes GPU Prices: More Power, Less Cost for AI Builders
Runpod has reduced prices by across Serverless and Secure Cloud GPUs, making high-performance AI compute more accessible for developers.
en
Runpod vs. Google Colab Pro: Which GPU Cloud Is Right for You?
Google Colab meters compute and does not guarantee a GPU. Runpod gives you a specific GPU, for as long as you want it, billed by the second.
en
DeepSeek V4 in the wild, and how to run it on Runpod
DeepSeek V4 is not the "Sputnik moment" R1 was, but it is the cheapest credible alternative to Claude Opus and GPT-5.5 that anyone has shipped thus far.
en
Deploy OpenJev on Runpod Serverless (Step-by-Step Guide)
Learn how to deploy OpenJev, a 27B structured-decision model, on a Runpod Serverless load balancer endpoint, then send requests with cURL and Python.
en
Announcing Runpod's New Serverless CPU Feature
Runpod introduces Serverless CPU: high-performance VM containers with customizable CPU options, ideal for cost-effective and versatile workloads not.
en
How to Connect Google Colab to Runpod
Prefer Google Colab's interface? This guide shows how to connect Colab notebooks to Runpod GPU instances for more power, speed, and flexibility in your AI.
en
How to Run FLUX Image Generator with Runpod (No Coding Needed)
A beginner-friendly guide to running the FLUX AI image generator on Runpod in minutes, no coding required.
en
How to Run SAM 2 on a Cloud GPU with Runpod
Segment Anything Model 2 (SAM 2) offers real-time segmentation power. This guide walks you through running it efficiently on Runpod’s cloud GPUs.
en
How to Run vLLM on Runpod Serverless (Beginner-Friendly Guide)
Learn how to run vLLM on Runpod’s serverless GPU platform. This guide walks you through fast, efficient LLM inference without complex setup.
en
How to Use the Kohya_ss Template with Runpod
This tutorial walks you through using the Kohya_ss template on Runpod for desktop CUDA-based tasks, including installation, model compatibility, and.
en
LTXVideo by Lightricks: Sleeper Hit in Open-Source Video Gen
LTXVideo may have flown under the radar, but it's one of the most exciting open-source video generation models of the year. Learn what makes it special.
en
NVIDIA's Llama 3.1 Nemotron 70B: Can It Solve Your LLM Bottlenecks?
Nemotron 70B is NVIDIA's latest open model and it's climbing the leaderboards. But how does it perform in the real world, and can it solve your toughest.
en
RAG vs. Fine-Tuning: Which Is Best for Your LLM?
Retrieval-Augmented Generation (RAG) and fine-tuning are powerful ways to adapt large language models. Learn the key differences, trade-offs, and when to.
en
Run Flux Image Generator in ComfyUI on Runpod (Step-by-Step Guide)
Learn how to deploy and run Black Forest Labs' Flux 1 Dev model using ComfyUI on Runpod. This step-by-step guide walks through setting up your GPU pod.
en
InvokeAI Stable Diffusion on Runpod: Easy GPU Setup
InvokeAI is a creative engine for Stable Diffusion models. Launch it on Runpod when you want GPU-backed image generation without a local setup.
en