Run Llama 3.1 with vLLM on Runpod Serverless
Discover how to deploy Meta's Llama 3.1 using Runpod's new vLLM worker. This guide walks you through model setup, performance benefits, and step-by-step.
en
RunPod Blog
127
Spot vs. On-Demand Instances: What's the Difference on Runpod?
Confused about the difference between spot and on-demand GPU instances? This guide explains how each works on Runpod, including pricing, reliability, and.
en
Spot vs. On-Demand Instances: What’s the Difference?
Confused about spot vs. on-demand GPU instances? This guide breaks down the key differences in availability, pricing, and reliability so you can choose.
en
Stable Diffusion 3.5: What’s New in the Latest Generation
Stability.ai’s SD3.5 is here, with new models built for speed and quality. Learn what’s changed, what’s improved, and how to run it on Runpod.
en
Global Networking: Secure Pod-to-Pod Across Data Centers
Runpod now supports secure internal communication between pods across data centers. With Global Networking enabled, your pods can talk to each other.
en
Avoid Errors by Selecting the Proper Resources for Your Pod
Common errors when spinning up pods often stem from insufficient container space or RAM/VRAM. This post explains how to identify and fix both issues by.
en
Boost vLLM Performance on Runpod with GuideLLM
Learn how to use GuideLLM to simulate real-world inference loads, fine-tune performance, and optimize cost for vLLM deployments on Runpod.
en
Build an OCR System Using Runpod Serverless
Learn how to build an OCR pipeline with Runpod Serverless and Hugging Face models, for processing receipts, invoices, and scanned documents at scale.
en
Classifier-Free Guidance in LLMs: How It Works
Classifier-Free Guidance improves LLM output quality and control. Here’s how it works, where it came from, and why it matters for your AI generations
en
How AnonAI Scaled Its Private Chatbot Platform on Runpod
AnonAI used Runpod to scale its decentralized chatbot platform with 40K+ users and zero data collection. Learn how they power private AI at scale.
en
Creating a Vlad Diffusion Template for Runpod
Want a custom spin on Stable Diffusion? This post shows you how to create and launch your own Vlad Diffusion template inside Runpod.
en
Creative Prompting with Disco Diffusion: Voronoi Noise Inits on Runpod
Explore a unique artistic technique using Voronoi noise inits with Disco Diffusion on Runpod. This post walks through setup and tips for generating.
en
DeepSeek R1: What It Is and Why It Matters
DeepSeek R1 is making waves in open-source AI, learn what it is, how it performs, and why developers are paying attention.
en
Deploy Google Gemma 7B with vLLM on Runpod Serverless
Deploy Google's Gemma 7B model with vLLM on Runpod Serverless in minutes. Learn how to optimize for speed, scalability, and cost-effective AI inference.
en
Deploy a Stable Diffusion UI on Runpod in Minutes
This post shows how to deploy a full Stable Diffusion UI using a community-created template on Runpod. With just a few clicks, you can generate.
en
DreamBooth on Runpod: How to Train for Great Results
DreamBooth can generate amazing, highly personalized images, but only if you train it well. In this post, Zhen walks through best practices for getting.
en
Enhanced CPU Pods Now Support Docker and Network Volumes
Runpod CPU pods now have Docker runtime and network volume support, giving you more flexibility, better storage options, and smoother dev workflows.
en
Evaluate Multiple LLMs Simultaneously Using Ollama on Runpod
Use Ollama to compare multiple LLMs side-by-side on a single GPU pod, perfect for fast, realistic model evaluation with shared prompts.
en
Get Better DreamBooth Results Using Offset Noise
DreamBooth tends to overfit and produce weird artifacts, like extra heads or multiple faces, especially with only a few training images. One trick to.
en
Build and Deploy an AI Chatbot with Runpod
Explore how Code in a Jiffy built a fully functional AI-powered coffee shop chatbot using Runpod. This community spotlight covers agentic chatbot.
en