Llama 4 Scout and Maverick Are Here, How Do They Shape Up?
Meta’s Llama 4 models, Scout and Maverick, are the next evolution in open LLMs. This post explores their strengths, performance, and deployment on Runpod.
en
RunPod Blog
99
Runpod Serverless Scaling: Optimize Performance and Cost
Learn how to optimize your serverless GPU deployment on Runpod to balance latency, performance, and cost. From active and flex workers to Flashboot and.
en
Mistral Small 3 Avoids Synthetic Data, Why That Matters
Mistral Small 3 skips synthetic data entirely and still delivers strong performance. Here's why that decision matters, and what it tells us about future.
en
Mochi 1: New State of the Art in Open-Source Text-to-Video
Mochi 1 pushes the boundaries of open-source video generation. Learn what makes it special, what’s new in v1, and how to deploy it on Runpod.
en
Open Source Video & LLM Roundup: The Best of What’s New
Open-source AI is booming, and 2024 delivered an incredible wave of new LLMs and generative video models. Here's a quick roundup of the most exciting.
en
Partnering with Defined AI to Bridge the Data Wealth Gap
Runpod and Defined.ai launch a pilot program to provide startups with access to high-quality training data and compute, enabling sector-specific.
en
Prompt Scheduling with Disco Diffusion on Runpod
This guide introduces prompt scheduling in Disco Diffusion, a technique that lets you shift prompts dynamically throughout an image generation run. Learn.
en
Pygmalion-7b from PygmalionAI has been released, and it's amazing
Pygmalion 7b and Metharme 7b significantly improve on the creative writing capabilities of Pygmalion 6b. This post walks through model comparisons and how.
en
Run GGUF Quantized Models Easily with KoboldCPP on Runpod
Lower VRAM usage and improve inference speed using GGUF quantized models in KoboldCPP with just a few environment variables.
en
Run Larger LLMs on Runpod Serverless: Llama-3 70B
Runpod Serverless now supports multi-GPU workers, enabling full-precision deployment of large models like Llama-3 70B. With optimized VLLM support.
en
Run Llama 3.1 405B with Ollama on Runpod: Step-by-Step Deployment
Learn how to deploy Meta's powerful open-source Llama 3.1 405B model using Ollama on Runpod. With benchmark-crushing performance, this guide walks you.
en
Run SAM 2 on a Cloud GPU with Runpod (Step-by-Step Guide)
Learn how to deploy Meta's Segment Anything Model 2 (SAM 2) on a Runpod GPU using Jupyter Lab. This guide walks through installing dependencies.
en
Run Very Large LLMs Securely with Runpod Serverless
Deploy large language models like LLaMA or Mixtral on Runpod Serverless with strong privacy controls and no infrastructure headaches. Here’s how.
en
Run the Flux Image Generator on Runpod (Full Setup Guide)
This guide walks you through deploying the Flux image generator on a GPU using Runpod. Learn how to clone the repo, configure your environment, and start.
en
Run vLLM on Runpod Serverless: Deploy Open Source LLMs in Minutes
Learn when to use open source vs. closed source LLMs, and how to deploy Llama 3 or Qwen3 with vLLM on Runpod Serverless for high-throughput inference.
en
Runpod Achieves SOC 2 Type I Certification: A Milestone in AI Security
Runpod has completed its SOC 2 Type I audit, reinforcing our commitment to security, compliance, and enterprise-grade trust in cloud AI infrastructure.
en
Runpod Launches AP-JP-1 Data Center in Fukushima
With the launch of AP-JP-1 in Fukushima, Runpod expands its Asia-Pacific footprint, improving latency, access, and compute availability across the region.
en
Runpod Partners With OpenCV to Empower the Next Gen of AI Builders
Runpod has teamed up with OpenCV to provide free GPU access for students building the future of computer vision. Learn how the partnership works and who.
en
Running JAX Diffusion Models on Runpod
Curious about JAX-based diffusion models? This post walks through setting up and running them on Runpod using our GPU pods. It covers environment setup.
en
Runpod RoundUp 2: 32k Token Context LLMs, StabilityAI
This week's Runpod RoundUp covers major releases including Llama-2 with 32k context support, SDXL 1.0's public release, and StabilityAI's new Stable.
en