Runpod RoundUp 3 – AI Music and Stock Sound Effect Creation
This week's Runpod RoundUp highlights Meta's Audiocraft for AI-generated music and sound effects, new Chinese LLMs from Alibaba, and Salesforce's.
en
RunPod Blog
99
Scoped API Keys Now Live: Fine-Grained Access Control
Runpod now supports scoped API keys with per-endpoint access, usage tracking, and on/off toggles. Create safer, more flexible keys that align with the.
en
Stable Diffusion + ComfyUI on Runpod: Easy Setup Guide
Set up Stable Diffusion with ComfyUI on Runpod, configure the environment, launch the interface, and start an AI image generation workflow.
en
Stable Diffusion 3.5: Better Quality and Easier Prompts
Stable Diffusion 3.5 delivers a major quality leap, fixing past flaws while generating photorealistic images from minimal prompts. Learn what's new, how.
en
Stable Diffusion XL 1.0 Released And Available On Runpod
Stable Diffusion XL 1.0 is now live on Runpod with full support in the Fast Stable Diffusion template. Users can generate higher-resolution, more.
en
Supercharge Your LLMs with SGLang: Boost Performance and Customization
Discover how to boost your LLM inference performance and customize responses using SGLang, an innovative framework for structured LLM workflows.
en
The Complete Guide to GPU Requirements for LLM Fine-Tuning
Fine-tuning large language models can require hours or days of runtime. This guide walks through how to choose the right GPU spec for cost and performance.
en
Training StyleGAN3 with Vision-Aided GAN on Runpod
StyleGAN3 represents a leap forward in GAN-based image generation, offering high-resolution outputs without aliasing artifacts. This post explores how.
en
Why LLMs Can't Spell 'Strawberry' And Other Odd Use Cases
Large language models can write poetry and solve logic puzzles, but fail at tasks like counting letters or doing math. Here's why, and what it tells us.
en
Rebuilding our PyTorch templates
Runpod's PyTorch templates now span 2.6 to 2.13 with multiple CUDA and Ubuntu versions, plus a CUDA dropdown in the Pod deploy flow.
en
Cost-Effective AI with Autoscaling on Runpod
Learn how Runpod autoscaling helps teams cut costs and improve performance for both training and inference. Includes best practices and real-world.
en
Exploring the Ethics of AI: What Developers Need to Know
Learn how to build ethical AI, from bias and privacy to transparency and sustainability, using tools and infrastructure that support responsible work.
en
How to Achieve True SSH in Runpod
This tutorial guides users through setting up a true SSH daemon on Runpod, enabling functionalities like SCP and IDE connections. It covers selecting a.
en
How to Fine-Tune LLMs with Axolotl on Runpod
Learn how to fine-tune large language models using Axolotl on Runpod. This guide covers LoRA, 8-bit quantization, DeepSpeed, and GPU infrastructure setup.
en
How to Cut LLM Inference Latency and Cost
Learn how to reduce LLM inference costs and latency using quantization, vLLM, SGLang, and speculative decoding without upgrading your hardware.
en
Open Source AI Renaissance: The Rise of Community Models
From Mistral to DeepSeek, open-source AI is closing the gap with closed models, and, in some cases, outperforming them. Here's why builders are betting on.
en
Training Flux.1 Dev on MI300X with Massive Batch Sizes
Explore what's possible when training Flux.1 Dev on AMD's 192GB MI300X GPU. This post dives into fine-tuning at scale with huge batch sizes and real-world.
en
Why the Future of AI Belongs to Indie Developers
Big labs may dominate the headlines, but the future of AI is being shaped by indie devs, fast-moving builders shipping small, weird, brilliant things.
en
GPU Memory Math: Sizing VRAM for Full-Parameter Tuning
A practical guide to calculating VRAM for full-parameter fine-tuning, with equations to size your compute and why inference rules of thumb fall short.
en