How to Achieve True SSH in Runpod
This tutorial guides users through setting up a true SSH daemon on Runpod, enabling functionalities like SCP and IDE connections. It covers selecting a.
en
RunPod Blog
127
How to Fine-Tune LLMs with Axolotl on Runpod
Learn how to fine-tune large language models using Axolotl on Runpod. This guide covers LoRA, 8-bit quantization, DeepSpeed, and GPU infrastructure setup.
en
How to Cut LLM Inference Latency and Cost
Learn how to reduce LLM inference costs and latency using quantization, vLLM, SGLang, and speculative decoding without upgrading your hardware.
en
Open Source AI Renaissance: The Rise of Community Models
From Mistral to DeepSeek, open-source AI is closing the gap with closed models, and, in some cases, outperforming them. Here's why builders are betting on.
en
Training Flux.1 Dev on MI300X with Massive Batch Sizes
Explore what's possible when training Flux.1 Dev on AMD's 192GB MI300X GPU. This post dives into fine-tuning at scale with huge batch sizes and real-world.
en
Why the Future of AI Belongs to Indie Developers
Big labs may dominate the headlines, but the future of AI is being shaped by indie devs, fast-moving builders shipping small, weird, brilliant things.
en
GPU Memory Math: Sizing VRAM for Full-Parameter Tuning
A practical guide to calculating VRAM for full-parameter fine-tuning, with equations to size your compute and why inference rules of thumb fall short.
en