Runpod Blog the company blog of Runpod: latest posts and feed

Nov 6

Deep Dive Into Creating and Listing on the Runpod Hub

A deep technical dive into how the Runpod Hub streamlines serverless AI deployment with a GitHub-native, release-triggered model. Learn how hub.json and.

Nov 6

Introducing the Runpod Hub: Deploy Open Source AI Repos

The Runpod Hub is here, a creator-powered marketplace for open source AI. Browse, fork, and deploy prebuilt repos for LLMs, image models, video.

Nov 6

Introducing the New Runpod Referral & Affiliate Program

Runpod enhanced its referral program with exciting new features including randomized rewards up to $500, a premium affiliate tier offering 10% cash.

Nov 6

Flash, now the Nix way: run the Flash CLI straight from GitHub

Nov 6

Global Volumes aren't "network volumes, but better." Here's what they're for

Nov 6

Building Runpod templates: Your first custom template

Step-by-step guide to building a custom PyTorch Docker image, pushing it to Docker Hub, and saving it as a reusable Runpod Pod template with a GPU test.

Nov 4

How to use Kimi K3.1 Pro and K3.1 Pro Highspeed on Runpod

Kimi K3.1 Pro and K3.1 Pro Highspeed are live on Runpod Public Endpoints. Get started in the Playground, with curl, or with the OpenAI Python SDK.

Nov 2

Runpod Achieves SOC 2 Type II Certification

Runpod has officially achieved SOC 2 Type II certification, validating that its enterprise-grade security controls not only meet strict design standards.

Oct 30

Build a Halloween Murder Mystery Game with AI on Runpod

Build Murder at Hollow Manor, a Halloween mystery game with AI suspects and generated portraits, using Python, Qwen3 32B and FLUX.1 Schnell on Runpod.

Oct 29

Serverless GPU inference vs. GPU Pods: cost benchmarks

We benchmarked one A40 as a Pod and as a Serverless worker. A busy worker cost about 2.3x per token, but Serverless wins below 29 billed minutes an hour.

Oct 28

Batch Inference Is Now Generally Available on Runpod

Batch Inference is now generally available on Runpod Serverless. Send up to 3 million requests a day to an existing queue-based endpoint, on dedicated workers.

Oct 23

Getting started with GLM-5.3 on Runpod's public endpoint

GLM-5.3 is now on Runpod's public endpoints at a lower price than elsewhere. Try it in the Playground, call it with curl, or use the OpenAI SDK in Python.

Oct 22

How to Benchmark Local LLM Inference for Speed and Cost Efficiency

Explore how to deploy and benchmark LLMs locally using tools like Ollama and NVIDIA NIMs. This deep dive covers performance, cost, and scaling insights.

Oct 22

Rebuilding our PyTorch templates

Runpod's PyTorch templates now span 2.6 to 2.13 with multiple CUDA and Ubuntu versions, plus a CUDA dropdown in the Pod deploy flow.

Oct 22

Global Networking: Secure Pod-to-Pod Across Data Centers

Runpod now supports secure internal communication between pods across data centers. With Global Networking enabled, your pods can talk to each other.

Oct 22

Classifier-Free Guidance in LLMs: How It Works

Classifier-Free Guidance improves LLM output quality and control. Here’s how it works, where it came from, and why it matters for your AI generations

Oct 22

How AnonAI Scaled Its Private Chatbot Platform on Runpod

AnonAI used Runpod to scale its decentralized chatbot platform with 40K+ users and zero data collection. Learn how they power private AI at scale.

Oct 22

Creative Prompting with Disco Diffusion: Voronoi Noise Inits on Runpod

Explore a unique artistic technique using Voronoi noise inits with Disco Diffusion on Runpod. This post walks through setup and tips for generating.

Oct 22

DeepSeek R1: What It Is and Why It Matters

DeepSeek R1 is making waves in open-source AI, learn what it is, how it performs, and why developers are paying attention.

Oct 22

Deploy Google Gemma 7B with vLLM on Runpod Serverless

Deploy Google's Gemma 7B model with vLLM on Runpod Serverless in minutes. Learn how to optimize for speed, scalability, and cost-effective AI inference.

Oct 22

Deploy a Stable Diffusion UI on Runpod in Minutes

This post shows how to deploy a full Stable Diffusion UI using a community-created template on Runpod. With just a few clicks, you can generate.

Oct 22

DreamBooth on Runpod: How to Train for Great Results

DreamBooth can generate amazing, highly personalized images, but only if you train it well. In this post, Zhen walks through best practices for getting.

Oct 22

Enhanced CPU Pods Now Support Docker and Network Volumes

Runpod CPU pods now have Docker runtime and network volume support, giving you more flexibility, better storage options, and smoother dev workflows.

Oct 22

Evaluate Multiple LLMs Simultaneously Using Ollama on Runpod

Use Ollama to compare multiple LLMs side-by-side on a single GPU pod, perfect for fast, realistic model evaluation with shared prompts.

Oct 22

Get Better DreamBooth Results Using Offset Noise

DreamBooth tends to overfit and produce weird artifacts, like extra heads or multiple faces, especially with only a few training images. One trick to.