Mortch The AI GuyLocal AI / Homelab field notes
The guide shelf

From hardware
to useful answers.

Start with the architecture. Then get into the memory math, the software, and the choices that make a homelab useful.

Ghost is currently in private preview. The launch guide is being prepared for publication. Public article links will appear here when they’re available. Follow along below for updates.
01
Multi-GPU inference / Launch guide

Four GPUs, Zero Cloud: Running LLMs Across a Heterogeneous Home GPU Cluster

A Windows and Ubuntu setup across NVIDIA and Intel. Separate model servers, a single front door, VRAM estimates, and Tailscale-only remote access.

PRIVATE PREVIEW
02
Memory / Planned follow-up

VRAM, quantization, and the context-window budget

What the weight file tells you, what the KV cache adds, and why “it loads” is different from “it fits comfortably.”

COMING SOON
03
Software / Planned guide

One front door for your local model servers

Connecting the serving stack, choosing an endpoint, and keeping remote access private.

COMING SOON
04
Hardware / Planned guide

Choose the workload before the next GPU

VRAM capacity, backend compatibility, power, and the tradeoffs worth checking before you buy.

COMING SOON

Follow the build.

New guides, useful experiments, and the occasional hard lesson.