Prefer not to load the embedded player? Watch on YouTube

Advanced · Alex Ziskind

This Shouldn't Be Able to Run 120B Locally

Running a 120-billion-parameter model on consumer hardware — the memory and quantization tricks (MoE + MXFP4) that make it possible.

Mapped to the curriculum: Frozen source accepted this video for T11-L05.

Watch at source

Why this one

A reality-check on running gpt-oss-120b on one machine — exactly the chapter's 'top one-box local' claim.