Running locally

VRAM

The memory on your graphics card — the main limit on which local models you can run (rough rule: the model's size in GB must fit in VRAM).