Size & speed
parameters
The adjustable weights a model learns during training; more parameters (e.g. 7B vs 120B, where B = billion) usually means smarter but slower and heavier to run.
Size & speed
The adjustable weights a model learns during training; more parameters (e.g. 7B vs 120B, where B = billion) usually means smarter but slower and heavier to run.