How models are built

distillation

Training a smaller model to imitate a bigger one, keeping much of the quality at a fraction of the size.