Features
predicted outputs
A feature where you supply the text you expect the model to produce; the model skips regenerating tokens that already match your prediction, speeding up the response.
Features
A feature where you supply the text you expect the model to produce; the model skips regenerating tokens that already match your prediction, speeding up the response.