Large Language Models
23 views
Distillation LLM
Quick Definition
Training smaller LLMs to replicate larger model behavior
Full Definition
Training smaller student LLMs to replicate behavior of larger teacher models.
Examples
student-teacher training, model compression, edge deployment
Related Terms
model-distillation
quantization
More Large Language Models Terms
Quantization LLM
Reducing LLM weight precision for efficient inference
Structured Output
Generating LLM responses in predefined machine-readable formats
Scaling Laws
Relationships between model size, data, compute, and performance
Adapter Layer
Small trainable modules in frozen transformer layers
Vector Database
Specialized database for high-dimensional embedding queries
Positional Encoding
Incorporating token position information into transformers