Large Language Models
280 views
Distillation LLM
Quick Definition
Training smaller LLMs to replicate larger model behavior
Full Definition
Training smaller student LLMs to replicate behavior of larger teacher models.
Examples
student-teacher training, model compression, edge deployment
Related Terms
model-distillation
quantization
More Large Language Models Terms
Large Language Model
Massive AI model trained on text for language understanding and generation
Model Merging
Combining fine-tuned LLMs without additional training
Prompt Caching
Storing key-value states for repeated prompt prefixes
Next Token Prediction
Core LLM objective predicting the next token from context
QLoRA
Combining 4-bit quantization with LoRA for efficiency
Reward Model
Model scoring LLM outputs based on human preferences