Artificial Intelligence
278 views
Model Distillation
Quick Definition
Creating smaller models that replicate larger model behavior
Full Definition
Creating smaller models that replicate the behavior of larger teacher models for efficient deployment.
Examples
TinyBERT, mobile models, edge deployment
Related Terms
pruning
quantization
model-compression
More Artificial Intelligence Terms
Convolutional Neural Network
Neural network for image and grid-like data processing
AI Safety
Research ensuring AI is developed safely without harm
Responsible AI
Framework for developing fair, transparent, accountable AI
AI Fairness
Ensuring AI decisions do not discriminate against groups
Prompt Injection
Attack manipulating AI behavior by overriding instructions
Word Embedding
Dense vector representation capturing word semantic meaning