Artificial Intelligence
23 views
Model Distillation
Quick Definition
Creating smaller models that replicate larger model behavior
Full Definition
Creating smaller models that replicate the behavior of larger teacher models for efficient deployment.
Examples
TinyBERT, mobile models, edge deployment
Related Terms
pruning
quantization
model-compression
More Artificial Intelligence Terms
Recommendation System
AI systems predicting and suggesting items of interest
Hallucination
AI generating confident but factually incorrect information
Recurrent Neural Network
Neural network with cyclic connections for sequence processing
Speech Recognition
Converting spoken language into written text using AI
Feature Importance
Quantifying each input features contribution to predictions
Prompt Injection
Attack manipulating AI behavior by overriding instructions