Artificial Intelligence
156 views
Quantization
Quick Definition
Reducing model precision from 32-bit to lower bit representations
Full Definition
Reducing model size and computation by representing weights with lower precision numbers like INT8.
Examples
INT8 inference, mixed precision, PTQ
Related Terms
pruning
model-distillation
More Artificial Intelligence Terms
AI Chip
Specialized hardware for accelerating AI computation
Transformer
Architecture using self-attention for parallel processing
Computer Vision
AI that enables machines to interpret visual information
Synthetic Data
Artificially generated data mimicking real-world distributions
Generative AI
AI systems that create new content
Meta-Learning
Designing models that learn how to learn new tasks