Machine Learning
26 views
Batch Normalization
Quick Definition
Normalizing layer inputs to stabilize and speed up training
Full Definition
A technique normalizing layer inputs during training to stabilize and accelerate neural network convergence.
Examples
faster training, reduced covariate shift, higher learning rates
Related Terms
deep-learning
neural-network
gradient-descent
More Machine Learning Terms
Underfitting
When a model is too simple to capture data patterns
Random Forest
Ensemble of decision trees that votes on predictions
Autoencoder
Neural network learning compressed data representations
Contrastive Learning
Self-supervised learning by contrasting data pairs
Online Learning
Updating models incrementally as new data arrives
Dimensionality Reduction
Reducing feature count while preserving important information