Machine Learning
286 views
Regularization
Quick Definition
Techniques constraining model complexity to prevent overfitting
Full Definition
Techniques that constrain or penalize model complexity to prevent overfitting and improve generalization.
Examples
L1/L2 regularization, dropout, early stopping
Related Terms
overfitting
lasso
ridge-regression
More Machine Learning Terms
Dropout
Regularization randomly deactivating neurons during training
Learning Rate
Hyperparameter controlling gradient descent step size
A/B Testing
Statistical method comparing two versions for performance
Self-Supervised Learning
Generating supervisory signals from unlabeled data for training
K-Means
Partitioning data into k clusters by updating centroids
LightGBM
Fast gradient boosting framework using histogram splitting