Machine Learning
301 views
Learning Rate
Quick Definition
Hyperparameter controlling gradient descent step size
Full Definition
A hyperparameter controlling the step size during gradient descent optimization of model parameters.
Examples
training speed, convergence, learning rate scheduling, warmup
Related Terms
gradient-descent
hyperparameter-tuning
More Machine Learning Terms
CatBoost
Gradient boosting library with native categorical feature support
Random Forest
Ensemble of decision trees that votes on predictions
Ridge Regression
Regularized regression using L2 penalty to prevent overfitting
Bias-Variance Tradeoff
The tension between model simplicity and complexity errors
Support Vector Machine
Finding optimal hyperplane to separate classes with max margin
DBSCAN
Density-based clustering finding clusters of varying shapes