Machine Learning
149 views
Learning Rate
Quick Definition
Hyperparameter controlling gradient descent step size
Full Definition
A hyperparameter controlling the step size during gradient descent optimization of model parameters.
Examples
training speed, convergence, learning rate scheduling, warmup
Related Terms
gradient-descent
hyperparameter-tuning
More Machine Learning Terms
Gradient Descent
Optimization algorithm minimizing loss by steepest descent
Imbalanced Learning
Handling datasets with unequal class distributions
XGBoost
Optimized gradient boosting library for structured data
Multi-Task Learning
Training one model for multiple related tasks simultaneously
Batch Normalization
Normalizing layer inputs to stabilize and speed up training
Markov Chain
Stochastic model where events depend only on previous state