Machine Learning
25 views
Learning Rate
Quick Definition
Hyperparameter controlling gradient descent step size
Full Definition
A hyperparameter controlling the step size during gradient descent optimization of model parameters.
Examples
training speed, convergence, learning rate scheduling, warmup
Related Terms
gradient-descent
hyperparameter-tuning
More Machine Learning Terms
Ridge Regression
Regularized regression using L2 penalty to prevent overfitting
Naive Bayes
Probabilistic classifier using Bayes theorem with independence
Hidden Markov Model
Statistical model with hidden states and observable outputs
Bagging
Training models on random subsets and averaging predictions
t-SNE
Nonlinear technique for visualizing high-dimensional data
K-Means
Partitioning data into k clusters by updating centroids