Machine Learning
287 views
Gradient Descent
Quick Definition
Optimization algorithm minimizing loss by steepest descent
Full Definition
An optimization algorithm minimizing a loss function by moving in the direction of steepest descent.
Examples
neural network training, parameter optimization, loss minimization
Related Terms
backpropagation
learning-rate
optimization
More Machine Learning Terms
Unsupervised Learning
Discovering hidden patterns in unlabeled data
Bayesian Optimization
Optimizing expensive functions using a probabilistic model
Hyperparameter Tuning
Finding optimal configuration values before training
Support Vector Machine
Finding optimal hyperplane to separate classes with max margin
Precision Recall
Metrics measuring positive prediction quality and coverage
Supervised Learning
Learning from labeled training data with input-output pairs