Machine Learning
24 views
Gradient Descent
Quick Definition
Optimization algorithm minimizing loss by steepest descent
Full Definition
An optimization algorithm minimizing a loss function by moving in the direction of steepest descent.
Examples
neural network training, parameter optimization, loss minimization
Related Terms
backpropagation
learning-rate
optimization
More Machine Learning Terms
CatBoost
Gradient boosting library with native categorical feature support
K-Means
Partitioning data into k clusters by updating centroids
Time Series Analysis
Analyzing time-ordered data for patterns and forecasting
Ensemble Learning
Combining multiple models for better predictions
Contrastive Learning
Self-supervised learning by contrasting data pairs
Linear Regression
Modeling variable relationships by fitting a linear equation