Gradient Boosting
Quick Definition
Sequential ensemble method correcting previous model errors
Full Definition
An ensemble technique building models sequentially where each corrects errors of previous ones.
Examples
XGBoost, LightGBM, Kaggle competitions
Related Terms
ensemble-learning
random-forest
decision-tree
More Machine Learning Terms
Clustering
Grouping similar data points based on feature similarity
Ridge Regression
Regularized regression using L2 penalty to prevent overfitting
Learning Rate
Hyperparameter controlling gradient descent step size
PCA
Statistical technique reducing dimensionality via principal components
K-Nearest Neighbors
Classifying based on majority class of k nearest neighbors
Support Vector Machine
Finding optimal hyperplane to separate classes with max margin