Machine Learning
140 views
Self-Supervised Learning
Quick Definition
Generating supervisory signals from unlabeled data for training
Full Definition
A ML approach where the model generates its own supervisory signal from unlabeled data.
Examples
BERT pre-training, contrastive learning, masked modeling
Related Terms
contrastive-learning
transfer-learning
More Machine Learning Terms
Logistic Regression
Statistical model estimating binary outcome probabilities
Learning Rate
Hyperparameter controlling gradient descent step size
Kernel Trick
Transforming data to higher dimensions for linear separability
Overfitting
When a model learns training data noise and fails on new data
Model Selection
Choosing the best ML model from candidates
Batch Normalization
Normalizing layer inputs to stabilize and speed up training