Artificial Intelligence
303 views
Self-Attention
Quick Definition
Mechanism allowing sequence positions to attend to all others
Full Definition
A mechanism allowing each position in a sequence to attend to all positions in the same sequence.
Examples
transformer layers, contextual embeddings, parallel processing
Related Terms
transformer
attention-mechanism
More Artificial Intelligence Terms
Explainable AI
AI that provides understandable explanations for decisions
GAN
Two competing neural networks generating synthetic data
Recommendation System
AI systems predicting and suggesting items of interest
Embedding
Learned vector representations of discrete objects in continuous space
Anomaly Detection
Identifying unusual patterns that deviate from expected behavior
AI Ethics
Study of moral implications in AI development