Artificial Intelligence
286 views
Attention Mechanism
Quick Definition
Component allowing models to focus on relevant input parts
Full Definition
A neural network component that allows models to focus on relevant parts of the input when producing output.
Examples
self-attention, cross-attention, multi-head attention
Related Terms
transformer
self-attention
More Artificial Intelligence Terms
OCR
Technology converting images of text into machine-readable text
Responsible AI
Framework for developing fair, transparent, accountable AI
Diffusion Model
Generative model creating data by iteratively removing noise
Hallucination
AI generating confident but factually incorrect information
Red Teaming AI
Adversarial testing of AI models for vulnerabilities
Meta-Learning
Designing models that learn how to learn new tasks