Transformer
Quick Definition
Architecture using self-attention for parallel processing
Full Definition
A neural network architecture using self-attention mechanisms for parallel processing of sequential data.
Examples
GPT, BERT, Vision Transformer
Related Terms
self-attention
large-language-model
More Artificial Intelligence Terms
Speech Recognition
Converting spoken language into written text using AI
Attention Mechanism
Component allowing models to focus on relevant input parts
Edge AI
Running AI on local devices instead of the cloud
One-Shot Learning
Learning to recognize patterns from a single example
Self-Attention
Mechanism allowing sequence positions to attend to all others
Named Entity Recognition
Identifying and classifying named entities in text