Transformer
Quick Definition
Architecture using self-attention for parallel processing
Full Definition
A neural network architecture using self-attention mechanisms for parallel processing of sequential data.
Examples
GPT, BERT, Vision Transformer
Related Terms
self-attention
large-language-model
More Artificial Intelligence Terms
Explainable AI
AI that provides understandable explanations for decisions
Embedding
Learned vector representations of discrete objects in continuous space
Style Transfer
Applying artistic style of one image to another using neural networks
Recurrent Neural Network
Neural network with cyclic connections for sequence processing
OCR
Technology converting images of text into machine-readable text
Hallucination
AI generating confident but factually incorrect information