Transformer
Quick Definition
Architecture using self-attention for parallel processing
Full Definition
A neural network architecture using self-attention mechanisms for parallel processing of sequential data.
Examples
GPT, BERT, Vision Transformer
Related Terms
self-attention
large-language-model
More Artificial Intelligence Terms
Synthetic Data
Artificially generated data mimicking real-world distributions
Adversarial Robustness
AI model ability to resist adversarial perturbations
Meta-Learning
Designing models that learn how to learn new tasks
AI Governance
Framework for responsible AI development policies
Reward Modeling
Training models to predict human preferences for RLHF
Diffusion Model
Generative model creating data by iteratively removing noise