Large Language Models
134 views
Autoregressive Model
Quick Definition
Generative model predicting next token from previous tokens
Full Definition
A generative model predicting the next token based on all previous tokens in sequence.
Examples
GPT text generation, language modeling, next-token prediction
Related Terms
large-language-model
transformer
More Large Language Models Terms
Fine-Tuning
Further training pre-trained models on specific domain data
Alignment Tax
Performance cost of aligning AI with human preferences
BPE
Subword tokenization algorithm merging frequent character pairs
Large Language Model
Massive AI model trained on text for language understanding and generation
Reward Model
Model scoring LLM outputs based on human preferences
Multi-Head Attention
Parallel attention operations concatenated for richer representations