Large Language Models
305 views
Autoregressive Model
Quick Definition
Generative model predicting next token from previous tokens
Full Definition
A generative model predicting the next token based on all previous tokens in sequence.
Examples
GPT text generation, language modeling, next-token prediction
Related Terms
large-language-model
transformer
More Large Language Models Terms
Prompt Template
Reusable structured format with dynamic input placeholders
Fine-Tuning
Further training pre-trained models on specific domain data
Scaling Laws
Relationships between model size, data, compute, and performance
WordPiece
Subword tokenization splitting words into frequent units
Model Merging
Combining fine-tuned LLMs without additional training
Grounded Generation
Generating outputs faithful to provided source documents