Context Window
Quick Definition
Maximum tokens a language model can process at once
Full Definition
The maximum number of tokens a language model can process in a single input.
Examples
long document processing, conversation history, retrieval context
Related Terms
large-language-model
attention
More Large Language Models Terms
Autoregressive Model
Generative model predicting next token from previous tokens
Semantic Search
Search technique understanding meaning rather than keywords
BERT
Google's bidirectional transformer for context understanding
RAG
Enhancing LLMs by retrieving relevant external knowledge
Constitutional AI
Training AI to follow explicit principles for consistency
QLoRA
Combining 4-bit quantization with LoRA for efficiency