Context Window
Quick Definition
Maximum tokens a language model can process at once
Full Definition
The maximum number of tokens a language model can process in a single input.
Examples
long document processing, conversation history, retrieval context
Related Terms
large-language-model
attention
More Large Language Models Terms
Embeddings LLM
Dense vectors capturing semantic meaning of text
Streaming
Sending LLM tokens to clients as they are generated
SentencePiece
Language-agnostic tokenizer operating on raw text bytes
WordPiece
Subword tokenization splitting words into frequent units
Chain-of-Thought Prompting
Technique encouraging step-by-step reasoning in LLMs
Hallucination LLM
LLMs generating plausible but incorrect information