Large Language Models
285 views
Linear Attention
Quick Definition
Attention with linear complexity for long sequences
Full Definition
Attention mechanism with linear complexity for efficient long-sequence processing.
Examples
efficient transformers, long documents, streaming models
Related Terms
attention-mechanism
sparse-attention
More Large Language Models Terms
Tokenizer Vocabulary
Complete set of tokens a language model can process
Speculative Decoding
Using draft model candidates verified by large model
Next Token Prediction
Core LLM objective predicting the next token from context
RAG
Enhancing LLMs by retrieving relevant external knowledge
Streaming
Sending LLM tokens to clients as they are generated
Function Calling
Structured mechanism for LLMs to generate API function calls