Large Language Models
31 views
Autoregressive Model
Quick Definition
Generative model predicting next token from previous tokens
Full Definition
A generative model predicting the next token based on all previous tokens in sequence.
Examples
GPT text generation, language modeling, next-token prediction
Related Terms
large-language-model
transformer
More Large Language Models Terms
BPE
Subword tokenization algorithm merging frequent character pairs
Structured Output
Generating LLM responses in predefined machine-readable formats
RAG
Enhancing LLMs by retrieving relevant external knowledge
Next Token Prediction
Core LLM objective predicting the next token from context
QLoRA
Combining 4-bit quantization with LoRA for efficiency
Streaming
Sending LLM tokens to clients as they are generated