GPT
Quick Definition
OpenAI's family of autoregressive large language models
Full Definition
Generative Pre-trained Transformer, a family of autoregressive large language models by OpenAI.
Examples
ChatGPT, GPT-4, code generation, content creation
Related Terms
transformer
large-language-model
More Large Language Models Terms
QLoRA
Combining 4-bit quantization with LoRA for efficiency
Nucleus Sampling
Generation using cumulative probability threshold for token selection
Reward Model
Model scoring LLM outputs based on human preferences
Linear Attention
Attention with linear complexity for long sequences
Tokenizer Vocabulary
Complete set of tokens a language model can process
Speculative Decoding
Using draft model candidates verified by large model