GPT
Quick Definition
OpenAI's family of autoregressive large language models
Full Definition
Generative Pre-trained Transformer, a family of autoregressive large language models by OpenAI.
Examples
ChatGPT, GPT-4, code generation, content creation
Related Terms
transformer
large-language-model
More Large Language Models Terms
System Prompt
Special prompt defining AI assistant behavior and constraints
Beam Search
Search algorithm exploring multiple output sequences
Training LLM
Adjusting parameters on large datasets to learn language
Synthetic Data Generation
Using AI to create artificial training data replicating patterns
RLHF
Aligning LLMs with human preferences using reinforcement learning
Prompt Caching
Storing key-value states for repeated prompt prefixes