Large Language Models
283 views
Training LLM
Quick Definition
Adjusting parameters on large datasets to learn language
Full Definition
Adjusting model parameters on large datasets to learn language patterns through optimization.
Examples
pre-training, fine-tuning, RLHF
Related Terms
pre-training
fine-tuning
gradient-descent
More Large Language Models Terms
Tokenizer Vocabulary
Complete set of tokens a language model can process
Positional Encoding
Incorporating token position information into transformers
Constitutional AI
Training AI to follow explicit principles for consistency
WordPiece
Subword tokenization splitting words into frequent units
Jailbreaking
Circumventing AI safety restrictions through prompt techniques
Streaming
Sending LLM tokens to clients as they are generated