Large Language Models
139 views
Training LLM
Quick Definition
Adjusting parameters on large datasets to learn language
Full Definition
Adjusting model parameters on large datasets to learn language patterns through optimization.
Examples
pre-training, fine-tuning, RLHF
Related Terms
pre-training
fine-tuning
gradient-descent
More Large Language Models Terms
Beam Search
Search algorithm exploring multiple output sequences
KV Cache
Memory optimization storing key-values for faster generation
Reward Model
Model scoring LLM outputs based on human preferences
Autoregressive Model
Generative model predicting next token from previous tokens
SentencePiece
Language-agnostic tokenizer operating on raw text bytes
Chain-of-Thought Prompting
Technique encouraging step-by-step reasoning in LLMs