Large Language Models
27 views
Instruction Tuning
Quick Definition
Fine-tuning on instruction-response pairs for better following
Full Definition
Fine-tuning models on instruction-response pairs to improve instruction following ability.
Examples
chatbot training, assistant development, task alignment
Related Terms
fine-tuning
rlhf
alignment
More Large Language Models Terms
RLHF
Aligning LLMs with human preferences using reinforcement learning
Constitutional AI
Training AI to follow explicit principles for consistency
Distillation LLM
Training smaller LLMs to replicate larger model behavior
Reward Model
Model scoring LLM outputs based on human preferences
Attention Head
Individual attention mechanism learning specific patterns
Streaming
Sending LLM tokens to clients as they are generated