Large Language Models
350 views
Instruction Tuning
Quick Definition
Fine-tuning on instruction-response pairs for better following
Full Definition
Fine-tuning models on instruction-response pairs to improve instruction following ability.
Examples
chatbot training, assistant development, task alignment
Related Terms
fine-tuning
rlhf
alignment
More Large Language Models Terms
Prompt Template
Reusable structured format with dynamic input placeholders
Mistral
Efficient open-source LLMs with strong performance
GGUF
File format for LLMs optimized for local inference
Constitutional AI
Training AI to follow explicit principles for consistency
Adapter Layer
Small trainable modules in frozen transformer layers
Pre-training
Initial training learning general language patterns from text