Large Language Models
193 views
Instruction Tuning
Quick Definition
Fine-tuning on instruction-response pairs for better following
Full Definition
Fine-tuning models on instruction-response pairs to improve instruction following ability.
Examples
chatbot training, assistant development, task alignment
Related Terms
fine-tuning
rlhf
alignment
More Large Language Models Terms
Fine-Tuning
Further training pre-trained models on specific domain data
Linear Attention
Attention with linear complexity for long sequences
Inference LLM
Using a trained LLM to generate outputs from inputs
Attention Head
Individual attention mechanism learning specific patterns
Temperature
Parameter controlling randomness in text generation
Synthetic Data Generation
Using AI to create artificial training data replicating patterns