Fine-Tuning
Quick Definition
Further training pre-trained models on specific domain data
Full Definition
Further training a pre-trained language model on domain-specific or task-specific data.
Examples
domain adaptation, instruction tuning, task specialization
Related Terms
transfer-learning
lora
pre-training
More Large Language Models Terms
Beam Search
Search algorithm exploring multiple output sequences
Adapter Layer
Small trainable modules in frozen transformer layers
Vector Database
Specialized database for high-dimensional embedding queries
Temperature
Parameter controlling randomness in text generation
Guardrails LLM
Frameworks for monitoring and controlling LLM I/O
BPE
Subword tokenization algorithm merging frequent character pairs