Fine-Tuning
Quick Definition
Further training pre-trained models on specific domain data
Full Definition
Further training a pre-trained language model on domain-specific or task-specific data.
Examples
domain adaptation, instruction tuning, task specialization
Related Terms
transfer-learning
lora
pre-training
More Large Language Models Terms
Scaling Laws
Relationships between model size, data, compute, and performance
QLoRA
Combining 4-bit quantization with LoRA for efficiency
SentencePiece
Language-agnostic tokenizer operating on raw text bytes
Tool Use
Capability of LLMs to call external tools and APIs
Llama
Meta AI's open-source large language models
Tokenization
Breaking text into tokens for language model processing