Fine-Tuning
Quick Definition
Further training pre-trained models on specific domain data
Full Definition
Further training a pre-trained language model on domain-specific or task-specific data.
Examples
domain adaptation, instruction tuning, task specialization
Related Terms
transfer-learning
lora
pre-training
More Large Language Models Terms
Tokenization
Breaking text into tokens for language model processing
Embeddings LLM
Dense vectors capturing semantic meaning of text
Large Language Model
Massive AI model trained on text for language understanding and generation
Context Window
Maximum tokens a language model can process at once
System Prompt
Special prompt defining AI assistant behavior and constraints
Attention Head
Individual attention mechanism learning specific patterns