Large Language Models
270 views
PEFT
Quick Definition
Fine-tuning methods updating only small parameter subsets
Full Definition
Parameter-Efficient Fine-Tuning, a family of methods updating only a small subset of model parameters.
Examples
LoRA, prefix tuning, adapter layers, efficient adaptation
Related Terms
lora
fine-tuning
qlora
More Large Language Models Terms
Grounded Generation
Generating outputs faithful to provided source documents
Function Calling
Structured mechanism for LLMs to generate API function calls
Adapter Layer
Small trainable modules in frozen transformer layers
Llama
Meta AI's open-source large language models
Constitutional AI
Training AI to follow explicit principles for consistency
Positional Encoding
Incorporating token position information into transformers