Large Language Models
26 views
QLoRA
Quick Definition
Combining 4-bit quantization with LoRA for efficiency
Full Definition
Combining 4-bit quantization with LoRA for memory-efficient fine-tuning of large models.
Examples
consumer GPU fine-tuning, large model adaptation
Related Terms
lora
quantization
fine-tuning
More Large Language Models Terms
Autoregressive Model
Generative model predicting next token from previous tokens
Scaling Laws
Relationships between model size, data, compute, and performance
RAG
Enhancing LLMs by retrieving relevant external knowledge
Quantization LLM
Reducing LLM weight precision for efficient inference
Instruction Tuning
Fine-tuning on instruction-response pairs for better following
Large Language Model
Massive AI model trained on text for language understanding and generation