RAG
Quick Definition
Enhancing LLMs by retrieving relevant external knowledge
Full Definition
Retrieval-Augmented Generation enhancing LLM responses by retrieving relevant external knowledge.
Examples
enterprise search, knowledge chatbots, document QA
Related Terms
vector-database
semantic-search
More Large Language Models Terms
LoRA
Parameter-efficient fine-tuning using low-rank matrix decomposition
GPT
OpenAI's family of autoregressive large language models
Temperature
Parameter controlling randomness in text generation
Quantization LLM
Reducing LLM weight precision for efficient inference
Sliding Window Attention
Attention limiting tokens to nearby window only
Synthetic Data Generation
Using AI to create artificial training data replicating patterns