RAG
Quick Definition
Enhancing LLMs by retrieving relevant external knowledge
Full Definition
Retrieval-Augmented Generation enhancing LLM responses by retrieving relevant external knowledge.
Examples
enterprise search, knowledge chatbots, document QA
Related Terms
vector-database
semantic-search
More Large Language Models Terms
Pre-training
Initial training learning general language patterns from text
Embeddings LLM
Dense vectors capturing semantic meaning of text
Multi-Head Attention
Parallel attention operations concatenated for richer representations
Reward Model
Model scoring LLM outputs based on human preferences
Tokenization
Breaking text into tokens for language model processing
Function Calling
Structured mechanism for LLMs to generate API function calls