Large Language Models
284 views
Embeddings LLM
Quick Definition
Dense vectors capturing semantic meaning of text
Full Definition
Dense vector representations of text capturing semantic meaning generated by language models.
Examples
semantic search, similarity comparison, clustering
Related Terms
embedding
vector-database
More Large Language Models Terms
Tool Use
Capability of LLMs to call external tools and APIs
QLoRA
Combining 4-bit quantization with LoRA for efficiency
GGUF
File format for LLMs optimized for local inference
Reward Model
Model scoring LLM outputs based on human preferences
Sliding Window Attention
Attention limiting tokens to nearby window only
Beam Search
Search algorithm exploring multiple output sequences