Large Language Models
283 views
Embeddings LLM
Quick Definition
Dense vectors capturing semantic meaning of text
Full Definition
Dense vector representations of text capturing semantic meaning generated by language models.
Examples
semantic search, similarity comparison, clustering
Related Terms
embedding
vector-database
More Large Language Models Terms
LoRA
Parameter-efficient fine-tuning using low-rank matrix decomposition
Grounding LLM
Connecting LLM outputs to verifiable external sources
Attention Head
Individual attention mechanism learning specific patterns
Mixture of Experts
Architecture routing tokens to specialized expert sub-networks
Next Token Prediction
Core LLM objective predicting the next token from context
Synthetic Data Generation
Using AI to create artificial training data replicating patterns