Large Language Models
275 views
BERT
Quick Definition
Google's bidirectional transformer for context understanding
Full Definition
Bidirectional Encoder Representations from Transformers, a Google model processing text in both directions.
Examples
search ranking, question answering, sentiment analysis
Related Terms
transformer
encoder-only
More Large Language Models Terms
RAG
Enhancing LLMs by retrieving relevant external knowledge
Embeddings LLM
Dense vectors capturing semantic meaning of text
Semantic Search
Search technique understanding meaning rather than keywords
Tree-of-Thought
Framework exploring multiple reasoning paths for optimal solutions
Adapter Layer
Small trainable modules in frozen transformer layers
Scaling Laws
Relationships between model size, data, compute, and performance