Large Language Models
25 views
BERT
Quick Definition
Google's bidirectional transformer for context understanding
Full Definition
Bidirectional Encoder Representations from Transformers, a Google model processing text in both directions.
Examples
search ranking, question answering, sentiment analysis
Related Terms
transformer
encoder-only
More Large Language Models Terms
Instruction Tuning
Fine-tuning on instruction-response pairs for better following
Next Token Prediction
Core LLM objective predicting the next token from context
Mistral
Efficient open-source LLMs with strong performance
Linear Attention
Attention with linear complexity for long sequences
Fine-Tuning
Further training pre-trained models on specific domain data
Hallucination LLM
LLMs generating plausible but incorrect information