Large Language Model
Quick Definition
Massive AI model trained on text for language understanding and generation
Full Definition
An AI model trained on vast text data to understand and generate human language using transformer architectures.
Examples
ChatGPT, Claude, Gemini, Llama
Related Terms
transformer
generative-ai
More Large Language Models Terms
Attention Head
Individual attention mechanism learning specific patterns
Mistral
Efficient open-source LLMs with strong performance
BERT
Google's bidirectional transformer for context understanding
Context Window
Maximum tokens a language model can process at once
Sparse Attention
Attention attending to only a subset of tokens
Flash Attention
Memory-efficient attention using GPU SRAM block computation