Large Language Models
28 views
Hallucination LLM
Quick Definition
LLMs generating plausible but incorrect information
Full Definition
When LLMs generate plausible but factually incorrect or fabricated information.
Examples
fake citations, wrong statistics, fictional references
Related Terms
grounding
retrieval-augmented-generation
More Large Language Models Terms
Constitutional AI
Training AI to follow explicit principles for consistency
Reward Model
Model scoring LLM outputs based on human preferences
GPT
OpenAI's family of autoregressive large language models
SentencePiece
Language-agnostic tokenizer operating on raw text bytes
Sliding Window Attention
Attention limiting tokens to nearby window only
LoRA
Parameter-efficient fine-tuning using low-rank matrix decomposition