Large Language Models
31 views
Nucleus Sampling
Quick Definition
Generation using cumulative probability threshold for token selection
Full Definition
A generation strategy using cumulative probability threshold p for dynamic token selection.
Examples
natural text generation, conversation, creative content
Related Terms
top-k-sampling
temperature
beam-search
More Large Language Models Terms
RAG
Enhancing LLMs by retrieving relevant external knowledge
GPT
OpenAI's family of autoregressive large language models
Beam Search
Search algorithm exploring multiple output sequences
System Prompt
Special prompt defining AI assistant behavior and constraints
RLHF
Aligning LLMs with human preferences using reinforcement learning
Large Language Model
Massive AI model trained on text for language understanding and generation