Large Language Models
145 views
Nucleus Sampling
Quick Definition
Generation using cumulative probability threshold for token selection
Full Definition
A generation strategy using cumulative probability threshold p for dynamic token selection.
Examples
natural text generation, conversation, creative content
Related Terms
top-k-sampling
temperature
beam-search
More Large Language Models Terms
Inference LLM
Using a trained LLM to generate outputs from inputs
Semantic Search
Search technique understanding meaning rather than keywords
Guardrails LLM
Frameworks for monitoring and controlling LLM I/O
Instruction Tuning
Fine-tuning on instruction-response pairs for better following
Next Token Prediction
Core LLM objective predicting the next token from context
Vector Database
Specialized database for high-dimensional embedding queries