Large Language Models
265 views
Nucleus Sampling
Quick Definition
Generation using cumulative probability threshold for token selection
Full Definition
A generation strategy using cumulative probability threshold p for dynamic token selection.
Examples
natural text generation, conversation, creative content
Related Terms
top-k-sampling
temperature
beam-search
More Large Language Models Terms
Mistral
Efficient open-source LLMs with strong performance
Model Merging
Combining fine-tuned LLMs without additional training
GPT
OpenAI's family of autoregressive large language models
Fine-Tuning
Further training pre-trained models on specific domain data
RLHF
Aligning LLMs with human preferences using reinforcement learning
Constitutional AI
Training AI to follow explicit principles for consistency