Large Language Models
22 views
Top-K Sampling
Quick Definition
Generation strategy considering top k most probable tokens
Full Definition
A generation strategy considering only the top k most probable tokens at each step.
Examples
text generation, creative writing, chatbot responses
Related Terms
nucleus-sampling
temperature
beam-search
More Large Language Models Terms
Synthetic Data Generation
Using AI to create artificial training data replicating patterns
Prompt Template
Reusable structured format with dynamic input placeholders
Constitutional AI
Training AI to follow explicit principles for consistency
Autoregressive Model
Generative model predicting next token from previous tokens
System Prompt
Special prompt defining AI assistant behavior and constraints
Hallucination LLM
LLMs generating plausible but incorrect information