Large Language Models
273 views
Top-K Sampling
Quick Definition
Generation strategy considering top k most probable tokens
Full Definition
A generation strategy considering only the top k most probable tokens at each step.
Examples
text generation, creative writing, chatbot responses
Related Terms
nucleus-sampling
temperature
beam-search
More Large Language Models Terms
Synthetic Data Generation
Using AI to create artificial training data replicating patterns
Autoregressive Model
Generative model predicting next token from previous tokens
QLoRA
Combining 4-bit quantization with LoRA for efficiency
Inference LLM
Using a trained LLM to generate outputs from inputs
Next Token Prediction
Core LLM objective predicting the next token from context
Distillation LLM
Training smaller LLMs to replicate larger model behavior