Large Language Models
300 views
Temperature
Quick Definition
Parameter controlling randomness in text generation
Full Definition
A parameter controlling randomness in LLM outputs by scaling logits before sampling.
Examples
creative writing, deterministic output, sampling strategy
Related Terms
top-k-sampling
nucleus-sampling
More Large Language Models Terms
Llama
Meta AI's open-source large language models
QLoRA
Combining 4-bit quantization with LoRA for efficiency
Hallucination LLM
LLMs generating plausible but incorrect information
Sliding Window Attention
Attention limiting tokens to nearby window only
Next Token Prediction
Core LLM objective predicting the next token from context
Alignment Tax
Performance cost of aligning AI with human preferences