Large Language Models
158 views
Temperature
Quick Definition
Parameter controlling randomness in text generation
Full Definition
A parameter controlling randomness in LLM outputs by scaling logits before sampling.
Examples
creative writing, deterministic output, sampling strategy
Related Terms
top-k-sampling
nucleus-sampling
More Large Language Models Terms
Grounded Generation
Generating outputs faithful to provided source documents
Next Token Prediction
Core LLM objective predicting the next token from context
PEFT
Fine-tuning methods updating only small parameter subsets
SentencePiece
Language-agnostic tokenizer operating on raw text bytes
Speculative Decoding
Using draft model candidates verified by large model
BERT
Google's bidirectional transformer for context understanding