Large Language Models
279 views
WordPiece
Quick Definition
Subword tokenization splitting words into frequent units
Full Definition
A subword tokenization algorithm that splits words into frequent subword units based on likelihood.
Examples
BERT tokenization, vocabulary building, unknown word handling
Related Terms
tokenization
bpe
sentencepiece
More Large Language Models Terms
LoRA
Parameter-efficient fine-tuning using low-rank matrix decomposition
Chain-of-Thought Prompting
Technique encouraging step-by-step reasoning in LLMs
Tokenizer Vocabulary
Complete set of tokens a language model can process
Constitutional AI
Training AI to follow explicit principles for consistency
DPO
Alignment method bypassing reward model for preference learning
Prompt Template
Reusable structured format with dynamic input placeholders