Large Language Models
140 views
Masked Language Model
Quick Definition
Training objective predicting randomly masked input tokens
Full Definition
A training objective where masked tokens are predicted from surrounding context.
Examples
BERT pre-training, fill-in-the-blank, contextual understanding
Related Terms
bert
pre-training
self-supervised-learning
More Large Language Models Terms
Synthetic Data Generation
Using AI to create artificial training data replicating patterns
Temperature
Parameter controlling randomness in text generation
Function Calling
Structured mechanism for LLMs to generate API function calls
Large Language Model
Massive AI model trained on text for language understanding and generation
Streaming
Sending LLM tokens to clients as they are generated
Jailbreaking
Circumventing AI safety restrictions through prompt techniques