Large Language Models
334 views
Structured Output
Quick Definition
Generating LLM responses in predefined machine-readable formats
Full Definition
The ability of LLMs to generate responses in predefined formats like JSON or XML.
Examples
JSON mode, schema enforcement, API responses
Related Terms
function-calling
json-mode
More Large Language Models Terms
WordPiece
Subword tokenization splitting words into frequent units
Function Calling
Structured mechanism for LLMs to generate API function calls
Prompt Caching
Storing key-value states for repeated prompt prefixes
Linear Attention
Attention with linear complexity for long sequences
Masked Language Model
Training objective predicting randomly masked input tokens
RoPE
Position encoding using rotation matrices for relative positions