Large Language Models
303 views
Streaming
Quick Definition
Sending LLM tokens to clients as they are generated
Full Definition
Sending LLM tokens to clients as they are generated for real-time responsiveness.
Examples
chat interfaces, real-time responses, SSE
Related Terms
inference-optimization
user-experience
More Large Language Models Terms
Reward Model
Model scoring LLM outputs based on human preferences
Embeddings LLM
Dense vectors capturing semantic meaning of text
Synthetic Data Generation
Using AI to create artificial training data replicating patterns
RLHF
Aligning LLMs with human preferences using reinforcement learning
SentencePiece
Language-agnostic tokenizer operating on raw text bytes
Guardrails LLM
Frameworks for monitoring and controlling LLM I/O