Large Language Models
288 views
Inference LLM
Quick Definition
Using a trained LLM to generate outputs from inputs
Full Definition
The process of using a trained LLM to generate outputs from new inputs.
Examples
text generation, chat responses, content creation
Related Terms
training
inference-optimization
More Large Language Models Terms
Reward Model
Model scoring LLM outputs based on human preferences
Distillation LLM
Training smaller LLMs to replicate larger model behavior
DPO
Alignment method bypassing reward model for preference learning
Jailbreaking
Circumventing AI safety restrictions through prompt techniques
Scaling Laws
Relationships between model size, data, compute, and performance
System Prompt
Special prompt defining AI assistant behavior and constraints