Large Language Models
22 views
Inference LLM
Quick Definition
Using a trained LLM to generate outputs from inputs
Full Definition
The process of using a trained LLM to generate outputs from new inputs.
Examples
text generation, chat responses, content creation
Related Terms
training
inference-optimization
More Large Language Models Terms
GGUF
File format for LLMs optimized for local inference
Training LLM
Adjusting parameters on large datasets to learn language
PEFT
Fine-tuning methods updating only small parameter subsets
System Prompt
Special prompt defining AI assistant behavior and constraints
BERT
Google's bidirectional transformer for context understanding
Reward Model
Model scoring LLM outputs based on human preferences