Large Language Models
252 views
GGUF
Quick Definition
File format for LLMs optimized for local inference
Full Definition
GPT-Generated Unified Format, a file format for LLMs optimized for local CPU/GPU inference.
Examples
llama.cpp, local AI, quantized model distribution
Related Terms
quantization
llama
local-inference
More Large Language Models Terms
Next Token Prediction
Core LLM objective predicting the next token from context
Sliding Window Attention
Attention limiting tokens to nearby window only
Multi-Head Attention
Parallel attention operations concatenated for richer representations
Reward Model
Model scoring LLM outputs based on human preferences
Alignment Tax
Performance cost of aligning AI with human preferences
Constitutional AI
Training AI to follow explicit principles for consistency