Large Language Models
23 views
GGUF
Quick Definition
File format for LLMs optimized for local inference
Full Definition
GPT-Generated Unified Format, a file format for LLMs optimized for local CPU/GPU inference.
Examples
llama.cpp, local AI, quantized model distribution
Related Terms
quantization
llama
local-inference
More Large Language Models Terms
Autoregressive Model
Generative model predicting next token from previous tokens
RoPE
Position encoding using rotation matrices for relative positions
Linear Attention
Attention with linear complexity for long sequences
Nucleus Sampling
Generation using cumulative probability threshold for token selection
Chain-of-Thought Prompting
Technique encouraging step-by-step reasoning in LLMs
Speculative Decoding
Using draft model candidates verified by large model