Large Language Models
131 views
GGUF
Quick Definition
File format for LLMs optimized for local inference
Full Definition
GPT-Generated Unified Format, a file format for LLMs optimized for local CPU/GPU inference.
Examples
llama.cpp, local AI, quantized model distribution
Related Terms
quantization
llama
local-inference
More Large Language Models Terms
Semantic Search
Search technique understanding meaning rather than keywords
DPO
Alignment method bypassing reward model for preference learning
Adapter Layer
Small trainable modules in frozen transformer layers
Masked Language Model
Training objective predicting randomly masked input tokens
Tool Use
Capability of LLMs to call external tools and APIs
Llama
Meta AI's open-source large language models