Llama
Quick Definition
Meta AI's open-source large language models
Full Definition
Meta AI's family of open-source large language models freely available for research and commercial use.
Examples
open-source AI, community fine-tunes, local deployment
Related Terms
large-language-model
open-source
More Large Language Models Terms
Adapter Layer
Small trainable modules in frozen transformer layers
PEFT
Fine-tuning methods updating only small parameter subsets
Autoregressive Model
Generative model predicting next token from previous tokens
SentencePiece
Language-agnostic tokenizer operating on raw text bytes
Top-K Sampling
Generation strategy considering top k most probable tokens
Speculative Decoding
Using draft model candidates verified by large model