Large Language Models
136 views
Mistral
Quick Definition
Efficient open-source LLMs with strong performance
Full Definition
Efficient open-source LLMs by Mistral AI known for strong performance relative to size.
Examples
Mixtral MoE, efficient inference, open-source deployment
Related Terms
large-language-model
mixture-of-experts
More Large Language Models Terms
Prompt Caching
Storing key-value states for repeated prompt prefixes
QLoRA
Combining 4-bit quantization with LoRA for efficiency
Tokenizer Vocabulary
Complete set of tokens a language model can process
Training LLM
Adjusting parameters on large datasets to learn language
LoRA
Parameter-efficient fine-tuning using low-rank matrix decomposition
Autoregressive Model
Generative model predicting next token from previous tokens