Large Language Models
276 views
Mistral
Quick Definition
Efficient open-source LLMs with strong performance
Full Definition
Efficient open-source LLMs by Mistral AI known for strong performance relative to size.
Examples
Mixtral MoE, efficient inference, open-source deployment
Related Terms
large-language-model
mixture-of-experts
More Large Language Models Terms
Speculative Decoding
Using draft model candidates verified by large model
Mixture of Experts
Architecture routing tokens to specialized expert sub-networks
DPO
Alignment method bypassing reward model for preference learning
Prompt Caching
Storing key-value states for repeated prompt prefixes
Tool Use
Capability of LLMs to call external tools and APIs
Constitutional AI
Training AI to follow explicit principles for consistency