Large Language Models
31 views
Mistral
Quick Definition
Efficient open-source LLMs with strong performance
Full Definition
Efficient open-source LLMs by Mistral AI known for strong performance relative to size.
Examples
Mixtral MoE, efficient inference, open-source deployment
Related Terms
large-language-model
mixture-of-experts
More Large Language Models Terms
RoPE
Position encoding using rotation matrices for relative positions
Inference LLM
Using a trained LLM to generate outputs from inputs
Flash Attention
Memory-efficient attention using GPU SRAM block computation
Synthetic Data Generation
Using AI to create artificial training data replicating patterns
Fine-Tuning
Further training pre-trained models on specific domain data
Temperature
Parameter controlling randomness in text generation