Large Language Models
33 views
Constitutional AI
Quick Definition
Training AI to follow explicit principles for consistency
Full Definition
Training AI to follow explicit principles or a constitution for consistent helpful behavior.
Examples
principle-based alignment, self-critique, safety training
Related Terms
ai-alignment
rlhf
responsible-ai
More Large Language Models Terms
Chain-of-Thought Prompting
Technique encouraging step-by-step reasoning in LLMs
Beam Search
Search algorithm exploring multiple output sequences
RAG
Enhancing LLMs by retrieving relevant external knowledge
WordPiece
Subword tokenization splitting words into frequent units
QLoRA
Combining 4-bit quantization with LoRA for efficiency
Top-K Sampling
Generation strategy considering top k most probable tokens