RLHF
Quick Definition
Aligning LLMs with human preferences using reinforcement learning
Full Definition
Reinforcement Learning from Human Feedback aligning language models with human preferences.
Examples
ChatGPT alignment, preference learning, safety tuning
Related Terms
reinforcement-learning
reward-model
alignment
More Large Language Models Terms
Grounding LLM
Connecting LLM outputs to verifiable external sources
Structured Output
Generating LLM responses in predefined machine-readable formats
Masked Language Model
Training objective predicting randomly masked input tokens
Nucleus Sampling
Generation using cumulative probability threshold for token selection
Quantization LLM
Reducing LLM weight precision for efficient inference
Training LLM
Adjusting parameters on large datasets to learn language