Aligning Large Language Models with Human Preferences: DPO, PPO, and GRPO in Practice
From Pre-training to Post-training
Large language models are usually built in two major stages:
Pre-training: The model learns to predict the next token given a prefix, acquiring broad linguistic competence.
Post-training: After the model can "speak", we teach it to "think". This stage splits into
Supervised Fine-Tuning (S ...
Posted on Wed, 16 Sep 2026 16:42:31 +0000 by tequila