This page moved to https://slavadubrov.com/ru/blog/fast-answers/rlhf-vs-dpo-vs-grpo/.