October 8, 2026 · arxiv.org
CE-GPPO aims to preserve gradients in LLM RL
Published on October 30, 2025, the paper presents CE-GPPO, a method addressing low-probability token gradients discarded by PPO clipping and coordinating policy entropy during training.