October 8, 2026 · x.com
Gradient compression cuts network demand in pretraining
A post published on December 23, 2025, reports using gradient compression in pretraining while maintaining high efficiency with one quarter of the stated network bandwidth.