Deep Dive: Overcoming Oscillations in QAT

2024-07-18

Appendix

A.2. Relation of the distance and frequency

A.3. Different learning rates and multiplicative regularization methods

• Learning rate only influences the amplitude and not the frequency of oscillations.

---