Forward vs. Reverse KL Divergence: Geometry, Mechanics & Generative Models
Why unimodal fits stretch across empty valleys, the exact log 2 threshold where mode-seeking kicks in, and how Forward vs. Reverse KL shapes diffusion, distillation, and RLHF.