Blog

Apr 28, 2024

Divergences (dissimilarities, discrepancies, discriminations, displacements, diversities, affinities)

Posted by in category: futurism

Taxonomy of principal distances and divergences v/ Frank Nielsen.


We define duo Bregman divergences, duo Fenchel-Young divergences, duo Jensen divergences. We show how those divergences occur naturally when calculating the Kullback-Leibler divergence and skew Bhattacharyya distances between densities belonging to nested exponential families. We report the KLD between truncated normal distributions as a duo Bregman divergence. Demo code:

Comments are closed.