Bregman Divergences
Tags: #machine learningEquation
$$d_{\phi}(z,z^{'})=\phi(z) - \phi(z^{'})-(z-z^{'})^{T} \nabla \phi(z^{'})$$Latex Code
d_{\phi}(z,z^{'})=\phi(z) - \phi(z^{'})-(z-z^{'})^{T} \nabla \phi(z^{'})
Have Fun
Let's Vote for the Most Difficult Equation!
Introduction
Bregman divergences
d_{\phi}(z,z^{'})=\phi(z) - \phi(z^{'})-(z-z^{'})^{T} \nabla \phi(z^{'})
Mixture Density Estimation
p_{\phi}(y=k|z)=\frac{\pi_{k} \exp(-d(z, \mu (\theta_{k})))}{\sum_{k^{'}} \pi_{k^{'}} \exp(-d(z, \mu (\theta_{k})))}
Explanation
The prototypi- cal networks algorithm is equivalent to performing mixture density estimation on the support set with an exponential family density. A regular Bregman divergence d_{\phi} is defined as above. \phi is a differentiable, strictly convex function of the Legendre type. Examples of Bregman divergences include squared Euclidean distance and Mahalanobis distance.
Discussion
Comment to Make Wishes Come True
Leave your wishes (e.g. Passing Exams) in the comments and earn as many upvotes as possible to make your wishes come true
-
Justin TurnerI wish for the knowledge to pass this exam.Dylan Griffiths reply to Justin TurnerBest Wishes.2023-05-24 00:00:00.0 -
Janice ReedI hope the odds are in my favor to pass this exam.Ernest White reply to Janice ReedBest Wishes.2023-02-22 00:00:00.0 -
Emily WheelerAiming for the stars with this test.Annie Mason reply to Emily WheelerYou can make it...2023-06-20 00:00:00.0
Reply