Common
Evidence lower bound
Lower bound on the log-likelihood of some observed data
Evidence lower bound
In variational Bayesian methods, the evidence lower bound (often abbreviated ELBO, also sometimes called the variational lower bound or negative variational free energy) is a useful lower bound on the log-likelihood of some observed data. The ELBO is useful because it provides a guarantee on the worst-case for the log-likelihood of some distribution (e.g. p ( X ) {\displaystyle p(X)} ) which models a set of data. The actual log-likelihood may be higher (indicating an even better fit to the distribution) because the ELBO includes a Kullback-Leibler divergence (KL divergence) term which decreases the ELBO due to an internal part of the model being inaccurate despite good fit of the model overall. Thus improving the ELBO score indicates either improving the likelihood of the model p ( X ) {\displaystyle p(X)} or the fit of a component internal to the model...
Open boosters, collect cards and trade them. Free to play.
Play for free