SearchOnMath

Bayes's theorem, \(P(A|B) = \frac{P(B|A)P(A)}{P(B)}\), relates the two conditional probabilities involving events \(A\) and \(B\).

The Taylor series for an infinitely differentiable \(f\) at point \(a\), given by \(f(x) = \sum_{k=0} ^ {\infty} \frac {f^{(k)}(a)}{k!} \, (x-a)^{k}\), allows \(f\) to be expressed in terms of its derivatives.

Shannon's entropy, \(H(X) = -\sum_{x \in \mathbf{X}} p(x) \log p(x)\), measures how informative the mass function \(p\) is about the occurrence of the possible values of variable \(X\).