SearchOnMath

The Taylor series for an infinitely differentiable \(f\) at point \(a\), given by \(f(x) = \sum_{k=0} ^ {\infty} \frac {f^{(k)}(a)}{k!} \, (x-a)^{k}\), allows \(f\) to be expressed in terms of its derivatives.

The natural logarithm can be expanded into a series, yielding \(\ln(1+x) = \sum_{k=1}^{\infty} \frac{(-1)^{k+1}x^k}{k}\).

Shannon's entropy, \(H(X) = -\sum_{x \in \mathbf{X}} p(x) \log p(x)\), measures how informative the mass function \(p\) is about the occurrence of the possible values of variable \(X\).