ENCYCLOPEDIA 4U .com

Encyclopedia Home Page

Asymptotic equipartition property

The asymptotic equipartition property (AEP) is a direct consequence of the weak law of large numbers and is used extensively in information theory. It can be summed up by the phrase 'Almost everything is almost equally probable.'

Given i.i.d random variables with entropy and the probability of observing the sequence , the AEP states that in all probability,

The AEP is used to define the typical set, which is used extensively in theories of compression.

Content on this web site is provided for informational purposes only. We accept no responsibility for any loss, injury or inconvenience sustained by any person resulting from information published on this site. We encourage you to verify any critical information with the relevant authorities.

This article is licensed under the GNU Free Documentation License. It uses material from the Wikipedia article "Asymptotic equipartition property".