Monday, July 12, 2010

Information Theory

What is information ??

Logically speaking information is inversely propotional to uncertainity.When the uncertainity about a certain thing or even dissappears then what we have is information.

For instance when you flip a coin you are uncertain whether it would show heads or tails. The moment it shows heads/tails the uncertainity is gone and what you have left is information , information that the coin showed up HEADS..

Now suppose you have an unfair coin(heads on both  side). Now in this case there is no uncertainity because the coin will always show up heads. Since in this case uncertainity is zero thus we have no information to attain.

To be continued....

No comments: