The more improbable the message, the less "compressible" it is, and the more bandwidth it requires. This is Shannon's point: the essence is its improbability.
William PoundstoneKelly was aware that there is one type of favorable bet available to everyone; the stock market.
William PoundstoneUse "entropy" and you can never lose a debate, von Neumann told Shannon - because no one really knows what "entropy" is.
William Poundstone