In order to understand information, we must define it; bit in order to define it, we must first understand it. Where to start?

The solution of the Monty Hall problem hinges on the concept of information, and more specifically, on the relationship between added information and probability.

Claude Shannon, the founder of information theory, invented a way to measure 'the amount of information' in a message without defining the word 'information' itself, nor even addressing the question of the meaning of the message.

As every bookie knows instinctively, a number such as reliability - a qualitative rather than a quantitative measure - is needed to make the valuation of information practically useful.

The switch from 'steam engines' to 'heat engines' signals the transition from engineering practice to theoretical science.

Both induction and deduction, reasoning from the particular and the general, and back again from the universal to the specific, form the essence to scientific thinking.

This is not what I thought physics was about when I started out: I learned that the idea is to explain nature in terms of clearly understood mathematical laws; but perhaps comparisons are the best we can hope for.