Bit (bit)

The bit is the fundamental unit of information. Its symbol is bit, and its name is a contraction of binary digit, coined by the statistician John Tukey and put into print by Claude Shannon in his 1948 paper A Mathematical Theory of Communication, the work that founded information theory.

A bit is the amount of information carried by a single choice between two equally likely possibilities. A coin landing heads or tails, a switch open or closed, a voltage high or low: each of those settles one bit. That definition is what makes the bit a unit rather than a mere convention of notation. It measures how much uncertainty an answer removes, and it does so in a way that is independent of what the question was about.

Shannon's insight was that this could be counted. A message drawn from an alphabet of thirty-two equally likely symbols carries five bits per symbol, because thirty-two is two to the fifth. If the symbols are not equally likely — as letters in English are not — the average drops, and that gap between the naive count and the true average is exactly what compression exploits. A well-compressed file is one from which the redundant bits have been removed.

In hardware the bit is a physical state: a charge trapped on a floating gate in flash memory, the direction of magnetisation of a domain on a hard disc platter, a pit or land on an optical disc, a pulse of light present or absent in a fibre. All of these encode the same abstract quantity, which is why data can move between them without loss.

Bits are almost never counted singly in storage. They are grouped into octets of eight, and storage capacity is quoted in octets or their multiples. Transmission is different: network and interface speeds are quoted in bits per second, so a connection described as 100 megabits per second delivers about 12.5 megaoctets per second. Confusing the two is the commonest arithmetic error in the whole field.

Where single bits do get counted is in specifications of precision and range. A colour channel with 8 bits holds 256 levels; one with 10 bits holds 1,024. Audio at 16 bits per sample has about 96 decibels of dynamic range, and at 24 bits about 144. A 64-bit address can name about 18 quintillion locations. In every case, each added bit doubles what can be distinguished.

One bit equals 0.125 octets, 0.001 kilobits, or about 0.0009766 kibibits.

Bit conversion table