Almost ten years ago I wrote an entry about the “1 bit = 6 dB” rule of thumb. This rule states that for each bit you add to a signal, you add 6 dB of signal to noise ratio.

The first derivation I gave then was focused on the noise, where the noise maximal amplitude was proportional to the amplitude represented by the last bit of the (encoded) signal. Let’s now derive it from the most significant bit of the signal to its least significant.

Let us suppose that the first bit represents half the maximum signal amplitude, . Then the second one should represent a quarter, and the third an eighth, etc. For bits, then, the maximum amplitude is

,

Or, alternatively,

,

which means that the rest of the amplitude—noise—is

.

Recall, the signal-to-noise ratio, the SNR, is given by the ratio of the powers of the signal and the noise, that is:

.

Substituting and for their expressions parameterized by we get that

,

where the s cancel out. We can rewrite the ratio as

.

To get decibels out of the expression of the power, we write

,

or, in our case,

.

Let us see what this expression yields.

.

Since , and goes rapidly to zero, we can write

.

* * *

So how fast does the last part, . go to zero? Intuitively, we should agree that as grows, gets closer and closer to one, and that, therefore, goes to zero. But how fast? A quick plot reveals the following picture:

which indeed goes rapidly to zero. When we combine the two results, we see that the full expression and the approximation go quite agree as soon as is somewhat large:

* * *

So when a device tells you it has a SNR of 60 dB (like an 1980s cassette deck), what it really tells you is that it’s gives you about 10 bits resolution. CDs, with 16 bits, gives you approximately 96 dB; 24 bits bring you in the realm of 144 dB. Well, good luck finding a device that will indeed guarantee this kind of SNR.

This entry was posted on Tuesday, March 28th, 2017 at 13:14 pm and is filed under data compression, Mathematics. You can follow any responses to this entry through the RSS 2.0 feed.
You can leave a response, or trackback from your own site.