The Gaussian Distribution β Deep Treatment
The Single Most Important Distribution
The Gaussian distribution deserves a section of its own because it is, without exaggeration, the most important distribution in engineering and applied mathematics. In digital communications, the Q-function β the Gaussian tail probability β appears in virtually every bit error rate expression. Tight bounds on translate directly into tight performance bounds for communication systems.
Definition: Standard Normal Distribution and CDF
Standard Normal Distribution and CDF
The standard normal random variable has PDF
and CDF
For a general : .
The CDF has no closed-form expression, which is why the Q-function and its bounds are so important.
Definition: The Q-Function
The Q-Function
The Q-function is the tail probability of the standard normal:
Key properties:
- .
- (symmetry).
- for all (the tail never vanishes).
- for .
Definition: Error Function and Complementary Error Function
Error Function and Complementary Error Function
The error function and complementary error function are:
The relationship to the Q-function is:
Theorem: Bounds on the Q-Function
For :
Chernoff bound:
Mills ratio (tight upper and lower bounds):
Asymptotic expansion (dominant term):
All bounds share the same exponential decay . The Chernoff bound is the simplest (one line to prove) but loose by a polynomial factor. The Mills ratio bounds are tight to within a factor of 2 for moderate and converge as .
Chernoff bound
For any : by Markov's inequality. Since , . Optimizing over : set to get . A tighter constant of follows from symmetry.
Mills ratio upper bound
Write . For , we have , so ... but we use the bound in the opposite direction. Integrate by parts: . With , (so ):
Mills ratio lower bound
Continuing the integration by parts one more step yields the lower bound. The pattern produces an alternating series, establishing the sandwich.
Theorem: Craig's Representation of the Q-Function
For :
This integral representation has a fixed, finite integration range regardless of , which makes it ideal for numerical integration and for averaging over fading distributions. The semi-infinite integral in the standard definition is replaced by a bounded one.
Sketch of proof
Consider where . Write where are polar coordinates with Rayleigh-distributed and uniform on . The event corresponds to a sector of the plane. Integrating the bivariate Gaussian density over this sector in polar coordinates, and performing a change of variable, yields the result.
Craig's Formula in BER Analysis over Fading Channels
Craig's representation of the Q-function is essential for computing average bit error rates over fading channels. The key advantage is that the SNR appears only inside the exponential, so averaging over a fading distribution amounts to computing the moment generating function of times the fading power β which often has a closed-form expression for Rayleigh, Ricean, and Nakagami fading. This technique is used extensively in the BER analysis of bit-interleaved coded modulation (BICM), a scheme proposed by Caire, Taricco, and Biglieri that remains the dominant coded modulation strategy in modern wireless standards (LTE, 5G NR, Wi-Fi 6).
Example: Computing Error Probabilities with the Q-Function
A BPSK signal is received with SNR dB. Compute the bit error probability.
Convert SNR to linear scale
.
Apply the BPSK BER formula
.
Evaluate using the asymptotic approximation
. The exact value is β the asymptotic bound is quite tight at this SNR.
and Its Bounds
Compare the Q-function with the Chernoff bound and Mills ratio bounds. Notice how the Mills ratio bounds sandwich tightly, while the Chernoff bound is looser but simpler.
Parameters
Common Mistake: Q-Function vs. erfc Conversion
Mistake:
Writing (missing the factor of ).
Correction:
The correct relationship is . The factor of is easy to forget and produces a factor-of-2 error in BER calculations.
Quick Check
What is ?
by the symmetry of the standard normal PDF. So .
Computing the Q-Function in Practice
In practice, the Q-function is computed using the complementary error function:
. Most numerical libraries (NumPy, MATLAB)
provide erfc() with full double-precision accuracy. Never approximate the Q-function
by integrating the Gaussian PDF numerically β this is both slow and inaccurate for
large where the tail probability is very small (e.g., ).
Use scipy.special.erfc or scipy.stats.norm.sf in Python, or qfunc in MATLAB.
Historical Note: Craig's 1991 Formula
1991John W. Craig published his elegant integral representation of the Q-function in a brief 1991 note in the journal Military Communications. The formula was quickly adopted by the wireless communications community because it dramatically simplified the computation of average error rates over fading channels β a problem that had previously required case-by-case integration for each fading model. Craig's formula unified these calculations and became a standard tool in textbooks by Proakis, Simon, and Goldsmith.
Q-Function
: the tail probability of the standard normal distribution. Appears in every BER expression for Gaussian channels.
Key Takeaway
The Q-function decays like a Gaussian times a polynomial pre-factor. The Chernoff bound () is the simplest upper bound and suffices for order-of-magnitude estimates. For tighter analysis, the Mills ratio bounds or Craig's representation are the tools of choice.