Common Continuous Distributions
A Catalog of Distributions
Why study specific distribution families? Because real-world phenomena — from noise in communication channels to inter-arrival times in queueing networks — are well-modeled by a small number of canonical distributions. Each family arises from a natural structural assumption (e.g., memorylessness for the exponential, maximum entropy for the Gaussian). Knowing these families and their properties is the probabilist's toolkit.
Definition: Uniform Distribution
Uniform Distribution
A random variable has the uniform distribution on , written , if its PDF is
The CDF is for . Mean: . Variance: .
The uniform distribution is the simplest continuous distribution and plays a fundamental role in simulation: by the inverse transform method, any continuous distribution can be generated from samples.
Definition: Exponential Distribution
Exponential Distribution
A random variable has the exponential distribution with rate , written , if its PDF is
CDF: for . Mean: . Variance: .
Theorem: Memoryless Property of the Exponential
A continuous random variable taking values in is memoryless, meaning
if and only if for some .
Given that the event has not occurred in the first time units, the residual waiting time has the same distribution as the original. The exponential distribution "forgets" how long it has already waited.
Sufficiency: verify for $\text{Exp}(\lambda)$
Necessity: derive the functional equation
Let . The memoryless property gives . Since is non-increasing and right-continuous with , the only solution is for some .
Exponential as the Continuous Geometric
The memoryless property of the exponential is the continuous analog of the memoryless property of the geometric distribution. Indeed, the exponential arises as the scaling limit of the geometric: if and , then as , in distribution. This connection is revisited in Chapter 11 (Poisson processes).
Definition: Gaussian (Normal) Distribution
Gaussian (Normal) Distribution
A random variable has the Gaussian (or normal) distribution with mean and variance , written , if its PDF is
The standard normal distribution is .
The Gaussian is the most important distribution in all of probability and engineering. Its privileged status stems from three independent facts: (1) it is the limit of sums of i.i.d. random variables (CLT), (2) it maximizes entropy under a second-moment constraint, and (3) it is closed under linear operations.
Definition: Gamma Distribution
Gamma Distribution
A random variable has the Gamma distribution with shape and rate , written , if its PDF is
where .
Mean: . Variance: .
Special cases: yields . When and , we get the chi-squared distribution with degrees of freedom. The Gamma distribution is the sum of independent variables (for integer ).
Definition: Beta Distribution
Beta Distribution
A random variable has the Beta distribution with parameters , written , if its PDF is
where .
Mean: . Variance: .
The Beta distribution is the natural distribution on . It is the conjugate prior for the Bernoulli likelihood in Bayesian inference. The special case gives .
Definition: Student- Distribution
Student- Distribution
A random variable has the Student- distribution with degrees of freedom, written , if its PDF is
Mean: (for ). Variance: (for ).
As , . The Student- has heavier tails than the Gaussian, making it important in robust estimation and small-sample inference. For , we recover the Cauchy distribution (no finite mean).
Definition: Rayleigh Distribution
Rayleigh Distribution
If are independent, then has the Rayleigh distribution with parameter :
Mean: . Variance: .
The Rayleigh distribution models the envelope (amplitude) of a complex Gaussian signal. In wireless communications, when a transmitted signal reaches the receiver via many independent scattered paths with no line-of-sight component, the received envelope is Rayleigh-distributed.
Definition: Ricean Distribution
Ricean Distribution
If and are independent with (the line-of-sight amplitude), then has the Ricean distribution with parameters and :
where is the zeroth-order modified Bessel function of the first kind. The K-factor quantifies the ratio of direct to scattered power. When , the Ricean reduces to the Rayleigh.
Definition: Nakagami- Distribution
Nakagami- Distribution
A random variable has the Nakagami- distribution with shape and spread if
For , this is the Rayleigh distribution with . The Nakagami- is more flexible than the Rayleigh or Ricean because it can model a wider range of fading severities through the single parameter .
Common Continuous Distributions at a Glance
| Distribution | Mean | Variance | Key Property | |
|---|---|---|---|---|
| Maximum entropy on | ||||
| Memoryless | ||||
| Max entropy under 2nd moment | ||||
| Sum of exponentials | ||||
| Conjugate prior for Bernoulli | ||||
| Rayleigh() | Envelope of complex Gaussian |
Fading Distribution Comparison
Compare the Rayleigh, Ricean, and Nakagami- distributions — the three canonical fading models in wireless communications. Adjust the K-factor and Nakagami parameter to see how the distributions interpolate between severe and mild fading.
Parameters
Ratio of LOS to scattered power
Exponential Memoryless Property
Visualize the memoryless property: the conditional survival function always equals , regardless of how long we have already waited.
Parameters
Historical Note: The Gaussian: From Errors to Everything
1733–1900The Gaussian distribution was discovered independently by de Moivre (1733, as an approximation to the binomial), Laplace (1774, in the context of measurement errors), and Gauss (1809, in the theory of least squares for astronomical observations). The name "normal distribution" was popularized by Karl Pearson and Francis Galton in the late 19th century, though many mathematicians and statisticians (including Gauss himself) would have objected to the implication that other distributions are "abnormal."
Common Mistake: Rate vs. Mean Parametrization of the Exponential
Mistake:
Confusing (rate parametrization, mean ) with the mean parametrization (mean , rate ) used in some texts.
Correction:
In this book (following Caire), we always use the rate parametrization: , mean . When reading other sources, check which convention is in use.
Quick Check
Which distribution is the special case ?
Setting gives for , which is the exponential PDF.
Why This Matters: Why Fading Distributions Matter
In wireless communications, the received signal amplitude depends on the propagation environment. When many scatterers contribute with no dominant path, the central limit theorem yields a complex Gaussian signal, whose envelope is Rayleigh-distributed. A strong line-of-sight component shifts the model to Ricean. The Nakagami- family provides additional flexibility to fit empirical data. Every bit error rate and outage probability expression in fading channels (Book 1, Chapters 6 and 10) involves the PDF or CDF of one of these distributions.
Memoryless Property
A distribution is memoryless if . The only continuous memoryless distribution is the exponential. The only discrete memoryless distribution is the geometric.
Related: Exponential Distribution
Exponential Distribution
: PDF for . The unique continuous memoryless distribution. Models inter-arrival times in Poisson processes.
Related: Memoryless Property