Prerequisites & Notation

Before You Begin

This chapter applies asymptotic random matrix tools to estimation and detection problems. The reader should be comfortable with the LMMSE estimator (Chapter 7), the LASSO and 1\ell_1-minimization (Chapter 14), and basic facts about the spectra of Hermitian matrices. Familiarity with the Stieltjes transform (Book FSP, Chapter 21) is helpful but not strictly required — the key identities are re-derived here.

  • LMMSE estimator and the Wiener-Hopf equations(Review ch07)

    Self-check: Can you write the LMMSE estimator of x\mathbf{x} from y=Hx+w\mathbf{y} = \mathbf{H}\mathbf{x} + \mathbf{w} and compute its MSE?

  • LASSO and the 1\ell_1 norm(Review ch14)

    Self-check: Can you state the LASSO estimator and explain why the 1\ell_1 penalty promotes sparsity?

  • Structured sparsity and block-sparse recovery(Review ch15)

    Self-check: Can you explain why 2,1\ell_{2,1} regularization recovers block-sparse signals?

  • Eigenvalue decomposition and SVD

    Self-check: Can you relate the singular values of A\mathbf{A} to the eigenvalues of AHA\mathbf{A}^H\mathbf{A}?

  • Stieltjes transform of a probability measure

    Self-check: Can you write the Stieltjes transform m(z)=(xz)1dμ(x)m(z) = \int (x-z)^{-1}\,d\mu(x) and invert it via Plemelj's formula?

  • Convergence in distribution (weak convergence of measures)

    Self-check: Can you distinguish almost-sure convergence of empirical spectral distributions from convergence in probability?

Notation for This Chapter

Key symbols used in this chapter. We work in a double asymptotic regime where matrix dimensions grow jointly at a fixed ratio, so ratios like β=nt/nr\beta = n_t/n_r will appear everywhere.

SymbolMeaningIntroduced
N,MN, MMatrix dimensions (rows ×\times columns); the asymptotic regime sends both to infinity with M/NδM/N \to \deltas01
δ=M/N\delta = M/NAspect ratio (undersampling ratio in compressed sensing)s01
ρ=s/M\rho = s/MNormalized sparsity (fraction of measurements equal to sparsity level)s02
β=nt/nr\beta = n_t/n_rRatio of transmit to receive antennas in MIMOs01
mμ(z)m_\mu(z)Stieltjes transform of the measure μ\mus01
FN(x)F_N(x)Empirical spectral distribution of an N×NN \times N matrixs01
SNR\text{SNR}Signal-to-noise ratio per symbols01
ηMP(;)\eta_{\text{MP}}(\cdot; \cdot)Marchenko-Pastur η\eta-transform (limiting SINR functional)s01
Rμ(z),Sμ(z)R_\mu(z), S_\mu(z)R-transform and S-transform of a probability measure μ\mus03
ρ(δ)\rho^*(\delta)Donoho-Tanner phase transition curves02
A\mathbf{A}Measurement / sensing matrix (Gaussian, M×NM \times N)s02
σ2\sigma^2Additive noise variances01