Exercises
ex-ch18-01
EasyAn XL-MIMO panel at GHz has aperture m. Compute the Fraunhofer distance . A user is at range m. Is it in the near field or far field?
m.
.
Wavelength
m cm.
Fraunhofer distance
m.
Conclusion
m m, so the user is deep in the near field. The spherical wavefront curvature across the 1.2 m aperture is easily observable and the polar dictionary of Section 18.4 is essential.
ex-ch18-02
EasyA user's true VR on a 1024-antenna XL-MIMO array covers antennas. The detector declares active, of which 180 overlap with the true VR. Using Theorem TLS Estimation Penalty from VR Mismatch with , compute the NMSE of LS estimation with the hard-threshold detector.
The two contributions are (a) size ratio over SNR, (b) miss fraction.
Miss count .
Size ratio term
. Term (a) .
Miss fraction term
Miss count . Miss fraction . Term (b) .
Total NMSE
. Compare with the genie NMSE of : the mismatched detector suffers a 3x penalty.
ex-ch18-03
EasyDerive the local conditional probability of the 2D Ising prior at a site whose four neighbours are with and . Express it as a sigmoid and compute the numerical value.
Sum of neighbour spins
.
Conditional probability
Numerical value
, so . The site is almost certain to be active, driven by its three active neighbours.
ex-ch18-04
EasyA -antenna XL-MIMO array uses square subarrays and serves users. Compute the per-coherence-block flop count of full-aperture MMSE and of plain subarray MMSE, and the speedup factor.
Full-aperture: .
Subarray: .
Full-aperture cost
flops.
Subarray cost
; per-subarray ; per-user ; per-block flops.
Speedup
, matching Theorem TComplexity Reduction from Subarray Decomposition.
ex-ch18-05
MediumA polar-domain dictionary for a -antenna ULA covers azimuth range uniformly with rad and range m logarithmically with ratio . Compute the grid size and the OMP pilot budget for scatterers using .
Angular range width is rad.
Logarithmic range count: .
Angular count
Width rad. rad. .
Range count
, so range bins.
Grid size
.
Pilot budget
symbols. The far-field counterpart would need , so the polar estimator saves about 3x pilot overhead.
ex-ch18-06
MediumGiven the matched-filter LLR , compute the average LLR under the alternative hypothesis () and under the null () for . Use the means and . What is the expected log-ratio under each hypothesis?
Linearity of expectation simplifies everything.
The 'good' detector has .
Null mean
Alternative mean
Interpretation
The gap is nats: about dB of log-likelihood separation between true and false antennas. The MRF coupling amplifies this gap by letting neighbouring antennas pool their evidence.
ex-ch18-07
MediumShow that the raster-order Gibbs sampler of Algorithm AGibbs Sampler for the 2D VR Prior has a stationary distribution equal to the 2D Ising prior of Definition D2D Markov Random Field Prior on the VR Mask. (State the detailed-balance condition, verify it for a single spin flip, and conclude.)
Detailed balance: .
The Gibbs update samples from the correct conditional by construction.
Detailed balance statement
Let be the Ising distribution with Hamiltonian . Let differ from at exactly one site . The Gibbs transition probability is .
Ratio
. By the definition of conditional probability, . A symmetric calculation for gives the same joint factor, so detailed balance holds.
Conclude
The chain is reversible with respect to , aperiodic (self-loops possible when ), and irreducible (any configuration is reachable via single-spin flips). Therefore is the unique stationary distribution and the sampler converges to it.
ex-ch18-08
MediumModify the per-antenna LLR to account for a soft (not binary) fade: the received energy under activation is where the SNR is itself a random variable with distribution (unit-mean Rayleigh power in linear scale). Derive the marginal LLR and compare with the fixed- formula.
Marginalize the chi-square likelihood over .
The marginal under activation is a mixture: .
Likelihood under activation
Non-central with non-centrality and scale has density . Averaging over exponential gives via the standard Laplace transform of the Bessel function.
Null likelihood
(central , mean 1).
Marginal LLR
Comparison
This matches the fixed- formula of Definition DPosterior MRF from Pilot Observations with replaced by its mean . The Rayleigh mixture does not change the LLR form β a particular gift of the exponential prior.
ex-ch18-09
MediumArgue that the M-step of Algorithm AJoint VR + Channel Estimation via EM reduces to a weighted LASSO problem and write it explicitly. Under the weights , show that the step is convex in and can be solved with soft-thresholding (ISTA).
Start from the ELBO expression of Theorem TMonotone Ascent of EM for the Joint Problem.
Differentiate in after substituting the Gaussian likelihood.
Expand the expected log-likelihood
The relevant ELBO term is .
Add the sparsity prior
With a Laplace prior , the M-step minimizes where and .
Convexity and ISTA
The objective is a positive-weighted quadratic plus an term β convex. ISTA iterations are with = Lipschitz constant of the gradient and the soft-thresholding operator. Convergence follows from standard proximal-gradient theory.
ex-ch18-10
HardSuppose you have a fixed pilot budget and want to estimate the channels of two users with completely disjoint VRs. Show that you can assign them the same pilot sequence without any pilot contamination penalty, and compute the resulting factor-of-2 gain in pilot-spectral efficiency.
Two disjoint VRs mean .
The matched-filter output at antenna only sees user with .
Observation model
With identical pilot , the matched-filter output at antenna is . Since at most one of is non-zero (disjoint VRs), the per- antenna observation carries user 's channel uncontaminated by user .
Separation via VR detection
The joint EM of Section 18.5 detects each user's VR mask separately; once detected, the masked observation is clean.
Pilot overhead saving
With orthogonal pilots, two users need . With shared pilots, . The factor-of-2 saving compounds for users whose VRs are pairwise disjoint: the achievable pre-log factor improves by the orthogonal-pilot savings symbols.
Practical caveat
Perfectly disjoint VRs are rare; in practice the MRF posterior has to resolve partially overlapping regions, and the pilot saving is smaller. But the principle β VR structure doing the work that pilot orthogonality does in the stationary regime β is exactly the spatial pilot decontamination of Section 18.5.
ex-ch18-11
HardDerive a closed-form upper bound on the probability that loopy BP on the 2D Ising posterior with external fields converges to the wrong mask. State your bound in terms of the LLR variance and the BP damping factor.
Use Chernoff-type bounds on the aggregate LLR over the VR boundary.
Loopy BP on binary MRFs with attractive coupling is provably exact on trees; the bound here is a local approximation.
Setup
Focus on a single boundary cell between active and inactive regions, containing antennas. The net LLR favoring the wrong decision is . For attractive coupling () the second term is always negative on the boundary of a coherent cluster.
Gaussian approximation
Under the central-limit approximation, is approximately Gaussian with mean and variance where are the LLR mean and standard deviation on a single antenna.
Error bound
The probability that loopy BP flips the boundary cell is . This decays exponentially in β the longer the cluster boundary, the harder it is for BP to mislabel it.
Damping factor
With damping factor , each BP sweep moves messages only -fraction toward the fixed point, so the effective boundary signal strength is . The error bound becomes : aggressive damping () stabilizes the iteration but slows the error decay. The XuβCaire paper recommends .
ex-ch18-12
HardShow that in the far-field limit , the polar dictionary collapses to the far-field DFT dictionary up to a range-independent phase factor. Conclude that polar-OMP is backwards compatible with far-field sparse recovery.
Expand the quadratic term as .
A range-independent phase factor is absorbed by the gain coefficient.
Quadratic term vanishes
As , for fixed , so . The near-field steering vector becomes , which is exactly the far-field steering vector .
Collapse of the range axis
For any sufficiently large range , the columns of with are numerically indistinguishable. The dictionary degenerates: the entire range dimension maps to a single column per angle. The polar dictionary therefore contains the far-field DFT as a subset, differing only in having extra columns at short ranges.
Backwards compatibility
A far-field user's channel has zero correlation with the short-range columns (they are near-orthogonal to the far-field steering vectors), and its OMP run picks the angular DFT columns exclusively. Thus polar-OMP reduces gracefully to far-field OMP in the far-field limit.
ex-ch18-13
HardA XL-MIMO panel is partitioned into subarrays of size . A user's VR covers a contiguous block of antennas. How many subarrays intersect the VR (worst case and best case over the block's position)? Compute the speedup of VR-pruned subarray MMSE over plain subarray MMSE.
Best case: VR aligned with the subarray grid.
Worst case: VR straddles four subarrays along each axis.
Best case: aligned
: the VR occupies 2 subarrays along each axis, covering subarrays. .
Worst case: straddled
antennas straddle 3 subarrays along each axis (e.g., 2 in subarray 1, 8 in subarray 2, 4 in subarray 3). .
Speedup over plain subarray
Plain subarray uses all tiles. VR-pruned uses only . Best-case speedup: x. Worst-case speedup: x. Combined with the factor over full-aperture MMSE, VR pruning delivers x total speedup in the best case.
ex-ch18-14
MediumVerify numerically that the sigmoid cost is the negative KL divergence between the variational and the posterior restricted to a single antenna, up to a constant. Use this to explain why the BP marginals maximize the ELBO's per-antenna contribution.
Compute explicitly for binary with mass .
Differentiate in and set to zero.
KL divergence
where from the local posterior.
Minimizer
gives . This is exactly the per-antenna BP marginal without coupling.
ELBO contribution
Substituting into the ELBO yields , confirming that BP maximizes the ELBO's local contribution. Adding coupling couples neighbouring updates and is precisely what loopy BP does on the full grid.
ex-ch18-15
Challenge(Mini-project.) Implement the joint EM estimator of Algorithm AJoint VR + Channel Estimation via EM in Python and reproduce the NMSE curve of the interactive plot πJoint EM vs Sequential Estimation: NMSE vs VR Mismatch. Compare against a sequential baseline and a full-aperture LS estimator. Report the ELBO trajectory over iterations and verify monotone ascent.
Use the vr_mrf_sample sim function as a starting point for the MRF part.
The sum-product BP can be replaced by a simpler mean-field update without changing the macro-level behaviour.
For the channel step, ISTA with 100 iterations is sufficient at .
Data generation
Sample a VR mask from the 2D Ising prior with . Draw the channel on the mask from β or from the polar dictionary with 4 random scatterers for a near-field test. Corrupt with Gaussian noise at the chosen SNR.
EM loop
Implement the E-step as 10 sweeps of loopy sum-product on the Ising graph. Implement the M-step as 100 iterations of ISTA on the weighted LASSO. Start from a polar-OMP estimate.
Benchmarks
Sequential baseline: run the VR detector once (threshold the raw LLRs), then do LS on the detected support. Full-aperture LS: ignore the mask.
Reporting
Plot NMSE vs SNR (e.g., to dB in -dB steps). The joint EM should lie within dB of the genie, the sequential detector should lag by β dB at moderate SNR, and the LS baseline should be much worse. Plot the ELBO vs EM iteration and verify monotonicity.
ex-ch18-16
MediumThe spatial correlation matrix of a user whose VR covers antennas has at most non-zero eigenvalues. Show that MMSE estimation on the full aperture is equivalent to MMSE restricted to the support of , provided the noise outside the support is filtered out.
Write with having only columns.
Apply the Woodbury identity or just inspect the structure.
Low-rank decomposition
with , .
MMSE formula
. Using Woodbury, .
Projection
Plugging back gives , which depends on only through β the projection onto the VR support. The remaining dimensions of carry only noise and are discarded exactly by the MMSE.