Prerequisites & Notation

Before You Begin

This chapter assumes familiarity with the following topics. If any item feels unfamiliar, revisit the linked material first.

  • Neural scene representations: NeRF, signed distance functions, volume rendering, and the rendering equation (Chapter 24) (Review ch24)

    Self-check: Can you write the NeRF volume rendering integral and explain what the MLP learns?

  • Differentiable rendering and the analysis-through-synthesis pipeline for inverse problems (Chapter 25) (Review ch25)

    Self-check: Can you explain how gradients flow through a differentiable renderer to update scene parameters?

  • The unified forward model y=Ac+w\mathbf{y} = \mathbf{A}\mathbf{c} + \mathbf{w} and Kronecker structure of A\mathbf{A} (Chapter 7) (Review ch07)

    Self-check: Can you describe the measurement model for a MIMO-OFDM sensing system and identify the Kronecker factors?

  • Scene representation and scattering models: voxel grids, reflectivity fields, and the Born approximation (Chapter 8) (Review ch08)

    Self-check: Can you explain the difference between specular and diffuse scattering in the context of RF imaging?

Notation for This Chapter

Symbols introduced in this chapter. See also the NGlobal Notation Table master table in the front matter.

SymbolMeaningIntroduced
G={(μk,Σk,αk,fk)}k=1N\mathcal{G} = \{(\boldsymbol{\mu}_k, \boldsymbol{\Sigma}_k, \alpha_k, \mathbf{f}_k)\}_{k=1}^NSet of NN 3D Gaussians with centres, covariances, opacities, and feature vectorss01
μkR3\boldsymbol{\mu}_k \in \mathbb{R}^3Centre (mean) of the kk-th Gaussians01
ΣkR3×3\boldsymbol{\Sigma}_k \in \mathbb{R}^{3 \times 3}Covariance matrix of the kk-th Gaussians01
αk[0,1]\alpha_k \in [0,1]Opacity of the kk-th Gaussians01
fk\mathbf{f}_kFeature vector (colour or RF attribute) of the kk-th Gaussians01
Gk(u)G_k(\mathbf{u})2D projected Gaussian evaluated at pixel u\mathbf{u}s01
PdB(u)P_{\text{dB}}(\mathbf{u})Rendered received power in dB at pixel/location u\mathbf{u}s02
T(μk,Σk)\mathcal{T}(\boldsymbol{\mu}_k, \boldsymbol{\Sigma}_{k})Tensorial RF field decomposition of a Gaussians03
Ym(d^)Y_\ell^m(\hat{\mathbf{d}})Spherical harmonic of degree \ell and order mm in direction d^\hat{\mathbf{d}}s03
P^k(d^)\hat{P}_k(\hat{\mathbf{d}})Directional power pattern of the kk-th Gaussian scatterers03
σRCS,k\sigma_{\text{RCS},k}Radar cross-section attribute of the kk-th Gaussian in RadarSplats04