DFT Codebook Estimation

All Elements On, All the Time

ON/OFF wastes (Nβˆ’1)/N(N-1)/N of the RIS aperture during every pilot slot β€” a consequence of activating only one element at a time. The DFT codebook flips this around: during every pilot slot, all NN elements are active, with orthogonal phase patterns across slots. The orthogonality lets the BS extract each element's cascaded channel by a simple inverse DFT, while exploiting the full NN-fold reflection aperture at every pilot slot. The result is a NN-fold improvement in estimation SNR relative to ON/OFF, at the same pilot overhead Ο„p=N\tau_p = N.

Definition:

DFT-Codebook Pilot Design

Let F∈CNΓ—N\mathbf{F} \in \mathbb{C}^{N \times N} be the normalized NN-point DFT matrix, [F]n,k=1Neβˆ’j2Ο€nk/N[\mathbf{F}]_{n,k} = \frac{1}{\sqrt{N}} e^{-j 2\pi n k / N}.

In the DFT-codebook protocol, the tt-th RIS configuration is Ο•(t)=N ft\boldsymbol{\phi}^{(t)} = \sqrt{N}\, \mathbf{f}_t, where ft\mathbf{f}_t is the tt-th column of F\mathbf{F}. That is, Ο•n(t)=eβˆ’j2Ο€nt/N\phi_n^{(t)} = e^{-j 2\pi n t / N} for all n,tn, t.

Every element has unit modulus in every slot; across slots, the phase pattern forms a DFT. The stacked configuration matrix Ξ¦stack=N F\boldsymbol{\Phi}^{\text{stack}} = \sqrt{N}\,\mathbf{F} is unitary (up to scaling): (Ξ¦stack)HΞ¦stack=NI(\boldsymbol{\Phi}^{\text{stack}})^H \boldsymbol{\Phi}^{\text{stack}} = N \mathbf{I}.

The DFT is the unique choice of orthogonal codebook with unit-modulus entries that can be realized by any RIS hardware β€” every element only needs to apply one of NN fixed phases. Crucially, no amplitude variation is required (which would be impossible for a passive RIS). Other unitary codebooks exist (e.g., Hadamard when NN is a power of 2), but DFT is the workhorse choice.

,

Theorem: DFT Codebook Estimator and MSE

Under the DFT-codebook pilot design with unit-power pilots (∣x∣=1|x| = 1) and noise W∼CN\mathbf{W} \sim \mathcal{CN} with per-entry variance Οƒ2\sigma^2, the least-squares estimator

G^H=1N Y FH\hat{\mathbf{G}}^H = \frac{1}{\sqrt{N}}\, \mathbf{Y}\, \mathbf{F}^H

is unbiased with per-element MSE

E[βˆ₯g^nβˆ’gnβˆ₯2]=Nt σ2N Pt.\mathbb{E}\big[\|\hat{\mathbf{g}}_n - \mathbf{g}_n\|^2\big] = \frac{N_t\, \sigma^2}{N\, P_t}.

Compared with the ON/OFF MSE of 2Nt σ2/Pt2N_t\,\sigma^2/P_t, the DFT estimator improves per-element MSE by a factor of 2N2N β€” at the same pilot length Ο„p=N\tau_p = N.

Stacking pilots, the received data is Y=GHΞ¦stack+W\mathbf{Y} = \mathbf{G}^H \boldsymbol{\Phi}^{\text{stack}} + \mathbf{W}. Multiplying on the right by the inverse codebook FH/N\mathbf{F}^H / \sqrt{N} recovers GH\mathbf{G}^H without amplification of noise β€” the DFT is unitary, so βˆ₯WFH/Nβˆ₯F2=βˆ₯Wβˆ₯F2/N\|\mathbf{W} \mathbf{F}^H / \sqrt{N}\|_F^2 = \|\mathbf{W}\|_F^2 / N is the same as before. The signal, however, has been coherently combined across NN slots.

Key Takeaway

DFT codebook beats ON/OFF by a factor of 2N2N in per-element MSE, at identical pilot overhead. The mechanism is that DFT keeps all NN elements active every slot, exploiting coherent reflection for estimation rather than just for data. This is the single biggest practical reason DFT codebooks are the default for RIS estimation in the literature β€” and why the ON/OFF protocol is taught primarily as pedagogical baseline.

Estimation MSE: ON/OFF vs. DFT Codebook

Compare the per-element MSE achieved by the ON/OFF protocol and the DFT-codebook estimator as a function of pilot SNR and NN. The DFT codebook is uniformly better by a factor of 2N2N (log axis makes the separation very clean).

Parameters
128
8
0
30

Example: DFT Codebook Recovery by Hand: N=4N = 4

An N=4N = 4 RIS is probed with the 44-point DFT codebook. The BS has a single antenna (Nt=1N_t = 1). The noiseless received samples are y=[y1,y2,y3,y4]T=GH4F\mathbf{y} = [y_1, y_2, y_3, y_4]^T = \mathbf{G}^H \sqrt{4} \mathbf{F}, where GH=[g1βˆ—,g2βˆ—,g3βˆ—,g4βˆ—]\mathbf{G}^H = [g_1^*, g_2^*, g_3^*, g_4^*] is the row of cascaded channels. Recover GH\mathbf{G}^H from y\mathbf{y}.

Common Mistake: DFT Requires Pilot Synchronization

Mistake:

"Just apply the DFT inverse to any received pilot vector β€” it works for any unitary codebook, not just the DFT specifically."

Correction:

The reconstruction G^H=YFH/N\hat{\mathbf{G}}^H = \mathbf{Y}\mathbf{F}^H/\sqrt{N} assumes that the BS knows exactly which RIS configuration was applied in each pilot slot. If slot timing slips by even one symbol β€” e.g., slot 2 gets misaligned with Ο•(2)\boldsymbol{\phi}^{(2)} β€” the estimator applies the wrong inverse codebook column, producing a systematic bias that does not vanish with more pilots. Synchronization between BS controller and RIS is a real engineering concern. Most deployments use a dedicated control link with known latency.

Historical Note: From Hadamard to DFT

2019–2020

The first RIS estimation papers (Mishra and Johansson, 2019; Jensen and de Carvalho, 2020) used the Hadamard codebook β€” an orthogonal Β±1\pm 1 matrix valid for N=2kN = 2^k. It has the same NN-fold improvement over ON/OFF and only requires Β±1\pm 1 phase states, easily realized by a 1-bit PIN-diode element. The Hadamard transform was the natural choice for the earliest 1-bit RIS prototypes.

The DFT codebook (Zheng and Zhang, 2020) generalizes to any NN and is optimal in the sense that its eigenvectors align with steering-vector structure of plane-wave channels β€” meaning the DFT pilot design implicitly probes angular directions. For RIS hardware with at least 2-bit phase control, DFT is the preferred choice; for 1-bit hardware, Hadamard is equally good. Both give the same O(N)\mathcal{O}(N) pilot-length lower bound.

πŸ”§Engineering Note

DFT in Deployed Panels

Modern RIS prototypes and pre-commercial panels use DFT-based pilot sequences as the default. Practical notes:

  • The DFT requires continuous or at least fine-resolution phase shifts (for N=256N = 256, phase step of ∼1.4∘\sim 1.4^\circ). Low-resolution (B=2B = 2-bit) hardware approximates DFT by rounding to nearest grid phase; the resulting non-orthogonality adds ∼1Β dB\sim 1\text{ dB} estimation MSE penalty.
  • Pilots are interleaved with the control link: the BS tells the RIS controller to cycle through the DFT columns, one per pilot symbol.
  • For high-rate updates, the codebook can be pre-programmed in RIS firmware and triggered by a single synchronization signal.
Practical Constraints
  • β€’

    Control-link bandwidth for Ο„p=N\tau_p = N updates at ∼10 ms\sim 10\,\text{ms} coherence: BN/0.01=100BNB N / 0.01 = 100 B N bps (∼300\sim 300 kbps at B=3B=3, N=1024N=1024).

  • β€’

    Practical DFT approximation error with B=3B = 3-bit: ∼0.3 dB\sim 0.3\text{ dB} MSE penalty.

  • β€’

    Synchronization jitter tolerance: Β±1\pm 1 symbol; beyond this, orthogonality breaks.