Prerequisites & Notation

Before You Begin

Chapter 10 develops the secure-aggregation protocol — the production-standard privacy mechanism for federated learning. The prerequisites are Shamir secret sharing (Chapter 3), gradient aggregation (Chapter 6), and the FL paradigm (Chapter 9). Readers who completed the privacy-motivation section 9.4 will find this chapter the natural next step.

  • Shamir secret sharing (Chapter 3 §§3.1–3.3)(Review ch03)

    Self-check: State the (t,n)(t, n)-threshold guarantee of Shamir's scheme in mutual-information terms.

  • Gradient aggregation in distributed SGD (Chapter 6)(Review ch06)

    Self-check: Why is G=kgk\mathbf{G} = \sum_k \mathbf{g}_k the only quantity the master needs from an aggregation round?

  • Federated learning overview (Chapter 9)(Review ch09)

    Self-check: Why is FL not privacy-preserving by default?

  • Basic finite-field arithmetic(Review ch03)

    Self-check: Compute 5+7(mod11)5 + 7 \pmod{11} and find the additive inverse of 33 in F11\mathbb{F}_{11}.

  • Diffie–Hellman key exchange (basic idea)

    Self-check: Two parties, public values g,pg, p: can they derive a shared secret known only to them? What is the adversary's computational problem?

Notation for This Chapter

Secure-aggregation notation extends Chapter 9's FL conventions. We introduce pairwise mask seeds rij\mathbf{r}_{ij} and Shamir shares of these seeds for dropout handling. TT is the privacy threshold (number of colluding parties the scheme tolerates); δ\delta is the expected user-dropout rate.

SymbolMeaningIntroduced
nnNumber of users in the rounds01
gkRd\mathbf{g}_k \in \mathbb{R}^dUser kk's local gradient (private input)s01
G=kgk\mathbf{G} = \sum_k \mathbf{g}_kTarget aggregate (server's only authorized output)s01
rij\mathbf{r}_{ij}Pairwise random mask between users ii and jjs02
g~k\tilde{\mathbf{g}}_kUser kk's masked upload to the servers02
TTPrivacy threshold (server + up to TT users may collude)s01
δ[0,1)\delta \in [0, 1)Expected dropout rate per rounds03
St\mathcal{S}_tSet of users surviving round tts03
Dt\mathcal{D}_tSet of users dropping out at round tts03
bk(i)b_k^{(i)}Shamir share of user ii's seed held by user kks03
RaggR_{\text{agg}}Per-round aggregate communication (normalized by dd)s04