Prerequisites & Notation

Before You Begin

Chapter 5 is the headline chapter of Part II. It develops the polynomial-code construction for coded distributed matrix multiplication β€” arguably the most influential coded-computing result of the last decade. The prerequisites are the finite-field algebra of Chapter 3, the IA framework of Chapter 4, and standard block-matrix arithmetic. Readers who have internalized the "polynomial evaluation + Lagrange interpolation" pattern from Chapter 3 will find the main construction almost immediate.

  • Finite fields and polynomial arithmetic (Chapter 3)(Review ch03)

    Self-check: Can you reconstruct a degree-dd polynomial from d+1d + 1 distinct evaluations over Fq\mathbb{F}_q (with q>dq > d)?

  • IA framework for coded matrix multiplication (Chapter 4 Β§4.2)(Review ch04)

    Self-check: Why is the recovery threshold Kβ‰₯pqK \geq pq?

  • Block-matrix multiplication and transposes

    Self-check: If A=[A1,A2]\mathbf{A} = [\mathbf{A}_1, \mathbf{A}_2] and B=[B1,B2]\mathbf{B} = [\mathbf{B}_1, \mathbf{B}_2], what is ATB\mathbf{A}^T \mathbf{B} in block form?

  • MDS codes (Reed-Solomon)(Review ch09)

    Self-check: What is the minimum distance of an (n,k)(n, k) MDS code, and what does the Singleton bound say?

  • Straggler-tolerance recovery threshold (Chapter 1)(Review ch01)

    Self-check: For i.i.d. exponential completion times, how does E[T(K)]\mathbb{E}[T_{(K)}] vary with K≀NK \leq N?

Notation for This Chapter

The central object is the polynomial p(x)p(x) whose evaluations at distinct points form the workers' encoded matrices. KK is the recovery threshold; (p,q)(p, q) are the column partitions of A,B\mathbf{A}, \mathbf{B}. We use boldface for matrices and distinguish the privacy threshold TT (Section 5.4) from the straggler-tolerance parameter Nβˆ’KN - K.

SymbolMeaningIntroduced
A,B\mathbf{A}, \mathbf{B}Input matrices of sizes mΓ—dm \times d and mΓ—dβ€²m \times d' resp.s01
ATB\mathbf{A}^T \mathbf{B}Desired output, size dΓ—dβ€²d \times d's01
p,qp, qColumn partitions of A\mathbf{A} and B\mathbf{B} respectivelys01
Ai,Bj\mathbf{A}_i, \mathbf{B}_jii-th and jj-th column blockss01
Cij=AiTBj\mathbf{C}_{ij} = \mathbf{A}_i^T \mathbf{B}_jBlock (i,j)(i, j) of the output (to be reconstructed)s01
NNNumber of workerss01
KKRecovery threshold (min. responses to reconstruct)s02
p(x)p(x)Encoding polynomial, degree pqβˆ’1pq - 1s02
Ξ±k\alpha_kEvaluation point for worker kks02
ΞΌ\muPer-worker storage fraction = 1/p+1/q1/p + 1/q in basic schemes02
TTPrivacy threshold (number of colluding workers) β€” Section 5.4s04
Fq\mathbb{F}_qFinite field; qβ‰₯Nq \geq N for distinct evaluation pointss02