Lattices and Lattice Partitions
From Constellations to Lattices
In the first three chapters we worked with finite constellations or — 8-PSK, 16-QAM, set-partitioning trees — and we asked how to code over them. In this chapter we move one level up in abstraction. Instead of picking a finite point set and partitioning it, we work with lattices: infinite regular arrays of points in . The constellation is then obtained by two independent operations:
- Coding. Select a subset of the lattice points by a code. This controls the minimum distance of the constellation and hence, loosely, the coding gain .
- Shaping. Confine the selected points to a bounded region . This controls the average energy of the constellation and hence the shaping gain .
The point is that coding and shaping are orthogonal design problems. Shaping moulds the marginal distribution of the transmitted symbols toward the Gaussian ideal; coding structures the relationships between codewords. They contribute independently to the gap to Shannon capacity, and we will see that each has a strict upper bound — a coding-gain ceiling that depends on the underlying lattice, and a shaping-gain ceiling of exactly dB. That dB is the "Shannon tax" that any finite-alphabet scheme pays; no clever code design recovers it. Only shaping does.
Definition: Lattice in
Lattice in
A lattice is a discrete additive subgroup of of rank . Equivalently, there exist linearly independent vectors such that
Stacking the basis vectors as columns of a matrix , we write and call a generator matrix of . Different bases give different 's, all related by unimodular transformations (integer matrices with ).
A lattice is closed under addition and under negation — that is what "additive subgroup" means. In particular, the origin always belongs to every lattice.
Definition: Fundamental Region and Volume
Fundamental Region and Volume
A fundamental region of is any measurable set such that the translates tile exactly (they cover it and overlap only on measure-zero sets). The fundamental parallelepiped is one canonical choice; the Voronoi region (below) is another. All fundamental regions have the same volume, which we call the fundamental volume of the lattice:
The volume is independent of the basis because unimodular preserves .
Think of as the "real estate" each lattice point occupies. A denser lattice has smaller for the same average distance between points — equivalently, a larger number of points per unit volume.
Definition: Voronoi Region, Packing and Covering Radii
Voronoi Region, Packing and Covering Radii
The Voronoi region of around the origin is the set of points of closer to than to any other lattice point:
The packing radius is the largest such that the balls around distinct lattice points are disjoint; equivalently, . The covering radius is the smallest such that the balls cover all of ; equivalently, .
Packing controls error probability on the AWGN channel (nearest-neighbour confusion), while covering controls the worst-case quantisation error. Both are lower-bounded by the same sphere-packing argument, but the extremal lattices for packing and covering differ in general.
Definition: Kissing Number
Kissing Number
The kissing number of a lattice is the number of minimum-norm vectors in — the number of "nearest neighbours" of the origin:
At high SNR, the pairwise union bound for ML decoding gives , so is the multiplicative pre-factor controlling the error floor once coding gain has set .
A large coding gain is worth less if it comes with an exponentially large kissing number. The Conway–Sloane tables list both numbers for the standard lattices; the ratio is sometimes called the effective coding gain to reflect this tradeoff.
Lattice Partition Visualization
Three canonical partitions in . The big dots are the sublattice ; the smaller dots are the coset representatives in . Each coset is colour-coded. Changing the partition shows how the index controls how many cosets the label bits must encode, and how the Voronoi region rescales.
Parameters
Important Lattices and Their Parameters
| Lattice | Dimension | Fund. vol. | Kissing | Coding gain over [dB] |
|---|---|---|---|---|
| any | ||||
| (checkerboard) | (for ) | |||
| (Gosset) | ||||
| (Barnes–Wall) | ||||
| (Leech) |
Historical Note: Forney's 1988 Coset Codes
1988The two-part paper Coset Codes — Part I: Introduction and Geometrical Classification and Part II: Binary Lattices and Related Codes by G. D. Forney Jr., appearing in the IEEE Transactions on Information Theory (Sept. 1988, pp. 1123–1187), consolidated a decade of work by Ungerboeck, Calderbank, Sloane, Wei, and Forney himself. Part I lays out the geometric framework of lattice partitions and coset codes, including the fundamental coding gain and the shaping-gain decomposition. Part II catalogues the binary lattices (like , , , the Barnes–Wall lattices, and the Leech lattice ) and the binary partitions between them, showing that most practical TCM codes are (unknowingly) coset codes of this form. These papers are the single most important reference for the material in this chapter.
Example: The Partition
Consider the integer lattice and its sublattice (all vectors with even coordinates). List the cosets of in , the index , and the fundamental volumes and . Confirm the identity .
Cosets
A coset of is for some . Two cosets and are equal iff , which for means and agree modulo 2 in both coordinates. There are four such parity classes: .
Index and volumes
So . The fundamental volumes are and . Indeed .
Geometric picture
Visually, is the integer grid, is every other grid point in both directions (a sparser grid four times as sparse), and the four cosets fill in the missing points by shifting by respectively. Each coset is itself a lattice congruent to .
Theorem: Index Equals Volume Ratio
Let be lattices in . Then has finite index in , and the number of cosets satisfies
If is coarser by a factor of in volume, then copies of — offset by the coset representatives — reassemble . The statement is a conservation law.
Start from generator matrices and with for some integer matrix .
Relate to both the volume ratio and the index.
Integer-matrix relation
Because , every column of is an integer combination of columns of . Hence there is an integer matrix with , and since has full rank.
Volume ratio
Taking determinants, , so .
Counting cosets
By the Smith normal form, any integer matrix can be written with unimodular and with positive integer . The unimodular factors do not change the lattice, so we may replace by . The cosets of in are indexed by , which has elements. Combining with the volume-ratio step yields the claim.
Definition: Lattice Partition Chain
Lattice Partition Chain
A lattice partition chain is a nested sequence
where each is a sublattice of . The chain has levels; the -th level contributes the partition of index . In the binary case each level is a two-way partition (index 2), and the total number of cosets of in is — exactly the number of bits we need to label a coset.
The chains we care about most are the Ungerboeck binary chains (the 8-PSK / 16-QAM chains of Ch. 2) and the more sophisticated chains leading down to , , and beyond.
Common Mistake: Dimension Counts , Not Channel Uses
Mistake:
Mixing up the dimension of the lattice (the ambient ) with the number of symbols the lattice represents. A 2D lattice point is a single 2D QAM symbol; an 8D lattice point spans four 2D symbols.
Correction:
A lattice with even corresponds to complex-valued channel uses under 2D (I/Q) modulation. When we quote per-symbol energy, coding gain per 2D, and so on, we must divide the per-lattice-point quantities by . The shaping gain ceiling is expressed per-dimension, so is scale-free.
Lattice
A discrete additive subgroup of of full rank ; equivalently, the set of integer combinations of linearly independent vectors (the generator matrix).
Related: Fundamental Region and Volume, Voronoi Region, Packing and Covering Radii, Sublattice
Sublattice
A lattice that is itself a lattice (full rank in ). Equivalently, the image of under multiplication by an integer matrix with nonzero determinant.
Related: Lattice in , Coset (Subset) of a Partition, Partition Chain of a Constellation
Voronoi region
The set of points in closer to the origin than to any other point of a lattice. Its volume equals the fundamental volume .
Related: Lattice in , Fundamental Region and Volume
Kissing number
The number of lattice points at minimum distance from the origin. Governs the pairwise-union-bound prefactor in the ML error probability.
Related: Minimum Distance and Asymptotic Coding Gain, Coding Gain of a Full-Rank Space-Time Code
Quick Check
What is the index of the checkerboard sublattice inside ?
1
2
4
consists of integer vectors with even coordinate sum. This parity constraint halves the lattice: the cosets of in are the "even-sum" and "odd-sum" cosets. Hence the index is , and correspondingly .
Key Takeaway
A lattice is a regular point set with group structure, and a sublattice partitions it into cosets. The fundamental volume measures point density, the Voronoi region measures local error tolerance, the kissing number measures error-floor multiplicity, and the index of a partition is the number of bits we need to label a coset. These four quantities will do all the work in the coset-code construction of the next section.