Memory Sharing for Non-Integer
What If Is Not an Integer?
The base MAN scheme requires to be an integer β because subsets have integer cardinalities. But in practice might fall anywhere in , so can be any real number in .
The elegant fix is memory sharing β a convex combination of two integer-valued schemes. The overall achievable region is the lower convex envelope of the integer points for , and memory sharing achieves every point on this envelope by time-sharing between two adjacent integer operating points.
Definition: Memory Sharing
Memory Sharing
For a non-integer with , the server partitions each file into a fraction and a fraction for some . The -fraction is handled by the MAN scheme with ; the -fraction by MAN with . The overall scheme uses per-user memory and achieves rate is chosen so that the weighted matches the target cache size.
Theorem: Achievable Region of the MAN Scheme
For any , the worst-case rate achievable by the MAN scheme with memory sharing equals the lower convex envelope of the integer- points: This envelope is a continuous, decreasing, piecewise-linear function of .
Construction: partition into two sub-files
Given target , let satisfy . Solve: . Note is well-defined.
Split each file
Split where has size bits, has size bits. Run MAN with on and MAN with on independently.
Verify cache budget
The scheme uses per-user cache bits per file; the scheme uses bits per file. Summing over files: β
Compute the combined rate
Delivery messages for the two sub-libraries are independent (different bits, separate XORs). Rate: which is the convex combination claimed.
Lower convex envelope
Varying over traces out the line segment between the two integer points in the plane. The union over all gives the lower envelope β a piecewise-linear curve.
Example: Memory Sharing at (Fractional )
Let , , (so , not integer). Find the rate achievable by memory-sharing between the and schemes.
Identify integer operating points
- : , .
- : , .
Set up the convex combination
. For : .
Compute the shared rate
files.
Compare to a hypothetical non-integer $t$
If we naively plug into . This is strictly less than the memory-shared 2.75. The reason: the naive formula is the continuous interpolation assuming fractional subsets exist, which they do not. The envelope is slightly above the continuous curve. This is why the MAN scheme upper bound curve (in our plots) is piecewise-linear, not smooth.
The Envelope Is Not the Continuous Curve
A common minor error: the continuous curve is below the memory-shared (piecewise-linear) envelope everywhere except at the integer- points. The continuous formula is the "asymptotic" rate assuming integer , not a rate that memory sharing achieves.
When we later visualize "the MAN upper bound," we usually mean the piecewise-linear envelope β or, in scaling analyses where at fixed , the two coincide and the distinction vanishes.
Common Mistake: Memory Sharing Cannot Recover the Continuous Formula
Mistake:
Claiming is always achievable, for any real .
Correction:
The formula is exactly achievable only when is a non-negative integer. For general , the best you can do with memory sharing is the lower convex envelope of the integer- points, which is slightly above the continuous curve. In practice for large , the difference is a few percent at most β small enough that papers often quote the continuous formula as "the MAN rate" without comment. Be aware of this subtlety when computing rates for small .
Subpacketization Growth β The Elephant in the Room
The MAN scheme requires each file to be partitioned into subfiles β exponential in for fixed memory ratio. This is the single largest practical obstacle to deploying the scheme at scale. The dashed Stirling bound illustrates the exponential growth. Chapter 14 introduces PDAs and graph-coloring schemes that recover the caching gain with polynomial subpacketization.
Parameters
Subpacketization Is the Main Practical Bottleneck
For users and (so ), subpacketization is . A 4 GB video file must be split into 10 billion pieces of 0.4 bytes each β obviously infeasible. For , , we would need pieces.
Consequences and mitigations:
- Grouping: Split the users into groups of size and run MAN within each group, losing the cross-group coded multicast gain. 3GPP uses this implicitly in multicast configurations.
- PDAs: Placement Delivery Arrays (Yan et al. 2017) achieve polynomial subpacketization with a sub-optimal but still significant coded gain.
- Graph coloring delivery (Ch 14): CommIT's polynomial- subpacketization schemes trade a constant-factor gain loss for polynomial .
- β’
MAN requires F β₯ \binom{K}{t}; typical video files have F β 10^9 bits
- β’
Feasibility: \binom{K}{t} β€ F/(few bits), so K β€ 30 for realistic t and F
- β’
Any finite packet header is a fixed cost per subfile; shrinks useful payload to zero at high K