5.3 Minimum sum-rate and Optimal Rate Vector
5.3.3 Minimum Sum-rate
The condition for the nonemptiness of B(f#
α,≤) can be easily derived based on the submodularity of this base polyhedron.
Lemma 5.3.2. If 0 ≤ α < H(V), fα# is intersecting submodular; If α ≥ H(V), fα# is
submodular.
Proof. For function fα#, we have
fα#(X) + fα#(Y)− fα#(X∪Y)− fα#(X∩Y) = H(X) +H(Y)−H(X∪Y)−H(X∩Y) +α−H(V) X∩Y=∅ H(X) +H(Y)−H(X∪Y)−H(X∩Y) otherwise .
Due to the submodularity of the entropy function H, ifα≥ H(V), fα#(X) + fα#(Y)−
f#
α(X∪Y)− fα#(X∩Y)≥0,∀X,Y⊆ V, i.e., fα# is submodular; ifα< H(V), fα#(X) + fα#(Y)− fα#(X∪Y)− fα#(X∩Y) ≥ 0,∀X,Y ⊆ V: X∩Y 6= ∅, i.e., fα# is intersecting submodular.
For X⊆V, denote byΠ(X)the set that contains all partitions ofX. A partitionP
0 1 2 3 4 0 1 0 1
r
1r
2r
3r(V) =
4
B(f
4#,≤)
P(f
# 4,≤)
R
∗ NCO(V) =
B(f
4#,≤)∩Z
3Figure 5.4: For the system in Example 5.2.1, when α = 4, the polyhedron P(f4#,≤)
and the plane{rV∈R3: r(V) =4}intersect, i.e., B(f4#,≤) ={rV ∈RCO(V): r(V) =
4} 6= ∅. Also, RNCO∗ (V) = B(f#
4,≤)∩Z3 = {(2, 1, 1),(3, 0, 1),(3, 1, 0)}. In this case,
there are three optimal rate vectors for the non-asymptotic model.
C,C0 ∈ P; (c) ∪C∈PC = X. Denote Π0(X) = Π(X)\ {X} = {P ∈ Π(X): |P |> 1}. For a partitionP ∈Π(X), let
fα#[P] =
∑
C∈P fα#(C)
and ˆfα#be theDilworth truncationof fα# that is defined as [100] ˆ
fα#(X) = min P ∈Π(X)f
#
α[P], ∀X⊆V. (5.5) We have ˆfα# being a submodular function due to the intersecting submodularity of fα#[164]. It is shown in [167] that, for a given value ofα, the minimal/finest and max-
imal/coarsest partitions that minimize minP ∈Π(X) fα#[P]exist.
12 Dilworth truncation
is an important concept in CO. We will show in the following context that a condi- tion on the Dilworth truncation determines the nonemptiness of the base polyhedron B(f#
α,≤). In Section 5.5.2, we will show that this maximization problem can be solved in polynomial time by efficient algorithms for solving theDilworth truncation problem, the minimization problem in (5.5).
12In [167], it is shown that the minimizers of min
P ∈Π(X)fα#[P]form a partition lattice, which is called the Dilworth truncation lattice, where the minimal/finest and maximal/coarsest minimizers uniquely exist.
Theorem 5.3.3. B(fα#,≤)is nonempty, i.e.,αis achievable, and B(fα#,≤) = B(fˆα#,≤)if and
only if
α= fˆα#(V). (5.6)
Proof. Whenα≥ H(V), fα#is submodular according to Lemma 5.3.2. So,α= fα#(V) =
ˆ
fα#(V)andB(fα#,≤)6=∅ [49]. When 0≤ α< H(V), due to the intersecting submod-
ularity of fα#, B(fα#,≤) 6= ∅ if and only if α = fˆα#(V) based on Lemma 5.A.1 in
Appendix 5.A.
In Theorem 5.3.3, ˆf#
α(V)determines the maximum sum-rate of all rate vectors in polyhedronP(fα#,≤),13 whileαis the sum-rate for all rate vectors in the hyperplane
{rV ∈ R|V|: r(V) = α}. There are two situations: if α > fˆα#(V), P(fα#,≤) does
not intersect with the hyperplane {rV ∈ R|V|: r(V) = α}; if α = fˆα#(V), P(fα#,≤)
intersects with the hyperplane {rV ∈ R|V|: r(V) = α} at B(fα#,≤). In the latter
case, B(f#
α,≤)6= ∅. Theorem 5.3.3 can also be interpreted by the principal sequence of partitions (PSP) in 5.5.1, where the comparison between the maximum sum-rate in P(f#
α,≤) and the sum-rate α of the hyperplane {rV ∈ R
|V|: r(V) =
α}, or the
nonemptiness of the base polyhedron B(fα#,≤), is fully characterized by a ˆfα#(V)vs.
αplot.
Example 5.3.4. For the system in Example 5.2.1, it can be shown that: when α < 72, we
haveα> fˆα#(V); whenα≥ 72, we haveα= fˆα#(V).14 For example, in Fig. 5.2 whenα= 165,
one can show thatmax{r(V): rV ∈ P(f16/5# ,≤)}= fˆ16/5# (V) = 135 < α. So, P(f16/5# ,≤)
does not intersect with hyperplane{rV ∈R|V|:r(V) = 165}, i.e., B(fα#,≤) =∅. In Fig. 5.4, whenα=4, we have f4# being
f4#(∅) =0,f4#({1}) =3,f4#({2}) =1,f4#({3}) =1,
f4#({1, 2}) =4,f4#({1, 3}) =4, f4#({2, 3}) =3, f4#({1, 2, 3}) =4 and the Dilworth truncation fˆ4# being
ˆ
f4#(∅) =0, ˆf4#({1}) =3, ˆf4#({2}) =1, ˆf4#({3}) =1, ˆ
f4#({1, 2}) =4, ˆf4#({1, 3}) =4, ˆf4#({2, 3}) =2, ˆf4#({1, 2, 3}) =4. 13For determining the maximum sum-rate inP(f#
α,≤), we have max{r(V):rV∈P(fα#,≤)}=r[P
∗] =
∑C∈Pr(C) = fˆα#(V), whereP
∗ is the minimizer of min
P ∈Π(V) fα#[P][49]. The detailed explanation is shown in Appendix 5.C.
14The two situations can be seen from the ˆf#
One can show that max{r(V): rV ∈ P(f4#,≤)} = fˆ4#(V) = 4 = α and B(f4#,≤) =
B(fˆ4#,≤)6= ∅.
By comparing the values of f#
4 and fˆ4#, we can see that the Dilworth truncation tight-
ens the constraints in the polyhedron P(f4#,≤). For example, the inequality r({2, 3}) ≤
f#
4({2, 3}) = 3 in P(f4#,≤) can be tightened by r({2}) ≤ f4#({2}) = 1 and r({3}) ≤
f4#({3}) = 1 so that we have r({2, 3}) ≤ fˆ4#({2, 3}) = 2 in P(fˆ4#,≤). It also ex- plains that fˆ#
α(V)determines the maximum sum-rate over all rate vectors in the polyhedron P(fα#,≤)[49].
Theorem 5.3.3 and the geometric relationship between P(f#
α,≤) and the hyper- plane {rV ∈ R|V|: r(V) = α} can also be interpreted by the concept of principal
sequence of partitions (PSP) in Section 5.5.1.
Corollary 5.3.5. ForP ∈Π0(V), define
ϕ(P) =
∑
C∈P
H(V)−H(C)
|P | −1 .
The minimum sum-rate in the asymptotic and non-asymptotic models are respectively RACO(V) = max P ∈Π0(V)ϕ(P), (5.7a) RNCO(V) = max P ∈Π0(V)ϕ(P) . (5.7b)
Proof. (5.6) in Theorem 5.3.3 is equivalent to α ≤ fα#[P],∀P ∈ Π(V), which can be
converted toα≥ ϕ(P),∀P ∈ Π0(V). It gives rise to the expressions ofRACO(V)and
RNCO(V)in (5.7a) and (5.7b), respectively.
Corollary 5.3.5 states that the minimum sum-rate can be determined by a maxi- mization over all multi-way cuts ofV. Any partitionP ∈Π0(V)can be considered as a multi-way cut of the user setV. For anyC∈ P, the cut{C,V\C}imposes the SW constraintr(V\C)≥ H(V\C|C) = H(V)−H(C). By applying this to eachC ∈ P, we have ∑C∈Pr(V\C) = (|P | −1)r(V) ≥ ∑C∈P H(V)−H(C)
, which imposes requirement or lower bound
r(V)≥
∑
C∈P
H(V)−H(C)
|P | −1 = ϕ(P)
Since the SW constraint applies to all the subset of V, an achievable sum-rate must satisfy the highest requirement imposed by ϕ(P)over all multi-way cuts, i.e., ϕ(P)
should be maximized over all P ∈ Π0(V). Therefore, we have (5.7a) and (5.7b). We call the mininal/finest maximizer of (5.7a) thefundamental partitionand denote it by
P∗. The fundamental partition is of great importance in many problems, e.g., the secrecy capacity problem [151, 160, 161], the clustering problem [163, 168] and the optimal network attack problem [169].
Example 5.3.6. For the system in Example 5.2.1, by applying (5.7a)and (5.7b), we have RACO(V) = 72 and RNCO(V) = 4, which is consistent with the results in Examples 5.2.1
and 5.3.1. In addition, we haveP∗ ={{1},{2},{3}}being the fundamental partition.