Professional Documents
Culture Documents
2 2’ T4 {S2}
{S1,S3} (3) X X
S3 T5 {S3} ≤ R(α, β) + (1 − 2−|S| )R(α, β)
{S1,S2,S3} (α,β):α∩β6=φ (α,β): α∩β=φ
T6 {S3} X
3’ −|S|
S4 3 T7 {S3}
{S3,S4} = R(α, β) − 2 Rs ,
T8 {S4} (α,β)∈I
Fig. 5. Sink Decomposition for Arbitrary Three-layer Network where step (1) follows from the fact that α∩β 6= φ implies α *
γβ . (2) follows from that for all α, β satisfying |α|
¡ = |S|
a, |β| =¢
b, α ∩ β = φ, the total number of (α, β) is a,b,|S|−a−b ;
X X furthermore, for a fixed order ≺ in S, the number of ¡(α, β) ¢
|S|
H(X i ) ≤ min C(α, β), satisfying |α| = a, |β| = b, α ∩ β = φ and α ⊆ γβ is a+b .
G,≺
i∈γ
(α,β):
β∩γ6=φ, This is obtained when we choose α and β jointly with the fixed
α∩γ*γβ order subject to α ⊆ γβ . From the property of symmetry, a
where ≺ is the order in γ. portion of
We also note that a recent result [7] has extended the ¡ |S| ¢
a+b 1
network sharing bound to any arbitrary multisouce multisink ¡ ¢ = ¡|α|+|β|¢
|S|
network. a,b,|S|−a−b |α|
An important consequence of the network sharing bound is should be excluded from the bound, and Step (3) follows from
the following observation. The network sharing bound implies the fact µ ¶
that ( ) |α| + |β|
X X ≤ 2|α|+|β| ≤ 2|S| .
inf Ri : R ∈ R = H(Xj ). |α|
i∈I j∈S IV. P ROOF OF M AIN R ESULT
This result means that, at least in the one-to-one source- Proof of Theorem 1: Suppose the |I|-tuple C is admissible
sink transmission case, coding among messages from different for the given three-layer network, for every ² > 0, there exists
sources has no benefit at all, if our goal is to minimize the for sufficiently large n an (n, (ηl , l ∈ P ), (∆i , i ∈ T )) code
total data rate of all channels in the network. This point can such that
be seen from the following intuition: suppose that we code n−1 log ηl ≤ Cl , for all l ∈ I
messages from different sources, then the data rate for some of
and
the side-information channels (channels satisfying α ∩ β = φ)
∆i ≤ ², for all i ∈ T.
must be non-zero. This is a very important observation since
it implies that single source multicast might be sufficient to Actually every Cl , l ∈ I corresponds to a C(α, β) where α =
achieve minimum total transmission cost. Al and β = Bl . Define U (α, β) = Fl (Xjn , j ∈ α), we have
Let the total rate of the side-information channels be 1) H(U (α, β)) ≤ log ηl ≤ nC(α, β);
∆
X 2) H(U (α, β)|Xjn : j ∈ α) = 0;
Rs = R(α, β),
α∩β=φ
3) By Fano’s inequality, ∃δ depending on ² such that δ → 0
as ² → 0 and for any i ∈ β, n−1 H(Xin |{U (α, β) : i ∈
then we have β, all α 6= φ}) ≤ δ.
Corollary 2: We have
X X X X
H(X i ) ≤ R(α, β) − 2−|S| Rs . nC(α, β) + H(Xin )
i∈S (α,β)∈I
β∩γ6=φ, i∈γ
/
Proof: Let γ = S in Theorem 1, we can obtain (α,β): α∩γ6⊆γ
β
X X X
H(X i ) ≥ H(U (α, β)) + H(Xin )
i∈S β∩γ6=φ, i∈γ
/
(α,β): α∩γ6⊆γ
(1) X X β
so we only need to show that Consider the three-layer network G in Fig. 6, where
H(Xink |Xin1 , ..., Xink−1 , ∆, Λ) S = T = {1, 2, 3},
≤ H(Xink |Xin1 , ..., Xink−1 , {U (α, β) : ik ∈ β, I = {1, 2, 3, 4, 5, 6}, I 0 = {10 , 20 , 30 , 40 , 50 , 60 },
α ∩ γ 6⊆ γβ }, Λ) A1 = {1}, A2 = {1, 2}, A3 = {1, 3},
k
[
(b) A4 = {2}, A5 = {2, 3}, A6 = {3},
= H(Xink |Xin1 , ..., Xink−1 , Λ, {U (α, β) :
t=1 B10 = {2}, B20 = {1, 2}, B30 = {1, 3},
iβ = it , ik ∈ β, α ∩ γ 6⊆ {i1 , ..., it−1 }}) B40 = {3}, B50 = {2, 3}, B60 = {1},
[k
(c) D1 = {1}, D2 = {2}, D3 = {3},
≤ H(Xink | {U (α, β) : iβ = it , ik ∈ β,
C({1, 2}, {1, 2}) = 1, C({1, 3}, {1, 3}) = 1,
t=1
k
[ C({2, 3}, {2, 3}) = 1, C({1}, {2}) = 1,
α ∩ γ ⊆ {i1 , ..., it−1 }}, {U (α, β) : C({2}, {3}) = 1, C({3}, {1}) = 1.
t=1
iβ = it , ik ∈ β, α ∩ γ 6⊆ {i1 , ..., it−1 }}) The Max-flow Min-cut bound can be easily obtained as
[k follows
= H(Xink | {U (α, β) : iβ = it , ik ∈ β}) H(X1 ) ≤ 2
t=1
(d) H(X2 ) ≤ 2
= H(Xink |U (α, β) : ik ∈ β)
H(X1 ) + H(X2 ) ≤ 4
≤ nδ.
H(X1 ) + H(X3 ) ≤ 4
The noted steps are explained as follows: H(X2 ) + H(X3 ) ≤ 4
(b) This union includes all the β, such that ik ∈ β. H(X1 ) + H(X2 ) + H(X3 ) ≤ 6.
(c) By the fact 2), it follows that H(U (α, β) : α ∩
γ ⊆ {i1 , ..., ik−1 }|Xin1 , ..., Xink−1 , Λ) = 0, ∀k ∈ Now, lets examine the network sharing bound. Since the given
{1, ..., |γ|}, ∀β ⊆ {1, ..., |T |}, β 6= φ. and H(Y |X) ≤ network is symmetric, we can just examine one order, without
H(Y |g(X)). loss of generality, γ = {1 ≺ 2 ≺ 3}. Since the bounds of
(d) Similar as (b). subsets of two or fewer source nodes are easy to be checked,
here we just give the derivation for the bound with three
Therefore, Theorem 1 is proved.
sources. We enumerate all the β sets as follows
V. E XAMPLES β = {1}, γβ = φ, ∀α ⊆ γ → C({3}, {1}) = 1;
It is easy to show that the network sharing bound is tight β = {1, 2}, γβ = φ, ∀α ⊆ γ → C({1, 2}, {1, 2}) = 1;
in the case of one-to-one source-sink transmission with two β = {1, 3}, γβ = φ, ∀α → C({1, 3}, {1, 3}) = 1;
sources and two sinks. However, the following example shows β = {2}, γβ = {1}, α ∩ γ 6⊆ {1} = α ∩ γ = {1};
that the bound is no longer tight for three sources. β = {2, 3}, γβ = {1}, α ∩ γ 6⊆ {1} → C({2, 3}, {2, 3}) = 1;
Example 1: In this example, we show the significant im- β = {3}, γβ = {1, 2}, α ∩ γ 6⊆ {2, 3} = α ∩ γ = {2},
provement of network sharing bound over the Max-flow Min- where = means ”contradicts”. Thus the network sharing
cut bound as an outer bound in some special cases. However, bound is
this example also proves that the network sharing bound is not
tight for the general three-layer network. H(X1 ) ≤ 2
H(X2 ) ≤ 2
H(X1 ) + H(X2 ) ≤ 3
H(X1 ) + H(X3 ) ≤ 3
H(X2 ) + H(X3 ) ≤ 3
H(X1 ) + H(X2 ) + H(X3 ) ≤ 4,
which suggests a significant improvement over the Max-
flow Min-cut bound. However, it is not hard to see that the
information rate triple (2, 1, 1) is not achievable in any order
of γ . In fact, the last inequality should be replaced by
H(X1 ) + H(X2 ) + H(X3 ) ≤ 3
to make the bound tight.
Therefore, despite of the potential significant improvement
the network sharing bound could offer over the Max-flow Min-
cut bound, it is still not tight in the general three-layer network.
VI. C ONCLUSION
In this paper, we proved an improved outer bound of the
admissible rate region for a special class of multisouce mul-
tisink network, namely, the three-layer network by analyzing
the role of side information. Although the proposed network
sharing bound is not tight for the general three layer network,
it provides significant improvement over the Max-flow Min-
cut bound. Another important consequence is that the network
sharing bound implies that network coding among messages
from different sources has no benefit if our goal is to minimize
the total bandwidth needed. Based on this result, we conjecture
that under reasonable assumptions this conclusion holds for
arbitrary multi-source, multi-sink networks.
R EFERENCES
[1] R. Ahlswede, N. Cai, S.-Y. R. Li, and R. W. Yeung, “Network informa-
tion flow,” IEEE Trans. Inform. Theory, vol. 46, pp. 1204–1216, July
2000.
[2] S.-Y. R. Li, R. W. Yeung, and N. Cai, “Linear network coding,” IEEE
Trans. Inform. Theory, vol. 49, pp. 371–381, Feb. 2003.
[3] E. Erez and M. Feder, “Capacity region and network codes for two
receivers multicast with private and common data,” Workshop on Coding,
Cryptography and Combinatorics, 2003.
[4] C. K. Ngai and R. W. Yeung, “Multisource network coding with
two sinks,” International Conference on Communications, Circuits and
Systems (ICCCAS), June 2004.
[5] R. W. Yeung, A First Course in Information Theory. New York:
Kluwer/Plenum, 2002.
[6] R. W. Yeung and Z. Zhang, “Distributed source coding for satellite
communications,” IEEE Trans. Inform. Theory, vol. 45, pp. 1111–1120,
May 1999.
[7] X. Yan, J. Yang, and Z. Zhang, “An outer bound for multisource
multisink network coding and its relation to minimum cost network
coding,” to be submitted to IEEE Trans. Inform. Theory, 2005.
[8] T. M. Cover and J. A. Thomas, Elements of Information Theory. New
York: Wiley, 1991.
[9] R. W. Yeung and Z. Zhang, “On symmetrical multilevel diversity
coding,” IEEE Trans. Inform. Theory, vol. 45, pp. 609–621, Mar. 1999.
[10] R. W. Yeung and C. K. Ngai, “Two approaches to quantifying the
bandwidth advantage of network coding,” presented at 2004 IEEE
Information Theory Workshop, Oct. 2004.