cs0702084/analysis.tex
1: \section{Bounds on Achievable Rate}
2: \label{sec:bounds}
3: 
4: We want to derive bound on the achievable link's physical data rate,
5: given the received signal power and the received powers of
6: interferers. For that matter, we will consider the discrete vector
7: channel model described in (\ref{eq:vecchan_simple}). We will first
8: present a simple upper-bound, and then we will derive a novel
9: lower-bound, which is the main result of our paper.
10: 
11: 
12: \subsection{Upper-bound}
13: 
14: To derive an upper-bound we consider the information-theoretic
15: capacity of the channel, constrained to the binary input alphabet. We can represent our channel as an $M$-dimensional vector channel
16: \begin{equation}
17:    \bR = U_{1} A_{1} \bh_{1} + \sum^I_{i>1}  U_i A_i \bh_i + \bz,
18: \end{equation}
19: where $\{U_i\}_{i=1\cdots I}$ are i.i.d Bernouli random variables with $P(U_i = 1) =
20: \eta_i$, $\bz = \{z_m\}_{m=1\cdots M}$ are i.i.d Gaussian with
21: variance $\sigma_W^2$, $\{A_i\}_{i=1\cdots I},\{\bh_{im}\}_{i=1\cdots
22:   I, m=1\cdots M}$ are known signal attenuations and unknown (except
23: for $\bh_1$) but constant channel fadings from transmitter $i$ to the
24: destination respectively.
25: 
26: We upper-bound the capacity of the channel assuming the receiver knows
27: the received symbols $\{\bu_i\}_{i>1}$ from the interferers. Since it
28: can then perfectly estimate the interference and extract it, the only
29: remaining noise is the white noise $\bz$.
30: 
31: We use the notation $\bH = \{\bh_i\}_{i=1,\cdots,I}$ and $\bU_{-1} =
32: \{U_i\}_{i=2,\cdots,I}$. We can write the upper-bound as
33: \begin{eqnarray}
34:   C_u &=& I(u_1; \bR \,|\, \bh_1)\\
35:     &\leq& I(u_1; \bR \,|\, \bU_{-1}, \bH) \\
36:     &=& \EE_{\bh_1,U_1,\bz} \left[-\log\left(\sum_{v=\{0,1\}} P(U_1=v)
37:         e^E\right)\right]\\
38:   E &=& -\sum_{m=1}^M\frac{(z_m-(v-U_1)A_1h_{1m})^2-z_m^2}{2\sigma_W^2}
39: \end{eqnarray}
40: The result is similar to the result from \cite{Souilmi03D} for a
41: non-coherent channel. This bound can be easily calculated using
42: e.g. Monte-Carlo simulations.
43: 
44: 
45: 
46: 
47: 
48: \subsection{Lower-bound}
49: 
50: 
51: \subsubsection {Threshold Decoding}
52: 
53: Next, we will derive a lower-bound on achievable rates using a
54: practical decoding scheme. We suppose the source sends data in packets
55: of length $N$, where $N$ is assume large. Each packet has a coding
56: rate $C_R$ associated with it, yielding error probability of decoding
57: $P(\err)$. We consider an upper bound on $P(\err)$ using random coding
58: bound technique.
59: 
60: Suppose packets are coded using a random codebook $\FC \subseteq
61: \{0,1\}^{N}, ||\FC|| = 2^{N C_R}$. A source, knowing the channel state
62: $\bh_1$, sends codeword $\bu_1$ and a destination receives $\bR =
63: \{\br[n]\}_{n=1,\cdots,N}$, as described in
64: (\ref{eq:vecchan_simple}). The optimal decoder is the maximum
65: likelihood (MLE) decoder which selects the codeword $\bu_1$ that
66: maximizes the likelihood $P(\bR\,|\,\bu_1,\bh_1)$. However, the
67: performance of the maximum likelihood decoder is hard to
68: analyze. Since we are interested in an upper-bound on the probability
69: of error, we shall consider a simple threshold decoding scheme, based
70: on an arbitrary threshold $\theta$. If the likelihood
71: $P(\bR\,|\,\bu_1,\bh_1) > \theta$ for only $\bu_1\in\FC$, then the
72: decoding is successful.  Otherwise, it fails.
73: 
74: 
75: 
76: \subsubsection {Performance Analysis}
77: 
78: We start by giving all the notation we will be using: $\bH =
79: \{\bh_i\}_{i=1,\cdots,I}$, $\bH_{-1} = \{\bh_i\}_{i=2,\cdots,I}$,
80: $\bR = \{\br[n]\}_{n=1,\cdots,N}$, $\bu_i =
81: \{u_i[n]\}_{n=1,\cdots,N}$, $\bU = \{\bu_i\}_{i=1,\cdots,I}$,
82: $\bU_{-1} = \{\bu_i\}_{i=2,\cdots,I}$ and $\bU[n] =
83: \{u_i[n]\}_{i=1,\cdots,I}$. We will also use a short notation for
84: $P(\bY\,|\,\bv,\bh) = P(\bR = \bY\,|\,\bu_1 = \bv,\bh_1 = \bh)$ and
85: $P(\bY\,|\,\bV,\bh) = P(\bR = \bY\,|\,\bU = \bV,\bh_1 = \bh)$.
86: 
87: We first need to choose the threshold $\theta$ which will yield good
88: performance. Ideally, $\theta(\bv, \bh_1)$ is a function of the
89: (unknown) transmitted codeword $\bv$ and a channel-state $\bh_1$, and
90: we shall choose it to minimize the probability of false-negative
91: $P(P(\bR\,|\,\bv, \bh_1) < \theta(\bv, \bh_1) \,|\, \bu_1=\bv,
92: \bh_1)$. We will show later that the optimal $\theta$ does not depend
93: on the choice of $\bv, \bh_1$.
94: 
95: The noise and the interferences are ergodic processes hence for a
96: large packet size $N$ we have that $P(P(\bR\,|\,\bv, \bh_1) >
97: \theta(\bv, \bh_1)| \bu_1 = \bv, \bh_1) \to 1$ if
98: \begin{eqnarray}
99:   \theta(\bv,\bh_1) &=& (1-\eps) \EE_{\bR}(P(\bR\,|\,\bv, \bh_1) \,|\, \bu_1=\bv, \bh_1)\\
100:     &=& (1-\eps) \int_\bY P(\bR = \bY\,|\,\bv, \bh_1)^2 d\bY \label{eq:theta}
101: \end{eqnarray}
102: for any $\eps>0$. We will choose $\theta(\bv,\bh_1) = \int_\bY
103: P(\bR=\bY\,|\,\bv, \bh_1)^2 d\bY$ (i.e. $\eps = 0$), and assume
104: further $P(P(\bR\,|\,\bv, \bh_1) > \theta(\bv, \bh_1)| \bu_1=\bv,
105: \bh_1) = 1$. We next show that $\theta(\bv, \bh_1)$ does not
106: actually depend on $\bv, \bh_1$, hence we can write $\theta(\bv,
107: \bh_1) = \theta$. {\proposition \label{prop:sym} The following
108: integral
109: $$
110:    p(||\bv-\bw||, \bh_1) = \int_\bY P(\bR=\bY\,|\,\bv, \bh_1)
111:       P(\bR=\bY\,|\,\bw, \bh_1) d\bY
112: $$
113: depends only on $||\bv-\bw||$. Also, $\theta(\bv, \bh_1)$ depends neither
114: on $\bv$ nor on $\bh_1$.}
115: 
116: \begin{proof}
117: Let us denote with $\bQ[n] = \sum_{i=2}^I u_i[n] A_i[n]
118: \bh_i[n] + \bz[n]$. Then, $P(\bR=\bY\,|\,\bv, \bh_1) =
119: P(\bigcup_{n=1\cdots N} \bQ[n] = \bY[n] - \bv[n] A_1 \bh_1)$ and
120: \begin{eqnarray*}
121:   \lefteqn{\int_\bY P(\bR=\bY\,|\,\bv, \bh_1) P(\bR=\bY\,|\,\bw, \bh_1) d\bY =}\\
122:     && \int_\by P\left(\bigcup_{n=1\cdots N}
123:        \bQ[n] = \bY[n]\right) \times \\
124:     &\times& P\left(\bigcup_{n=1\cdots N} \bQ[n] = \bY[n] -
125:        (\bw[n]-\bv[n]) A_1 \bh_1\right) d\by.
126: \end{eqnarray*}
127: The distribution of the vector $\{\bQ[n]\}_{n=1\cdots N}$ is by
128: definition symmetric and invariant to a permutation of its elements,
129: hence the value of the integral depends only on $||\bv-\bw||$.
130: Furthermore, if $||\bv-\bw|| = 0$, as in (\ref{eq:theta}), then the
131: integral does not depend on $\bh_1$ either.
132: \end{proof}
133: 
134: 
135: Now we are interested in the probability of error of decoding a
136: random transmitted codeword. We consider a random codebook $\FC$,
137: and from there select a random codeword $\bv$ to transmit. Note that
138: $P(\bv=\bomega \,|\, \FC=C) = 2^{-C_R N} 1\{\bomega\in C\}$ since
139: all the codewords from $\FC$ are equiprobable. The probability of
140: error can be bounded by the union bound as
141: \begin{eqnarray}
142:   \lefteqn{P(\err | \bh_1) \leq}\\
143:   &\leq& \EE_{\FC,\bv\in\FC} \left[ \sum_{\bomega\in\FC, \bomega \not= \bv}
144:         P(P(\bR\,|\,\bomega, \bh_1) > \theta \,|\, \bv, \bh_1) \right] \\
145:     &=& 2^{C_R N} \EE_{\bv, \bw, \bv\not=\bw}\left[P(P(\bR\,|\,\bw, \bh_1) >
146:       \theta \,|\, \bv, \bh_1)\right] \label{eq:tresdec}
147: \end{eqnarray}
148: where $\bv,\bw$ are two randomly choosen codewords from a random codebook.
149: 
150: Next, using Markov inequality, we bound
151: \begin{eqnarray}
152:   \lefteqn{P(P(\bR\,|\,\bw, \bh_1) > \theta \,|\, \bu_1=\bv, \bh_1) \leq}\\
153:   &\leq& \frac{1}{\theta}
154:      \EE_\bR\left[ P(\bR\,|\,\bw, \bh_1) \,|\, \bv, \bh_1 \right]\\
155:   &=& \frac{p(||\bv-\bw||, \bh_1)}{\theta} \label{eq:markov}
156: \end{eqnarray}
157: where the last equation follows from \pref{prop:sym}. The Markov
158: bound is the best bound we can use knowing only the mean of a random
159: variable, and numerical results in \sref{sec:results} show that the
160: bound is useful for performance evaluation of the channel.
161: 
162: Random codewords $\bv,\bw$ can be assumed independent in a large
163: codebook (when $C_R N$ is large). We then have that $P(||\bv-\bw|| =
164: d) = \comb{N}{d} (2\eta_1(1-\eta_1))^d (\eta_1^2 +
165: (1-\eta_1)^2)^{N-d}$.
166: 
167: Next, let $e_d$ be a vector with $d$ ones and $n-d$ zeros and let us
168: denote $J(\bV,\bW,\bh_1) = \int_\bY P(\bR=\bY\,|\,\bV,\bh_1)
169: P(\bR=\bY\,|\,\bW,\bh_1) d\bY$. Then from (\ref{eq:tresdec}) and
170: (\ref{eq:markov}) we have
171: \begin{eqnarray}
172:   p(d) &=& \EE[ J([\be_d,\bU_{-1}],[\be_0,\bV_{-1}],\bh_1)], \label{eq:pd}\\
173:   P(\err) &\leq& \frac{2^{C_R N}}{\theta}
174:     \sum_{d=0}^N P(||\bu-\bv|| = d) p(d) \label{eq:pebound}
175: \end{eqnarray}
176: where $\bU_{-1} = \{u_i\}_{i=2,\cdots,I}, \bV_{-1} =
177: \{v_i\}_{i=2,\cdots,I}$ are random codewords transmitted by
178: interferers. We can express $J(\bU,\bV,\bh_1)$ in a closed-form, as
179: explained in Appendix, and calculate the mean using Monte-Carlo
180: simulations. Since $p(0,\bh_1) = \theta$, we can use the same
181: procedure to calculate $\theta$ (note that in addition $\theta$ does
182: not depend on $\bh_1$). Details on Monte-Carlo simulations are given
183: in \sref{sec:MC}.
184: 
185: From (\ref{eq:pebound}) we can obtain a lower-bound $C_l$ on the
186: communication rate $C_R$. When $N\to\infty$ we can obtain
187: arbitrarily small $P(\err)$ using communication rate
188: \begin{equation}
189:   C_l = -\frac{1}{N} \log_2\left(\sum_{d=0}^N P(||\bu-\bv|| = d)
190:       \frac{p(d)}{\theta}\right). \label{eq:lbound}
191: \end{equation}
192: