38c3f2c82ad8b022.tex
1: \begin{abstract}
2: %Shannon's Entropy Power Inequality (EPI) has played a key role in resolving a number of problems in information theory. It is therefore quite interesting to examine the existence of a similar inequality for discrete random variables. In this paper we look at random variables taking values on finite abelian groups of order $2^n$ and obtain a version of the EPI for the same. This version of the EPI also leads to a new interpretation of Mrs. Gerber's Lemma (MGL), and using this interpretation we put forth a conjecture generalizing MGL to all finite abelian groups. We prove this conjecture for all abelian groups of order $2^n$.\\ 
3: 
4: Shannon's Entropy Power Inequality can be viewed as characterizing the minimum differential entropy achievable by the sum of two independent 
5: random variables with fixed differential entropies. 
6: The entropy power inequality has played a key role in resolving a number of problems in information theory. It is therefore interesting to examine the existence of a similar inequality for discrete random variables.
7: In this paper we obtain an entropy power inequality for random variables taking values in an abelian group of order $2^n$, i.e. for such a group $G$ we explicitly characterize the function $f_G(x,y)$ giving
8: the minimum entropy of the sum of two independent $G$-valued random variables with respective entropies $x$ and $y$. Random variables achieving the extremum in this inequality 
9: are thus the analogs of Gaussians in this case, and these are also determined. It turns out that $f_G(x,y)$ is convex in $x$ for fixed $y$ and, by symmetry, convex in $y$ for fixed $x$. This is a generalization to abelian 
10: groups of order $2^n$ of the result known as Mrs. Gerber's Lemma.\\ 
11: 
12: \textit{Keywords}: Entropy, Entropy power inequality, Mrs. Gerber's Lemma, Finite abelian groups.
13: \end{abstract}
14: