1: \begin{abstract}

2:   This paper introduces several fundamental concepts in information

3:   theory from the perspective of their origins in

4:   engineering. Understanding such concepts is important in

5:   neuroscience for two reasons. Simply applying formulae from

6:   information theory without understanding the assumptions behind

7:   their definitions can lead to erroneous results and

8:   conclusions. Furthermore, this century will see a convergence of

9:   information theory and neuroscience; information theory will expand

10:   its foundations to incorporate more comprehensively biological

11:   processes thereby helping reveal how neuronal networks achieve their

12:   remarkable information processing abilities.

13: \end{abstract}

14: