J Comput Neurosci (2011) 30:1–5
DOI 10.
1007/s10827-011-0314-3
Information theory in neuroscience
Alexander G.
Dimitrov · Aurel A.
Lazar ·
Jonathan D.
Victor
Published online: 29 January 2011
© Springer Science+Business Media, LLC 2011
Information Theory...
More
J Comput Neurosci (2011) 30:1–5
DOI 10.
1007/s10827-011-0314-3
Information theory in neuroscience
Alexander G.
Dimitrov · Aurel A.
Lazar ·
Jonathan D.
Victor
Published online: 29 January 2011
© Springer Science+Business Media, LLC 2011
Information Theory started and, according to some,
ended with Shannon’s seminal paper “A Mathematical
Theory of Communication” (Shannon 1948).
Because its
significance and flexibility were quickly recognized, there
were numerous attempts to apply it to diverse fields
outside of its original scope.
This prompted Shannon
to write his famous essay “The Bandwagon” (Shannon
1956), warning against indiscriminate use of the new
tool.
Nevertheless, non-standard applications of Information Theory persisted.
Very soon after Shannon’s initial publication (Shannon
1948), several manuscripts provided the foundations
of much of the current use of information theory
in neuroscience.
MacKay and McCulloch (1952) applied the concept of information to propose limit
Less