# A mathematical theory of communication

##### Citations

34,054 citations

17,414 citations

15,032 citations

13,370 citations

### Cites background from "A mathematical theory of communicat..."

...The concept of unconditional security was introduced in the seminal paper by Shannon [1120]....

[...]

...2 The concept of entropy was introduced in the seminal paper of Shannon [1120]....

[...]

11,176 citations

### Cites background from "A mathematical theory of communicat..."

...Many UL methods are designed to maximize entropy-related, information-theoretic (Boltzmann, 1909; Kullback & Leibler, 1951; Shannon, 1948) objectives (e.g., Amari, Cichocki, & Yang, 1996; Barlowet al., 1989;Dayan&Zemel, 1995;Deco&Parra, 1997; Field, 1994; Hinton, Dayan, Frey, & Neal, 1995; Linsker,…...

[...]

...…another RNN to the stack improves a bound on the data’s description length – equivalent to the negative logarithm of its probability (Huffman, 1952; Shannon, 1948) – as long as there is remaining local learnable predictability in the data representation on the corresponding level of the…...

[...]

##### References

1,614 citations

436 citations