Blind separation of sources, Part 1: an adaptive algorithm based on neuromimetic architecture
Citations
[...]
38,208 citations
14,635 citations
Cites background from "Blind separation of sources, Part 1..."
...d Hinton, 1994; Field, 1994; Hinton et al., 1995; Dayan and Zemel, 1995; Amari et al., 1996; Deco and Parra, 1997). Many do this to uncover and disentangle hidden underlying sources of signals (e.g., Jutten and Herault, 1991; Schuster, 1992; Andrade et al., 1993; Molgedey and Schuster, 1994; Comon, 1994; Cardoso, 1994; Bell and Sejnowski, 1995; Karhunenand Joutsensalo, 1995; Belouchrani et al., 1997; Hyva¨rinen et al., 2...
[...]
...…1993; Bell & Sejnowski, 1995; Belouchrani, Abed-Meraim, Cardoso, & Moulines, 1997; Cardoso, 1994; Comon, 1994; Hyvärinen, Karhunen, & Oja, 2001; Jutten & Herault, 1991; Karhunen & Joutsensalo, 1995; Molgedey & Schuster, 1994; Schuster, 1992; Shan & Cottrell, 2014; Shan, Zhang, & Cottrell,…...
[...]
11,500 citations
11,201 citations
Cites background from "Blind separation of sources, Part 1..."
...Similarly, Le et al. (2011b) recently showed that adding a regularization term of the form ∑ t ∑ j s3(Wjx (t)) to a linear auto-encoder with tied weights, where s3 is a nonlinear convex function, yields an efficient algorithm for learning linear ICA....
[...]
...t al., 2011c; Chen et al., 2012). Another rich family of feature extraction techniques that this review does not cover in any detail due to space constraints is Independent Component Analysis or ICA (Jutten and Herault, 1991; Comon, 1994; Bell and Sejnowski, 1997). Instead, we refer the reader to Hyvarinen¨ et al. (2001a); Hyvarinen¨ et al. (2009). Note that, while in the simplest case (complete, noisefree) ICA yields li...
[...]
...Therefore, ICA and its variants like Independent and Topographic ICA (Hyvärinen et al., 2001b) can and have been used to build deep networks (Le et al., 2010, 2011c): see section 11.2....
[...]
...Another rich family of feature extraction techniques that this review does not cover in any detail due to space constraints is Independent Component Analysis or ICA (Jutten and Herault, 1991; Bell and Sejnowski, 1997)....
[...]
...Note that, while in the simplest case (complete, noise-free) ICA yields linear features, in the more general case it can be equated with a linear generative model with non-Gaussian independent latent variables, similar to sparse coding (section 6.1.1), which result in non-linear features....
[...]
10,141 citations
References
2,460 citations
1,586 citations
219 citations
"Blind separation of sources, Part 1..." refers background in this paper
...Relations (24) and (25) are very close to mathematic formalizations [6] of rules for synaptic plasticity proposed as by Hebb [7] or Rauschecker and Singer [15]....
[...]
54 citations