Big Data Deep Learning: Challenges and Perspectives
Citations
975 citations
Cites background from "Big Data Deep Learning: Challenges ..."
...[28] An introduction to deep learning for big data....
[...]
...The era of big data is triggering wide interest in deep learning across different research disciplines [28]–[31] and a growing number of surveys and tutorials are emerging (e....
[...]
922 citations
915 citations
Cites background from "Big Data Deep Learning: Challenges ..."
...Such explosion of data makes these fields endorse the concept and power of big data [1]–[3]....
[...]
907 citations
Cites background or methods from "Big Data Deep Learning: Challenges ..."
...Below is the equation [23] for change in weights, where c is the momentum factor and α is the learning rate, and v and h are visible and hidden units respectively....
[...]
...Modified Neural Networks such as Deep Belief Network (DBM) as described by Chen and Lin [23] uses both labeled and unlabeled data with supervised and unsupervised learning respectively to improve performance....
[...]
...Linear models are learnt from the dataset in a single iteration by adjusting the weights between the hidden layer and the output, whereas the weights between the input and the hidden layers are randomly initialized and fixed [69]....
[...]
...Chen and Lin [23] highlights the fact that conventional neural network can easily get stuck in local minima when the function is non-convex....
[...]
...Equation [23] for probability distribution for hidden and visible inputs....
[...]
903 citations
References
73,978 citations
42,067 citations
23,814 citations
"Big Data Deep Learning: Challenges ..." refers background in this paper
...While deep learning has shown impressive results in many applications, its training is not a trivial task for Big Data learning due to the fact that iterative computations inherent in most deep learning algorithms are often extremely difficult to be parallelized....
[...]
18,761 citations
"Big Data Deep Learning: Challenges ..." refers methods in this paper
...Furthermore, GPUs are being utilized to implement a model parallel scheme: each GPU is only used for a different part of the model optimization with the same input examples; collectively, their communication occurs through the MVAPICH2 MPI....
[...]
18,616 citations