Neural Architecture Search with Reinforcement Learning
Citations
75 citations
Cites background from "Neural Architecture Search with Rei..."
...A myriad of recent efforts attempt to automate the process of the architecture design by searching among a set of smaller well-known building blocks [30, 34, 37, 19, 2, 20]....
[...]
75 citations
Cites background or methods from "Neural Architecture Search with Rei..."
...It is represented as a sequence of parameters to describe raw layers in NAS (Zoph & Le, 2016), followed by MetaQNN (Baker et al., 2017), ENAS (Pham et al., 2018), in which the selection of parameters is essentially finding subgraphs in a single directed acyclic graph (DAG)....
[...]
...Pure reinforced methods was initiated by NAS (Zoph & Le, 2016), later echoed by NASNet (Zoph et al., 2017), ENAS (Pham et al., 2018), MetaQNN (Baker et al., 2017), MnasNet (Tan et al., 2018), MONAS (Hsu et al., 2018) etc....
[...]
...In fact, macro-level search (Zoph & Le, 2016) is harmful to mobile devices regarding some underlying hardware designs (Ma et al., 2018)....
[...]
...…methods feature a recurrent neural controller (RNN or LSTM) to generate models, with its parameters updated by a family of Policy Gradient algorithms: REINFORCEMENT (Zoph & Le, 2016; Pham et al., 2018; Hsu et al., 2018), Proximal Policy Optimization (Zoph et al., 2017; Tan et al., 2018)....
[...]
74 citations
74 citations
Cites background from "Neural Architecture Search with Rei..."
...For the application of image classification there have been several recent successful efforts of automatically searching for successful architectures (Zoph and Le, 2016; Negrinho and Gordon, 2017; Liu et al., 2017)....
[...]
74 citations
Cites background from "Neural Architecture Search with Rei..."
...Zoph et al.(31,32) train a recurrent neural network via reinforcement learning to ̄nd neural network architectures that are likely to yield a good performance on speci ̄c tasks....
[...]
...Zoph and Le (2016) train a recurrent neural network via reinforcement learning to find neural network architectures that are likely to yield a good performance on specific tasks....
[...]
References
123,388 citations
111,197 citations
55,235 citations
"Neural Architecture Search with Rei..." refers methods in this paper
...Along with this success is a paradigm shift from feature designing to architecture designing, i.e., from SIFT (Lowe, 1999), and HOG (Dalal & Triggs, 2005), to AlexNet (Krizhevsky et al., 2012), VGGNet (Simonyan & Zisserman, 2014), GoogleNet (Szegedy et al., 2015), and ResNet (He et al., 2016a)....
[...]
42,067 citations
31,952 citations
"Neural Architecture Search with Rei..." refers methods in this paper
...Along with this success is a paradigm shift from feature designing to architecture designing, i.e., from SIFT (Lowe, 1999), and HOG (Dalal & Triggs, 2005), to AlexNet (Krizhevsky et al., 2012), VGGNet (Simonyan & Zisserman, 2014), GoogleNet (Szegedy et al., 2015), and ResNet (He et al., 2016a)....
[...]