Neural Architecture Search with Reinforcement Learning
Citations
46 citations
Cites methods from "Neural Architecture Search with Rei..."
...Our work is related to neural network architecture search [55, 5, 32, 14], which also aims to automate part of the model design process....
[...]
46 citations
45 citations
Cites background from "Neural Architecture Search with Rei..."
...search (NAS) [22], all of which facilitate the development and application of DNN models on edge systems....
[...]
45 citations
Cites background or methods from "Neural Architecture Search with Rei..."
...Random search [4, 23], reinforcement learning [77, 78, 61, 8, 1], neuro-evolutionary algorithms [60, 48, 41, 36, 47, 66], and gradient-based methods [37, 68, 9] have been used to solve the optimization problem, but the first three suffer from prohibitive computation costs....
[...]
...For search space, existing methods can be categorized into searching the network (macro) space [48, 77], the cell (micro) space [78, 35, 47, 37, 45], or exploring such a two-level space [54, 34] jointly....
[...]
...Since its inception NAS [77, 48] has been intensively studied with favorable outcomes [19, 72]....
[...]
...We therefore developed a Neural Architecture Search (NAS) [77, 48] based approach to automatically discover multi-scaled counting-by-density models....
[...]
45 citations
Cites background from "Neural Architecture Search with Rei..."
...Therefore, the challenge is: how do we make the AutoML search process over this design space as efficient as possible? There exists an enormous breadth of work from the AutoML community on how to best automate hyperparameter search [8, 7, 19], how to warm-start hyperparameter search [14, 16, 20], how to learn how to select good workflow configurations5 [9, 47], how to trade-off model performance and search time by modeling the time budget into multicriterion optimization problems, and even how to learn the structure of neural architectures [38, 55] and other ML workflows....
[...]
References
123,388 citations
111,197 citations
55,235 citations
"Neural Architecture Search with Rei..." refers methods in this paper
...Along with this success is a paradigm shift from feature designing to architecture designing, i.e., from SIFT (Lowe, 1999), and HOG (Dalal & Triggs, 2005), to AlexNet (Krizhevsky et al., 2012), VGGNet (Simonyan & Zisserman, 2014), GoogleNet (Szegedy et al., 2015), and ResNet (He et al., 2016a)....
[...]
42,067 citations
31,952 citations
"Neural Architecture Search with Rei..." refers methods in this paper
...Along with this success is a paradigm shift from feature designing to architecture designing, i.e., from SIFT (Lowe, 1999), and HOG (Dalal & Triggs, 2005), to AlexNet (Krizhevsky et al., 2012), VGGNet (Simonyan & Zisserman, 2014), GoogleNet (Szegedy et al., 2015), and ResNet (He et al., 2016a)....
[...]