Is Second-Order Information Helpful for Large-Scale Visual Recognition?
Citations
1,378 citations
1,219 citations
Cites background from "Is Second-Order Information Helpful..."
...On the other hand, recent works [19, 21] have shown that second-order statistics in deep CNNs are more helpful for more discriminative representations than first-order ones....
[...]
...It is shown in [27, 19] that covariance normalization plays a critical role for more discriminative representations....
[...]
...As explored in [19], α = 1/2 works well for more discriminative representations....
[...]
1,048 citations
262 citations
Cites background or methods from "Is Second-Order Information Helpful..."
...The double-attention block is related to a number of recent works, including the Squeeze-andExcitation Networks [11], covariance pooling [14], the Non-local Neural Networks [25] and the Transformer architecture of [24]....
[...]
...Meanwhile, self-attentive and correlation operators like second-order pooling have been recently shown to work well in a wide range of tasks [24, 14, 15]....
[...]
226 citations
References
123,388 citations
73,978 citations
49,914 citations
42,067 citations
40,257 citations