Could someone please explain to me in details (possibly from mathematical point of view) what is the role of Equivariance and Invariance in Convolutional Neural Networks, and how are they actually achieved? I found a similar question here but I did not get the full picture.
$\begingroup$
$\endgroup$
1
asked Nov 17, 2018 at 9:51
-
$\begingroup$ Was the answer sufficient? $\endgroup$– Laurent DuvalMay 8, 2021 at 22:27
Add a comment
|
2 Answers
$\begingroup$
$\endgroup$
Several answers have been provided to the role of equivariance or invariance question "What is the difference between “equivariant to translation” and “invariant to translation”.
Depending on how local they are, scalar and Convolution operators tend to be equivariant, max/min or range are more invariant, and subsampling/pooling can somewhat link those behavior.
$\begingroup$
$\endgroup$
Your question is discussed in detail in a video about generalized CNNs.
answered Oct 10, 2020 at 12:29