I am searching for scientific work on skip-connections.
Everybody is talking about improving gradient flow through the Network, which feels like it makes sense. But I would love to understand and read what that means when it comes down to the math.
Other than the resnet paper I haven't found anything in depth about those magical skip-connections.
I am looking for any hints, papers or equations.