I am referring to plain neural networks, MLPs. I got to read the paper by Glorot and Bengio (2010), Understanding the difficulty of training deep feedforward neural networks.

Therein I read an interesting statement: ``Deep learning methods aim at learning feature hierarchies with features from higher levels of the hierarchy formed by the composition of lower level features''.

What does that mean in the framework of MLPs? As far as I could understand, such a features extraction and abstraction process is made feasible by the use of convolutional layers, hence more advancer Deep Learning models.


1 Answer 1


In MLP, you can imagine it as similar to finding features in different spaces. Like for n features you come up with k feature by using PCA, similarly here MLP is converting the n features into k* features in different space.


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.