3
$\begingroup$

I found a couple of sources which mention mean pooling for convolutional neural networks (CNNs) - including all lectures I had about CNNs so far - but I could not find any paper with at least 10 citations which uses mean pooling.

Do you know of a paper which uses mean pooling?

$\endgroup$
2
  • 1
    $\begingroup$ Are you only interested in mean pooling, or also in sum pooling? I could write an answer mentioning at least two relevant papers using sum pooling. $\endgroup$
    – hbaderts
    Nov 13 '16 at 18:01
  • $\begingroup$ Interesting! I have not heard of sum-pooling before. Yes, that is also interesting and also relevant to the question, as it is only a constant multiplication of sum pooling to get mean pooling. $\endgroup$ Nov 13 '16 at 18:03
3
$\begingroup$

Sum-pooling, which is of course just a scaled version of mean pooling, has been proposed for the task of content-based image retrieval (CBIR). To my best knowledge, the first paper for this was the following, and has (according to Google Scholar) gathered 35 citations over its first year of being published:

1A. Babenko and V. Lempitsky: "Aggregating Deep Convolutional Features for Image Retrieval". In IEEE International Conference on Computer Vision (ICCV), Dec. 2015, pp. 1269-1277. DOI: 10.1109/ICCV.2015.150. arXiv: 1510.07493.

A very short explanation of image retrieval: For large-scale image retrieval, a new query image has to be compared to a database of thousands of images to find the most similar image. While previous work has achieved this by matching SIFT descriptors, recently CNN-based descriptors have become the state-of-the-art2.

The basic idea when using CNNs for image retrieval is, to use a network which is pre-trained (usually on a classification task, such as ILSVRC) and use the output of a layer as the descriptor vector3,4. Different papers propose using either one of the FC layers or one of the Conv layers as the descriptor.

As the outputs of these layers are very large - too large to use as a "compact" descriptor of an image - the usual approach is to reduce the dimensionality to something in the range of 32 to 1024. This is usually done by L2-normalization → PCA Whitening → L2-normalization 1,3,4.

Now finally, I get to the sum-pooling part: Babenko and Lempitsky1 show that sum-pooling leads to a better retrieval performance than max-pooling, when the dimensionality of the resulting descriptor is reduced using PCA and Whitening. Their SPoC (Sum-Pooling of Convolutions) method outperforms other pooling/embedding methods, such as max-pooling, Fisher vectors and triangular embedding.

Final words: more recent work (ICLR 2016) proposes the so-called R-MAC descriptor5, which is the regional maximum activations of convolutions, i.e. they use a set of regions at different scales, calculate the feature vector for each region using max-pooling, and finally sum up all these regional feature vectors. This again improves over the sum-pooling proposed in 1. Still it has a kind of sum-pooling over the different regions in it.

Footnotes & References

2If required, I can add a few citations to show this, just comment below.

3A.S. Razavian, H. Azizpour, J. Sullivan, and S. Carlsson, "CNN Features Off-the-Shelf: An Astounding Baseline for Recognition", in IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, Jun. 2014, pp. 512–519. DOI: 10.1109/CVPRW.2014.131. arXiv: 1403.6382.

4A. Babenko, A. Slesarev, A. Chigorin, and V. Lempitsky, "Neural Codes for Image Retrieval", in European Conference on Computer Vision (ECCV), Sep. 2014, pp. 584–599. DOI: 10.1007/978-3-319-10590-1_38. arXiv: 1404.1777.

5G. Tolias, R. Sicre, and H. Jégou, "Particular object retrieval with integral max-pooling of CNN activations", in International Conference on Learning Representations (ICLR), Oct. 2016, pp. 1–11. arXiv: 1511.05879.

$\endgroup$
3
$\begingroup$

I just found an answer myself:

Boureau, Y-Lan, Jean Ponce, and Yann LeCun. "A theoretical analysis of feature pooling in visual recognition." In Proceedings of the 27th international conference on machine learning (ICML-10), pp. 111-118. 2010.

See also: shortscience summary

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.