There are so many CNNs out there and I am trying to do a comparison between some of them in my paper. Which networks should I include? Resnet, VGG, and Inception are obvious, but I would like three or four others. Which ones should I choose? There are so many variations out there like Xception, resnext, and ... that I am confused. Which of these networks are most used in the academic papers?
It largely depends what kind of paper you are writing — you haven't provided too much information in that regard. You could discuss a selection of models that have scored the highest on ImageNet. Most of these networks have historical significance, and brought a new aspect to the table.