Currently I'm trying to build a neural network that is able to classify different types of bottles on an image solely based on the shape. The bottles have no label and at first I only used beer and wine bottles. My goal is to compare a neural network that uses feature extraction to one that uses the raw images.
Example input image:
Using openCV to process the images, I tried to obtain only the edges of the bottles and classify the types based on the shape. Currently, I am receiving the following result for the images:
In the next step, I cropped out each bottle in the image and split them into a 2d array of tiles (normally I try with 30x50 but in this image I show it with 10x20)
For every tile I execute PCA to extract the eigenvectors. In the end I receive a matrix of 10x20 tiles, where each of them contains the direction of the line. As you can see, the (0.0, 1.0) tuples are the vertical lines, and the (1.0, 0.0) tuples are the horizontal lines.
Sorry for the long post, here is my question:
Is it possible to use this data do classify between wine and beer bottles? The shape of the neck of the bottle is different but is it representative for building a neural network? I tried to train a model by calculating the gradient (arctan from the tuple) but i didn't manage to get some successful results. Does anyone have a idea how to pre-process the data for a neural network?
Is it better to use the cropped out images of the bottles as image data for the neural network?
I am thankful for any help as this is my first machine learning project and I would really like to get it working.