0
$\begingroup$

I want to do the following project and I think the best way is using tensorflow/keras: I have photos as images from a list with prices of products and I need classify these text objects from the images such that i identify the product name and the price. So I think it is different from normal Image classification since my objects are text objects? First, I thought it is like object detection in images but I think i need more to take these texts to another neural network?

Improve this question
$\endgroup$

1 Answer 1

Reset to default
1
$\begingroup$

I think you are referring to a king of image auto captioning, and why not sentence alignement ! I suggest you to go over the paper Deep Visual-Semantic Alignments for Generating Image Descriptions which is one of the references today (by M. Karpathy). The first step is about recognizing objects in an image and align sentences to them (done with R-CNN and BRNN) and the second is about generating new captions (CNN + RNN)

Even though it may be quite difficult to deeply go through, there is some code available on GitHub and it has been remade by a a lot of people with various implementations. Here is the summary.

Good luck !

Improve this answer
$\endgroup$
5
  • $\begingroup$ Sorry but that’s too complex. I have not yet st this link because you don’t understand me or should explain why this is so complicated ? $\endgroup$
    – Tido
    Dec 3, 2017 at 11:11
  • $\begingroup$ I am a beginner and looked st the tutorial for handwritten digits classification from tensorflow. So, you could do same thing with words instead of numbers from the image? It is going about word classification from an image... $\endgroup$
    – Tido
    Dec 3, 2017 at 11:13
  • $\begingroup$ why should this help me? I have only names in this images and want to extract them.. $\endgroup$
    – Tido
    Dec 4, 2017 at 18:11
  • $\begingroup$ It depends on how is your data. What do you have ? a list of predefined prices and objects ? $\endgroup$
    – Elliot
    Dec 4, 2017 at 18:26
  • $\begingroup$ I have images with product names and prices within like from a receipt. So in a predefined pattern $\endgroup$
    – Tido
    Dec 4, 2017 at 21:06

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.