I am working on an image classification problem using Transfer Learning with Resnet50 as base model (in Keras) (For example Class A and Class B).
There is a time factor involved in this classification. For example, I need sufficient evidence to make transition from one class to another.
So one of the thought came to my mind to make smooth transition is adding LSTM layer to the CNN layer (CNN+LSTM).
Need your help in understanding below queries.
Is there any way that I can add LSTM layer to the transfer learning process (assuming the CNN layer weights are not trainable)
How do I need to prepare the dataset (image frames). For example I have 10 videos each for class A and Class B. Do I need to keep the images in sequential order as it is in video. (As of now for the normal image classification, I have shuffled the image frames)
Any thought on building my own CNN + LSTM model.
A reference link would be great for 2 and 3.
Whether the image frames need to be updated as it is in the video ?
Any updates on this please.
Thank you, Deep Guy