# Deep Learning Classification Model for data with time dimension

I know it might be a generic question but I would still appreciate some feedback. So I have a dataset with 4 dimensions (time, x, y, color). Where I have a total of 24000 records each with (5, 188, 188, 3) this dimension where I have a 5-time dimension which is like 5 different time intervals each at 15 minutes difference. Now I have to build a model for binary classification from the image. So initially I used Resnet with 3 dimensions from data (x, y, color), which gave a pretty decent result. Now I also want to include the time dimension in my data but I'm not sure RESNET will make any sense if the time dimension is included. Can someone tell me if there's another network that I can try where the model can make use of time dimension, or adding a layer like LSTM in the model can be helpful? I have attached a sample gif with 5-time dimensions and 1 color. Any suggestion will be appreciated.

Sample data:

[[[0.1798448 , 0.1735874 , 0.1735874 , ..., 0.04843931,
0.05156801, 0.05469671],
[0.17671609, 0.1798448 , 0.1829735 , ..., 0.05156801,
0.05313236, 0.05156801],
[0.18140915, 0.1861022 , 0.18140915, ..., 0.05156801,
0.05313236, 0.05156801],
...,
[[0.17515175, 0.17045869, 0.1735874 , ..., 0.05626106,
0.05000366, 0.05626106],
[0.17515175, 0.1735874 , 0.17202304, ..., 0.06564717,
0.06408282, 0.06721152],
[0.1735874 , 0.1735874 , 0.16889434, ..., 0.06721152,
0.06251846, 0.06095411],
...,
[0.06877588, 0.07034022, 0.06877588, ..., 0.01715229,
0.01558794, 0.01715229],
[0.07346892, 0.07190457, 0.06721152, ..., 0.01871664,
0.01715229, 0.02028099],
[0.07503328, 0.06721152, 0.06564717, ..., 0.01558794,
0.02184534, 0.02184534]],

[[0.1735874 , 0.17045869, 0.16889434, ..., 0.04843931,
0.05313236, 0.05938977],
[0.17515175, 0.17202304, 0.16732998, ..., 0.05938977,
0.05938977, 0.06408282],
[0.17045869, 0.16889434, 0.16576564, ..., 0.06564717,
0.06251846, 0.06564717]]], dtype=float32)


• You have a color video, right?
– Dave
Jun 17 at 1:42
• @Dave not exactly color video, I have 4d array as mentioned above where 1st dimension is time and last is color channel. I created gif file from that using 5 time dimension and 1 color channel for vizulization. Jun 17 at 2:00
• I do not follow your last sentence about five times dimensions and one color channel, but if your data are a bunch of gifs, I would call that video-like.
– Dave
Jun 17 at 2:59
• @Dave yup it’s like that. Can you suggest me something that I should try? Any suggestions will be appreciated! :) Jun 18 at 11:23