I am working on a project where I classify tiny moving particles into a few classes (fibers, hairs, glass shards, bubbles). The particles are only a few pixels large and are observed in a few frames as the particle moves and rotates. As the particles are so tiny, it is expected that classification with a CNN or observed particle characteristics on singular observations do not yield a satisfactory accuracy. A voting system can be used to classify the particle with multiple observations but it might be possible to achieve a better result.
I am looking for a method to combine the different observations of a particle to extract new relevant features. For example, if the shape of the particle varies over the different frames, this could indicate that the particle is not symmetrical.
Do you know any methods that perform such multi-observation classification methods? Thanks a lot!