I have a dataset of 90 periodic signals (current signals). These signals are divided into two big areas: Fault-free area and Fault area.
I sliced the signals using a window of 80ms with an overlap of 40ms in order to increase the dimensionality of the original dataset. Each window is labeled according to the part of the series which it was extracted from. Such approach generated a lot of points which are essentially the same due to the periodicity of the signal. As a consequence, when I try to fit my model and perform cross validation, I receive insane results such as 0.9999% accuracy. This is due to the fact that I have way too similar data points in my training set and in my validation set.
How can I solve this problem? Do you have any ideas?