From a mix of real-world and back-calculated data how to remove the part that was back-calculated?

I have a geostatistical dataset and I've been building linear regression model, but when I plotted the data I've noticed that part of the data shows an absolute straight line trend, i.e. it is most likely not a real-world data, but it was back-calculated.

All the data is in pandas dataframe and I guess I need to find subset of the dataset that shows a perfect linear relationship, but I'm not quite sure how to approach it.

Try to fit several linear regression models, for very small number of observations from the data set (for instance, $$n$$ or $$n+1$$ randomly selected points, where $$n$$ is the number of dimensions). If there are enough perfectly linearly aligned points and enough models, it is likely that one of the models will be built from points that were only drawn from the back-calculus.
Then compare the models predictions to the actual data. For the models which perform very well on a large number of test cases (i.e. more than $$m$$ points are correctly predicted with an error of $$\epsilon$$ or less), these observations have probably been computed.
You will have to define $$m$$ and $$\epsilon$$ based on your knowledge of the problem / by adjustment.