I am estimating water depth with satellite data (predicted value) and would like to validate my result using bathymetry lidar data collected on the field and believed to be more accurate (observed value). I have different observations at each water depth. For example, number of observations at water depth range of 0-10m are 300, where as values at deeper depth range (10 - 20m) are less (~50 points). I have been using RMSE (as I would like to penalize larger error) to measure my accuracy but wondering if there is a better error metric out that is not sensitive to number of observations. In other words, for water depth 10 - 20m with 50 points, I have RMSE of ~6m, and I was thinking the value could be lower if I have more observations. Where as for shallow water depth (0-10m), my RMSE are much lower, perhaps because I have lots of observation.

I am estimating water depth with satellite data (predicted value) and would like to validate my result using bathymetry lidar data collected on the field and believed to be more accurate (observed value). I have different observations at each water depth. For example, number of observations at water depth range of 0-10 m are 300, where as values at deeper depth range (10 - 20 m) are less (~50 points). I have been using RMSE (as I would like to penalize larger error) to measure my accuracy but wondering if there is a better error metric out that is not sensitive to number of observations. In other words, for water depth 10 - 20 m with 50 points, I have RMSE of ~6m, and I was thinking the value could be lower if I have more observations. Where as for shallow water depth (0-10 m), my RMSE are much lower, perhaps because I have lots of observation.