For example, if you are a data scientist at a company, and a salesperson offers you a pre-trained model that is claimed to have a 90% accuracy of detecting fraudulent transactions. How would you go about verifying this claim?
I would test it on the data that I possess and see what the acc. is for detecting frauds in my data-set, and run a t-test with the sample acc., to see if it is close enough to 90% to make the call that it would detect 90% of all frauds in the entire population.
Let me know if this is the correct way to think about this question.