We are planning a marketing campaign to collect data and the response rates for a random sample. Total population size is 10 million and historically, response rates are low (0.5 - 0.65 %).

How long do we need to run the test to collect a decent number of positive responses and how many positive responses need to aim for ?

I know there are no general rules for deciding the model data size as it all depends on the attributes and how predictive they are?

I am planning to run the test so that we get 5- 6K positive reponses for our campaign. We may need to send atleast 1 million mailers to get 6K responses. Only reason for proposing 6k number was aiming to collect as much as data and at the same time not spend too much on marketing.

Please let me know your thoughts about test sample size.

  • 2
    $\begingroup$ Does this answer your question? Time duration for ML models A/B testing $\endgroup$ – Erwan Oct 27 '20 at 1:01
  • $\begingroup$ It didn't answer this question, there are no general rules around data size. I had asked this question as i was curious about other people thoughts and how they would approach the problem. $\endgroup$ – Max64 Oct 29 '20 at 16:47

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.