Is there a way to check the result of A/B test to determine the better one.
Group A has 100 views and 10 clicks.
Group B has 10 views and 2 clicks.
How to chose which one produces more clicks ?
Data Science Stack Exchange is a question and answer site for Data science professionals, Machine Learning specialists, and those interested in learning more about the field. It only takes a minute to sign up.Sign up to join this community
There are ways of understanding which of these is the right one to go with. Unforunately 10 views means no calculation is going to be great for you, but i'll try to explain both.
T-tests and Z-tests are used by a lot of AB Testing tools, as described here, to calculate winners. You'll be able to input views and clicks, and receieve back stats that describe if Group B's treatment is to win. You get back a yes/no answer, based on tolerances provided.
Bayesian calculations, on the other hand, rely on a percentage likelihood of being a winner, after which you can make a judgement.
If possible, you should run this for longer and try to drive more views to Group B. If the interaction rate of 20% persists, you'll see an eventual winner there (100% lift over the 10% rate for Group A).