A Standard Problem: Determining Sample Size Recently, I was tasked with a straightforward question: "In an A/B test setting, how many samples do I have to collect in order to obtain significant results?" As ususal in statistics, the answer is not quite as straightforward as the question, and it depends quite a bit on the framework. In this case, the A/B test was supposed to test whether the effect of a treatment on the success rate p had the assumed size e.

Continue reading

Author's picture

Sebastian Schweer

Theoretiker, Ingenieur, Berater, Erzähler.

Data Analyst

Heidelberg, Germany