Computations and formulae with examples on basic A/B testing experience
A simple follow along notebook explaining how to get:
- Required sample size for a specific A/B test experience
- Which hypothesis to set up and test to perform based on sample size
- Examples of Z test
- Examples of t-test
- The binary case
- A list of online tools
The files for the example are available in the folder. All required packages are listed in requirements.txt
- Ztest, hypothesis and directionnality https://towardsdatascience.com/hypothesis-testing-z-scores-337fb06e26ab
- statistical significance https://towardsdatascience.com/statistical-significance-hypothesis-testing-the-normal-curve-and-p-values-93274fa32687
- non-inferiority testing https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2701110/pdf/nihms112245.pdf