A Tutorial on Bayesian Inference for the A/B Test with R and JASP

Popular in business, psychology, and the analysis of clinical trial data, the A/B test refers to a comparison between two proportions. Here we discuss two Bayesian A/B tests that allow users to monitor the uncertainty about a difference in two proportions as data accumulate over time. We emphasize the advantage of assigning a dependent prior distribution to the proportions (i.e., assigning a prior to the log odds ratio). This dependent-prior approach has been implemented in the open-source statistical software programs R and JASP. Several examples demonstrate how JASP can be used to apply this Bayesian test and interpret the results.