1. bookVolume 58 (2021): Issue 1 (June 2021)
Journal Details
License
Format
Journal
eISSN
2199-577X
First Published
17 Aug 2013
Publication timeframe
2 times per year
Languages
English
access type Open Access

The Pearson Bayes factor: An analytic formula for computing evidential value from minimal summary statistics

Published Online: 24 Jun 2021
Volume & Issue: Volume 58 (2021) - Issue 1 (June 2021)
Page range: 1 - 26
Journal Details
License
Format
Journal
eISSN
2199-577X
First Published
17 Aug 2013
Publication timeframe
2 times per year
Languages
English
Summary

In Bayesian hypothesis testing, evidence for a statistical model is quantified by the Bayes factor, which represents the relative likelihood of observed data under that model compared to another competing model. In general, computing Bayes factors is difficult, as computing the marginal likelihood of data under a given model requires integrating over a prior distribution of model parameters. In this paper, I capitalize on a particular choice of prior distribution that allows the Bayes factor to be expressed without integral representation, and I develop a simple formula – the Pearson Bayes factor – that requires only minimal summary statistics as commonly reported in scientific papers, such as the t or F score and the degrees of freedom. In addition to presenting this new result, I provide several examples of its use and report a simulation study validating its performance. Importantly, the Pearson Bayes factor gives applied researchers the ability to compute exact Bayes factors from minimal summary data, and thus easily assess the evidential value of any data for which these summary statistics are provided, even when the original data is not available.

Keywords

Faulkenberry T.J. (2018): Computing Bayes factors to measure evidence from experiments: An extension of the BIC approximation. Biometrical Letters 55(1): 31–43.10.2478/bile-2018-0003 Search in Google Scholar

Faulkenberry T.J. (2019a): Estimating Bayes factors from minimal ANOVA summaries for repeated-measures designs. arXiv:1905.05569.10.51936/abic6583 Search in Google Scholar

Faulkenberry T.J. (2019b): Estimating evidential value from analysis of variance summaries: A comment on Ly (2018). Advances in Methods and Practices in Psychological Science 2(4): 406–409.10.1177/2515245919872960 Search in Google Scholar

Fisher R.A. (1925): Statistical Methods for Research Workers. Oliver & Boyd, Edinburgh. Search in Google Scholar

García-Donato G., Sun D. (2007): Objective priors for hypothesis testing in one-way random effects models. Canadian Journal of Statistics, 35(2): 303–320.10.1002/cjs.5550350207 Search in Google Scholar

Gönen M., Johnson W.O., Lu Y., Westfall P.H. (2005): The Bayesian two-sample t test. The American Statistician, 59(3): 252–257.10.1198/000313005X55233 Search in Google Scholar

Jeffreys H. (1961): The Theory of Probability (3rd ed.). Oxford University Press, Oxford, UK. Search in Google Scholar

Kass R.E., Raftery A.E. (1995): Bayes factors. Journal of the American Statistical Association, 90(430): 773.10.1080/01621459.1995.10476572 Search in Google Scholar

Liang F., Paulo R., Molina G., Clyde M.A., Berger J.O. (2008): Mixtures of g priors for Bayesian variable selection. Journal of the American Statistical Association, 103(481): 410–423.10.1198/016214507000001337 Search in Google Scholar

Maruyama Y. (2009): A Bayes factor with reasonable model selection consistency for ANOVA model. arXiv:0906.4329v2. Search in Google Scholar

Masson M.E.J. (2011): A tutorial on a practical Bayesian alternative to null-hypothesis significance testing. Behavior Research Methods, 43(3): 679–690.10.3758/s13428-010-0049-521302025 Search in Google Scholar

Raftery A.E. (1995): Bayesian model selection in social research. Sociological Methodology, 25: 111–163.10.2307/271063 Search in Google Scholar

Rouder J.N., Engelhardt C.R., McCabe S., Morey R.D. (2016): Model comparison in ANOVA. Psychonomic Bulletin & Review, 23(6): 1779–1786.10.3758/s13423-016-1026-527068543 Search in Google Scholar

Rouder J.N., Morey R.D., Speckman P.L., Province J.M. (2012): Default Bayes factors for ANOVA designs. Journal of Mathematical Psychology, 56(5): 356–374.10.1016/j.jmp.2012.08.001 Search in Google Scholar

Schwarz G. (1978): Estimating the dimension of a model. The Annals of Statistics, 6(2): 461–464.10.1214/aos/1176344136 Search in Google Scholar

Sellke T., Bayarri M.J., Berger J.O. (2001): Calibration of p-values for testing precise null hypotheses. The American Statistician, 55(1): 62–71.10.1198/000313001300339950 Search in Google Scholar

Student (1908): The probable error of a mean. Biometrika, 6(1):1.10.2307/2331554 Search in Google Scholar

Thiele J.E., Haaf J.M., Rouder J.N. (2017): Is there variation across individuals in processing? Bayesian analysis for systems factorial technology. Journal of Mathematical Psychology, 81: 40–54.10.1016/j.jmp.2017.09.002 Search in Google Scholar

Wagenmakers E.J. (2007): A practical solution to the pervasive problems of p values. Psychonomic Bulletin & Review, 14(5): 779–804.10.3758/BF0319410518087943 Search in Google Scholar

Wang M., Liu G. (2016): A simple two-sample Bayesian t-test for hypothesis testing. The American Statistician, 70(2): 195–201.10.1080/00031305.2015.1093027 Search in Google Scholar

Wang M., Sun X. (2014): Bayes factor consistency for one-way random effects model. Communications in Statistics - Theory and Methods, 43(23): 5072–5090.10.1080/03610926.2012.739252 Search in Google Scholar

Wasserstein R.L., Lazar N.A. (2016): The ASA statement on p-values: Context, process, and purpose. The American Statistician, 70(2): 129–133.10.1080/00031305.2016.1154108 Search in Google Scholar

Zellner A. (1986): On assessing prior distributions and Bayesian regression analysis with g-prior distributions. In Goel, P. K. and Zellner, A., editors, Bayesian inference and decision techniques: Essays in Honor of Bruno de Finetti, pages 233–243. Elsevier. Search in Google Scholar

Recommended articles from Trend MD

Plan your remote conference with Sciendo