Testing the Statistical Significance of Microsimulation Results: A Plea

TitleTesting the Statistical Significance of Microsimulation Results: A Plea
Publication TypeInternational peer-reviewed journal article
Year of Publication2013
AuthorsGoedemé, T., Van den Bosch K., Salanauskaite L., & Verbist G.
JournalInternational Journal of Microsimulation

In the microsimulation literature, it is still uncommon to test the statistical significance of results. In this article we argue that this situation is both undesirable and unnecessary. Provided the parameters used in the microsimulation are exogenous, as is often the case in static microsimulation of the first-order effects of policy changes, simple statistical tests can be sufficient. Moreover, standard routines have been developed which enable applied researchers to calculate the sampling variance of microsimulation results, while taking the sample design into account, even of relatively complex statistics such as relative poverty, inequality measures and indicators of polarization, with relative ease and a limited time investment. We stress that when comparing simulated and baseline variables, as well as when comparing two simulated variables, it is crucial to take account of the covariance between those variables. Due to this covariance, the mean difference between the variables can generally (though not always) be estimated with much greater precision than the means of the separate variables.

KeywordsEU-SILC, EUROMOD, microsimulation, Statistical inference
Citation Key4087
Universiteit Antwerpen - University of Antwerp
Centrum voor Sociaal Beleid © 2005 - 2020