Browse > Article
http://dx.doi.org/10.5351/KJAS.2016.29.5.787

Mode effects in concurrent mixed-mode surveys  

Baek, Jeeseon (Methodology Division, Statistical Research Institute, Statistics Korea)
Min, Kyung A (Methodology Division, Statistical Research Institute, Statistics Korea)
Publication Information
The Korean Journal of Applied Statistics / v.29, no.5, 2016 , pp. 787-806 More about this Journal
Abstract
Mixed-mode (MM) designs in which data are collected by different modes in one design have become increasingly popular. An MM data collection has several advantages such as reductions of coverage error, non-response and cost. However, MM designs may introduce mode effects that are confounded by selection effects and measurement effects, which can make MM data quality poor. In order to investigate mode effects, SRI implemented a concurrent mixed-mode experiment in 2014 where respondents could choose between a self-administrated Web survey and a self-administrated paper survey. This paper separately estimates selection effects and measurement effects. We found that measurement effects on some items are large.
Keywords
mixed-mode survey; mode effects; measurement effects; selection effects;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Bowling, A. (2005). Mode of questionnaire administration can have serious effects on data quality, Journal of Public Health, 27, 281-291.   DOI
2 Cannell, C., Miller, P., and Oksenberg, L. (1981). Research on interviewing techniques, Sociological Methodology, 389-437.
3 De Leeuw, E. (2005). To mix or not to mix? Data collection modes in surveys, Journal of Official Statistics, 21, 1-23.
4 Dillman, D. A., Phelps, G., Tortora, R., Swift, K., Kohrell, J., Berck, J., and Messer, B. L. (2009). Response rate and measurement differences in mixed-mode surveys using mail, telephone, interactive voice response (IVR), and the internet, Social Science Research, 38, 3-20.
5 Groves, R. (1989). Survey Errors and Survey Costs, Wiley, New York.
6 Groves, R., Fowler, F. J., Couper, M. P., Lepkowski, J. M., Singer, E., and Tourangeau, R. (2009). Survey Methodology, Wiley, New York.
7 Groves, R. and Kahn, R. (1979). Surveys by Telephone: A National Comparison with Personal Interviews, Academic Press, New York.
8 Jackle, A., Roberts, C., and Lynn, P. (2008). Assessing the effect of data collection mode on measurement, Institute for Social & Economic Research.
9 Tourangeau, R., Rips, L. J., and Rasinski, K. A. (2000). The Psychology of Survey Response, Cambridge University press, Cambridge.
10 Vannieuwenhuyze, J., Loosveldt, G., and Molenberghs, G. (2010). A method for evaluating mode effects in mixed-mode surveys, Public Opinion Quarterly, 74, 1027-1045.   DOI
11 Voogt, R. J. J. and Saris, W. E. (2005). Mixed mode designs; finding the balance between nonresponse bias and mode effects, Journal of Official Statistics, 21, 367-387.
12 Weisberg, H. F. (2005). The Total Survey Error Approach: A Guide to the New Science of Survey Research, University of Chicago, Chicago.