Social Desirability Bias in CATI, IVR, and Web Surveys The Effects of Mode and Question Sensitivity

TLDR: The authors examined the effect of different modes of self-administration on the reporting of potentially sensitive information by a sample of university graduates, and found that the effects of the mode of data collection and the actual status of the respondent influenced whether respondents found an item sensitive.

Abstract: Although it is well established that self-administered ques- tionnaires tend to yield fewer reports in the socially desirable direction than do interviewer-administered questionnaires, less is known about whether different modes of self-administration vary in their effects on socially desirable responding In addition, most mode comparison stud- ies lack validation data and thus cannot separate the effects of differ- ential nonresponse bias from the effects of differences in measurement error This paper uses survey and record data to examine mode effects on the reporting of potentially sensitive information by a sample of re- cent university graduates Respondents were randomly assigned to one of three modes of data collection—conventional computer-assisted tele- phone interviewing (CATI), interactive voice recognition (IVR), and the Web—and were asked about both desirable and undesirable attributes of their academic experiences University records were used to evaluate the accuracy of the answers and to examine differences in nonresponse bias by mode Web administration increased the level of reporting of sensi- tive information and reporting accuracy relative to conventional CATI, with IVR intermediate between the other two modes Both mode of data collection and the actual status of the respondent influenced whether respondents found an item sensitive