Response Order Effects in Online Surveys: An Empirical Investigation

Response Order Effects in Online Surveys: An Empirical Investigation

M.A. Sanjeev (Jaypee Business School, Jaypee Institute of Information Technology, Noida, India) and Parul Balyan (Jaypee Business School, Jaypee Institute of Information Technology, Noida, India)
Copyright: © 2014 |Pages: 17
DOI: 10.4018/ijom.2014040103

Abstract

Online surveys are fast becoming the favourite tools of researchers due to various advantages they offer like ease of administration, reduced survey cost and real time data analysis. However they also have their drawbacks like any survey method; some of them being lack of population representativeness due to digital divide, consideration of the survey as spam eliciting low responses and technical glitches. Survey errors are generally classified in to two groups of Sampling & non-Sampling errors. Respondent errors, one of the most widely studied non- Sampling errors consist of Primacy and recency effects. The response order effects both Primacy and Recency have not been studied in online surveys according to accessible literatures; though their effect in oral and paper -pencil surveys are well documented. The existence of respondent errors in online surveys may vary vastly from other survey methods due to the respondent characteristics like higher education levels, control on the response setting and time and independence in response in the absence of a survey administrator. Using an experimental design we examined and provided preliminary evidence for response order effect (Primacy effect) in online surveys. We have also explored the impact of question complexity and questionnaire length on response order effects. The results indicate the existence of response order effects in online surveys, much like the traditional methods. The result also indicates the exacerbation of response errors due to question complexity and questionnaire length. Our study may offer valid insights and ideas to survey researchers, who use online survey tools, to reduce response order effects and thereby make their survey results more accurate.
Article Preview

1. Introduction

Twentieth century saw great advancements in survey research. The advancements encompassed technique and technology like systematic sampling methods, enhanced questionnaire design, computerized data analysis and online surveys. The scientific advancements in survey research were enhanced by the emergence of institutions and associations that enhanced the research practices. Some of these venerable institutions include ESOMAR (World Association of Opinion and Marketing Research Professionals, www.casro.com).

Table 1.
World wide internet usage
World RegionsPopulation (in Millions)Users-Dec. 31, 2000 (in Millions)Users-June. 30, 2012(in Millions)Penetration (% Population)Growth (%) 2000-2012
Africa1,073516715.60%3606.70%
Asia3,9221141,07627.50%841.90%
Europe82010551863.20%393.40%
Middle East22339040.20%2639.90%
North America34810827378.60%153.30%
Latin America / Caribbean5931825442.90%1310.80%
Oceania / Australia3682467.60%218.70%
WORLD TOTAL7,0153602,40234.30%566.40%

Source: http://www.internetworldstats.com/

Purchase this article to continue reading all 17 pages >

Complete Article List

Search this Journal:
Reset
Open Access Articles: Forthcoming
Volume 9: 4 Issues (2019): Forthcoming, Available for Pre-Order
Volume 8: 4 Issues (2018): 3 Released, 1 Forthcoming
Volume 7: 4 Issues (2017)
Volume 6: 4 Issues (2016)
Volume 5: 4 Issues (2015)
Volume 4: 4 Issues (2014)
Volume 3: 4 Issues (2013)
Volume 2: 4 Issues (2012)
Volume 1: 4 Issues (2011)
View Complete Journal Contents Listing