Evaluating the Readability of Privacy Policies in Mobile Environments

Evaluating the Readability of Privacy Policies in Mobile Environments

R. I. Singh, M. Sumeeth, J. Miller
Copyright: © 2011 |Pages: 24
DOI: 10.4018/jmhci.2011010104
(Individual Articles)
No Current Special Offers


Recent work has suggested that the current “breed” of privacy policy represents a significant challenge in terms of comprehension to the average Internet-user. Due to display limitations, it is easy to represent the conjecture that this comprehension level should drop when these policies are moved into a mobile environment. This paper explores the question of how much does comprehension decrease when privacy policies are viewed on mobile versus desktop environments and does this decrease make them useless in their current format? It reports on a formal subject-based experiment, which seeks to evaluate how readable are privacy policy statements found on the Internet but presented in mobile environments. This experiment uses fifty participants and privacy policies collected from ten of the most popular web sites on the Internet. It evaluates, using a Cloze test, the subject’s ability to comprehend the content of these privacy policies.
Article Preview


Computing is undergoing a trend-shift from an environment dominated by desktops and servers to mobile environments such as smart phones, PDA’s, and various handheld devices. The success of mobile commerce has led to the large-scale development of applications for mobile users, providing easy access to the purchase of products using such devices. Most companies or organizations post one or more privacy policy documents on their websites to educate users and enhance security. A privacy policy can be described as a comprehensive description of a website’s practices on collecting, using and protecting user information. A privacy policy defines what information is collected, the purpose of information collection, and how this will be handled, stored, and used. Furthermore, it provides information on whether customers are allowed to access the collected information and to resolve privacy-related disputes with the website, etc (Story, 2007, para. 1). A poll conducted by CBS News (CBS) and The New York Times (Wobbrock, 2007) showed that 82% of respondents believe that the right to privacy is either under serious threat or is already lost. In addition, Internet users are concerned about companies collecting personal information and any risk that information may be shared with others inappropriately (Roberts, 2005, para. 1).

Unfortunately, the current privacy policies published on websites are usually long, complex and difficult for the end users to read and comprehend. Research has found that many online privacy policies lack clarity and most require a reading skill considerably higher than the Internet population’s average literacy level (Jensen & Potts, 2004). For privacy policies to be useful, they must be readable by online users who visit and use the website. This means that the privacy notice should be written at an appropriate level, and should be easy to navigate for information. There is a need to improve the current policies to help Internet users to read and understand website privacy policies and increase privacy awareness. A privacy policy must contain the following information for users (Federal Trade Commission, 2007):

  • ❖ How and where collected user information is used?

  • ❖ Whether the information can be linked to an individual

  • ❖ What happens to the information that has been collected?

  • ❖ If the information is shared with other websites or companies

  • ❖ Does the website install any software on the user system?

In this paper, we shall address the following fundamental question: Is readability affected in a mobile environment? More precisely, we shall focus on understanding the impact of display constraints of mobile devices on the readability of privacy policies. In this work, we shall study readability of policies in mobile devices and compare the results of mobile and desktop environments. The remainder of this paper is organized as follows: the next section provides an introduction to the issues and current directions associated with improving the readability of privacy policies. Next, the obvious readability challenge of mobile devices, namely screen size, is covered and others such as connection fees, lack of standards, and how user mobility affects readability. Then we explain some of the serious shortcomings of readability formulas and propose the Cloze test as a reliable replacement. The section concludes with a practical example of a Cloze test. Then, the readability of privacy policies on mobile devices is empirically explored. Next, we ask the question, do people prefer the mobile or desktop environments for readability? Not surprisingly, readers find the mobile environment significantly more difficult to comprehend privacy policies. Then suggestions are made in terms of what directions may be viable to resolve this problem; finally, the paper is concluded.

Complete Article List

Search this Journal:
Volume 16: 1 Issue (2024): Forthcoming, Available for Pre-Order
Volume 15: 1 Issue (2023)
Volume 14: 4 Issues (2022): 1 Released, 3 Forthcoming
Volume 13: 1 Issue (2021)
Volume 12: 3 Issues (2020)
Volume 11: 4 Issues (2019)
Volume 10: 4 Issues (2018)
Volume 9: 4 Issues (2017)
Volume 8: 4 Issues (2016)
Volume 7: 4 Issues (2015)
Volume 6: 4 Issues (2014)
Volume 5: 4 Issues (2013)
Volume 4: 4 Issues (2012)
Volume 3: 4 Issues (2011)
Volume 2: 4 Issues (2010)
Volume 1: 4 Issues (2009)
View Complete Journal Contents Listing