Browse > Article

Users' Understanding of Search Engine Advertisements  

Lewandowski, Dirk (Hamburg University of Applied Sciences Department of Information)
Publication Information
Journal of Information Science Theory and Practice / v.5, no.4, 2017 , pp. 6-25 More about this Journal
In this paper, a large-scale study on users' understanding of search-based advertising is presented. It is based on (1) a survey, (2) a task-based user study, and (3) an online experiment. Data were collected from 1,000 users representative of the German online population. Findings show that users generally lack an understanding of Google's business model and the workings of search-based advertising. 42% of users self-report that they either do not know that it is possible to pay Google for preferred listings for one's company on the SERPs or do not know how to distinguish between organic results and ads. In the task-based user study, we found that only 1.3 percent of participants were able to mark all areas correctly. 9.6 percent had all their identifications correct but did not mark all results they were required to mark. For none of the screenshots given were more than 35% of users able to mark all areas correctly. In the experiment, we found that users who are not able to distinguish between the two results types choose ads around twice as often as users who can recognize the ads. The implications are that models of search engine advertising and of information seeking need to be amended, and that there is a severe need for regulating search-based advertising.
Search engines; search engine marketing; search engine advertising; information retrieval; search engine results pages; selection behavior;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Fallows, D. (2005). Search engine users: Internet searchers are confident, satisfied and trusting- but they are also unaware and naive. Pew Internet & American Life Project. Washington, DC: Pew Internet & American Life Project.
2 Goel, S., Broder, A., Gabrilovich, E., & Pang, B. (2010). Anatomy of the long tail: Ordinary people with extraordinary tastes. In Proceedings of the third ACM international conference on Web search and data mining (pp. 201-210). ACM.
3 Google. (2017). Advertising policies help: Editorial. Retrieved from
4 Granka, L., Hembrooke, H., & Gay, G. (2006). Location location location: Viewing patterns on WWW pages. In Proceedings of the 2006 Symposium on Eye Tracking Research & Applications (Vol. 2005, pp. 43-43). New York: ACM.
5 Hochstotter, N., & Lewandowski, D. (2009). What users see - Structures in search engine results pages. Information Sciences, 179(12), 1796-1812.   DOI
6 Jansen, B. J. (2007). The comparative effectiveness of sponsored and nonsponsored links for Web e-commerce queries. ACM Transactions on the Web, 1(1), article 3.   DOI
7 Jansen, J. (2011). Understanding sponsored search: Core elements of keyword advertising. New York: Cambridge UP.
8 Joachims, T., Granka, L., Pan, B., Hembrooke, H., & Gay, G. (2005). Accurately interpreting clickthrough data as implicit feedback. In Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval (pp. 154-161). Salvador, Brazil: ACM.
9 Keane, M. T., O'Brien, M., & Smyth, B. (2008). Are people biased in their use of search engines? Communications of the ACM, 51(2), 49-52.   DOI
10 Kelly, D., & Azzopardi, L. (2015). How many results per page? A study of SERP size, search behavior and user experience categories and subject descriptors. In SIGIR'15, August 09-13, 2015, Santiago, Chile (pp. 183-192). New York: ACM.
11 Lewandowski, D. (2008). The retrieval effectiveness of web search engines: Considering results descriptions. Journal of Documentation, 64(6), 915-937.   DOI
12 Lewandowski, D. (2014). Why we need an independent index of the Web. In R. Konig & M. Rasch (Eds.), Society of the query reader: Reflections on web search (pp. 49-58). Amsterdam: Institute of Network Culture.
13 Lewandowski, D. (2015). Suchmaschinen verstehen. Berlin, Heidelberg: Springer.   DOI
14 Lewandowski, D. (2016). Die Suchergebnisseite als Dauerwerbesendung? In H. C. Mayr & M. Pinzger (Eds.), INFORMATIK 2016 (pp. 183-193). Bonn: Gesellschaft fur Informatik.
15 Lewandowski, D., Drechsler, J., & von Mach, S. (2012). Deriving query intents from web search engine queries. Journal of the American Society for Information Science & Technology, 63(9), 1773-1788.   DOI
16 Buckland, M. (2012). What kind of science can Information Science be? Journal of the American Society for Information & Techology, 63(1), 1-7.   DOI
17 Alphabet Inc. (2017). Annual Report pursuant to section 13 or 15(d) of the Securities Exchange Act of 1934 for the fiscal year ended December 31, 2016. Retrieved from
18 Battelle, J. (2005). The search: How Google and its rivals rewrote the rules of business and transformed our culture. London: Brealey.
19 Broder, A. (2002). A taxonomy of web search. ACM Sigir Forum, 36(2), 3-10.   DOI
20 Bundesverband Digitale Wirtschaft. (2009). Nutzerverhalten auf Google-Suchergebnisseiten: Eine Eyetracking-Studie im Auftrag des Arbeitskreises Suchmaschinen-Marketing des Bundesverbandes Digitale Wirtschaft (BVDW) e.V. Retrieved from
21 Card, S. K., Pirolli, P., Wege, M. Van Der, Morrison, J. B., Reeder, R. W., Schraedley, P. K., & Boshart, J. (2001). Information scent as a driver of web behavior graphs: Results of a protocol analysis method for web usability. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems CHI 01, 3(3), 498-505.   DOI
22 Charlton, G. (2013). 40% of consumers are unaware that Google Adwords are adverts. Econsultancy. Retrieved from
23 Cutrell, E., & Guan, Z. (2007). What are you looking for? An eye-tracking study of information usage in Web search. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2007) (pp. 407-416). New York: ACM.
24 Lewandowski, D., Sunkler, S., & Kerkmann, F. (2017). Are ads on Google Search engine results pages labeled clearly enough? In M. Gade, V. Trkulja, & V. Petras (Eds.), Everything changes, everything stays the same? Understanding information spaces. Proceedings of the 15th International Symposium of Information Science (ISI 2017), Berlin, 13th-15th March 2017 (pp. 62-74). Gluckstadt: Verlag Werner Hulsbusch.
25 Edelman, B. (2014). Google's advertisement labeling in 2014. Retrieved from
26 Edelman, B., & Gilchrist, D. S. (2012). Advertising disclosures: Measuring labeling alternatives in Internet search engines. Information Economics and Policy, 24, 75-89.   DOI
27 Lewandowski, D., Kerkmann, F., Rummele, S., & Sunkler, S. (2017). An empirical investigation on search engine ad disclosure. Journal of the Association for Information Science and Technology.   DOI
28 Liu, Z., Liu, Y., Zhang, M., & Ma, S. (2014). How do sponsored search results affect user behavior in web search? In Lecture notes in computer science (including subseries Lecture notes in artificial intelligence and lecture notes in bioinformatics) (Vol. 8870, pp. 73-85).
29 Liu, Z., Liu, Y., Zhou, K., Zhang, M., & Ma, S. (2015). Influence of vertical result in web search examination. In Proceedings of SIGIR'15, August 09 - 13, 2015, Santiago, Chile. New York: ACM.
30 Marchionini, G. (1995). Information seeking in electronic environments. Cambridge Series on Human-Computer Interaction.
31 Methode - Reichweitenwahrung der AGOF. (2015). Retrieved from
32 Purcell, K., Brenner, J., & Raine, L. (2012). Search engine use 2012. Washington, DC. Retrieved from
33 Nicholson, S., Sierra, T., Eseryel, U. Y., Park, J.-H., Barkow, P., Pozo, E. J., & Ward, J. (2006). How much of it is real? Analysis of paid placement in web search engine results. Journal of the American Society for Information Science and Technology, 57(4), 448-461.   DOI
34 Pan, B., Hembrooke, H., Joachims, T., Lorigo, L., Gay, G., & Granka, L. (2007). In Google We Trust: Users' decisions on rank, position, and relevance. Journal of Computer-Mediated Communication, 12(3), 801-823.   DOI
35 Petrescu, P. (2014). Google organic click-through rates in 2014. Moz. Retrieved from
36 Rowlands, I., Nicholas, D., Williams, P., Huntington, P., Fieldhouse, M., Gunter, B., & Tenopir, C. (2008). The Google generation: The information behavior of the researcher of the future. Aslib Proceedings, 60(4), 290-310.   DOI
37 Saracevic, T. (2016). Relevance: In search of a theoretical foundation. In D. Sonnenwald (Ed.), Theory development in the information sciences (pp. 141-163). Austin: University of Texas Press.
38 Sterling, G. (2016). Report: Nearly 60 percent of searches now from mobile devices. Retrieved from
39 Sullivan, D. (2013a). FTC updates search engine ad disclosure guidelines after 'decline in compliance.' Retrieved from
40 Sullivan, D. (2013b). Revealed: The 17 other search engines the FTC warned over paid ad disclosures. Retrieved from
41 Tober, M., Grundmann, J., & Thakur, A. (2016). New options to generate more Google traffic: Universal & extended search 2016: Facts, trends and optimization tips. Berlin: Searchmetrics.
42 Tremel, A. (2010). Suchen, finden-glauben?: Die Rolle der Glaubwurdigkeit von Suchergebnissen bei der Nutzung von Suchmaschinen. Ludwig-Maximilians-Universitat Munchen. Retrieved from
43 Vogl, P., & Barret, M. (2010). Regulating the information gatekeepers. Communications of the ACM, 53(11), 67-72.   DOI
44 Wall, A. (2012). Consumer ad awareness in search results. Seobook. Retrieved from
45 Ellis, D. (1989). A behavioral approach to information retrieval system design. Journal of Documentation, 45(3), 171-212.   DOI