scispace - formally typeset
Book ChapterDOI

What Users Do: The Eyes Have It

Reads0
Chats0
TLDR
It is argued that users retain a number of snippets in an “active band” that shifts down the result page, and that reading and clicking activity tends to takes place within the band in a manner that is not strictly sequential.
Abstract
Search engine result pages – the ten blue links – are a staple of document retrieval services. The usual presumption is that users read these one-by-one from the top, making judgments about the usefulness of documents based on the snippets presented, accessing the underlying document when a snippet seems attractive, and then moving on to the next snippet. In this paper we re-examine this assumption, and present the results of a user experiment in which gaze-tracking is combined with click analysis. We conclude that in very general terms, users do indeed read from the top, but that at a detailed level there are complex behaviors evident, suggesting that a more sophisticated model of user interaction might be appropriate. In particular, we argue that users retain a number of snippets in an “active band” that shifts down the result page, and that reading and clicking activity tends to takes place within the band in a manner that is not strictly sequential.

read more

Citations
More filters
Proceedings ArticleDOI

Searching, browsing, and clicking in a search session: changes in user behavior by task and over time

TL;DR: This study characterize and compare user behavior in relatively long search sessions for search tasks of four different types, noting that users shift their interests to focus less on the top results but more on results ranked at lower positions in browsing and that results eventually become less and less attractive for the users.
Proceedings ArticleDOI

Users versus models: what observation tells us about effectiveness metrics

TL;DR: The results show that user behavior is influenced by a blend of many factors, including the extent to which relevant documents are encountered, the stage of the search process, and task difficulty, which can be used to guide development of batch effectiveness metrics.
Journal ArticleDOI

Incorporating User Expectations and Behavior into the Measurement of Search Effectiveness

TL;DR: The role of search task complexity is investigated, and it is suggested that user behavior while scanning results listings is affected by the rate at which their goal is being realized, and hence that appropriate effectiveness metrics must be adaptive to the presence of relevant documents in the ranking.
Proceedings ArticleDOI

What Snippet Size is Needed in Mobile Web Search

TL;DR: A user study is conducted to investigate what size of snippet is appropriate for mobile devices and suggests that, unlike desktop users, mobile users are best served by snippets of two to three lines.
Journal ArticleDOI

Factors influencing viewing behaviour on search engine results pages: a review of eye-tracking research

TL;DR: A comprehensive narrative literature review of eye-tracking studies examining factors influencing users’ viewing behaviour on results pages of search engines found results in many sub-categories to be inconclusive.
References
More filters
Journal ArticleDOI

Cumulated gain-based evaluation of IR techniques

TL;DR: This article proposes several novel measures that compute the cumulative gain the user obtains by examining the retrieval result up to a given ranked position, and test results indicate that the proposed measures credit IR methods for their ability to retrieve highly relevant documents and allow testing of statistical significance of effectiveness differences.
Proceedings ArticleDOI

Accurately interpreting clickthrough data as implicit feedback

TL;DR: It is concluded that clicks are informative but biased, and while this makes the interpretation of clicks as absolute relevance judgments difficult, it is shown that relative preferences derived from clicks are reasonably accurate on average.
Proceedings ArticleDOI

Eye-tracking analysis of user behavior in WWW search

TL;DR: This work investigates how users interact with the results page of a WWW search engine using eye-tracking to gain insight into how users browse the presented abstracts and how they select links for further exploration.
Journal ArticleDOI

Variations in relevance judgments and the measurement of retrieval effectiveness

TL;DR: Very high correlations were found among the rankings of systems produced using different relevance judgment sets, indicating that the comparative evaluation of retrieval performance is stable despite substantial differences in relevance judgments, and thus reaffirm the use of the TREC collections as laboratory tools.
Journal ArticleDOI

Rank-biased precision for measurement of retrieval effectiveness

TL;DR: A new effectiveness metric, rank-biased precision, is introduced that is derived from a simple model of user behavior, is robust if answer rankings are extended to greater depths, and allows accurate quantification of experimental uncertainty, even when only partial relevance judgments are available.
Related Papers (5)