Basics of qualitative research: Grounded theory procedures and techniques

A meta-analysis of the comparative distance education (DE) literature between 1985 and 2002 was conducted. In total, 232 studies containing 688 independent achievement, attitude, and retention outcomes were analyzed. Overall results indicated effect sizes of essentially zero on all three measures and wide variability. This suggests that many applications of DE outperform their classroom counterparts and that many perform more poorly. Dividing achievement outcomes into synchronous and asynchronous forms of DE produced a somewhat different impression. In general, mean achievement effect sizes for synchronous applications favored classroom instruction, while effect sizes for asynchronous applications favored DE. However, significant heterogeneity remained in each subset.

/pdf/how-does-distance-education-compare-with-classroom-dh5xmepwak.pdf

How Does Distance Education Compare With Classroom Instruction? A Meta-Analysis of the Empirical Literature

The Web and especially major Web search engines are essential tools in the quest to locate online information for many people. This paper reports results from research that examines characteristics and changes in Web searching from nine studies of five Web search engines based in the US and Europe. We compare interactions occurring between users and Web search engines from the perspectives of session length, query length, query complexity, and content viewed among the Web search engines. The results of our research shows (1) users are viewing fewer result pages, (2) searchers on US-based Web search engines use more query operators than searchers on European-based search engines, (3) there are statistically significant differences in the use of Boolean operators and result pages viewed, and (4) one cannot necessary apply results from studies of one particular Web search engine to another Web search engine. The wide spread use of Web search engines, employment of simple queries, and decreased viewing of result pages may have resulted from algorithmic enhancements by Web search engine companies. We discuss the implications of the findings for the development of Web search engines and design of online content.

/pdf/how-are-we-searching-the-world-wide-web-a-comparison-of-nine-1vg6xqg009.pdf

How are we searching the world wide web?: a comparison of nine search engine transaction logs

This paper provides overview and instruction regarding the evaluation of interactive information retrieval systems with users The primary goal of this article is to catalog and compile material related to this topic into a single source This article (1) provides historical background on the development of user-centered approaches to the evaluation of interactive information retrieval systems; (2) describes the major components of interactive information retrieval system evaluation; (3) describes different experimental designs and sampling strategies; (4) presents core instruments and data collection techniques and measures; (5) explains basic data analysis techniques; and (4) reviews and discusses previous studies This article also discusses validity and reliability issues with respect to both measures and methods, presents background information on research ethics and discusses some ethical issues which are specific to studies of interactive information retrieval (IIR) Finally, this article concludes with a discussion of outstanding challenges and future research directions

https://www.nowpublishers.com/article/DownloadSummary/INR-012

Methods for Evaluating Interactive Information Retrieval Systems with Users

Users of online search engines often find it difficult to express their need for information in the form of a query. However, if the user can identify examples of the kind of documents they require then they can employ a technique known as relevance feedback. Relevance feedback covers a range of techniques intended to improve a user's query and facilitate retrieval of information relevant to a user's information need. In this paper we survey relevance feedback techniques. We study both automatic techniques, in which the system modifies the user's query, and interactive techniques, in which the user has control over query modification. We also consider specific interfaces to relevance feedback systems and characteristics of searchers that can affect the use and success of relevance feedback systems.

/pdf/a-survey-on-the-use-of-relevance-feedback-for-information-4ywe4mxljx.pdf

A survey on the use of relevance feedback for information access systems

This study examines the facets and patterns of multiple Web query reformulations with a focus on reformulation sequences Based on IR interaction models, it was presumed that query reformulation is the product of the interaction between the user and the IR system Query reformulation also reflects the interplay between the surface and deeper levels of user interaction Query logs were collected from a Web search engine through the selection of search sessions in which users submitted six or more unique queries per session The final data set was composed of 313 search sessions Three facets of query reformulation (content, format, and resource) as well as nine sub-facets were derived from the data In addition, analysis of modification sequences identified eight distinct patterns: specified, generalized, parallel, building-block, dynamic, multitasking, recurrent, and format reformulation Adapting Saracevic's stratified model, the authors develop a model of Web query reformulation based on the results of the study The implications for Web search engine design are finally discussed and the functions of an interactive reformulation tool are suggested

/pdf/analysis-of-multiple-query-reformulations-on-the-web-the-5gnvwatnw6.pdf

Analysis of multiple query reformulations on the web: The interactive information retrieval context

In order to design information retrieval (IR) systems to support various information-seeking strategies across a variety of contexts, it is important to explore what leads to the selection of different types of information-seeking strategies. This study addresses the issue by investigating the relationships between users' information-seeking goals and their information-seeking behaviors. The particular focus of this study is to specify hierarchical levels of user goals, and to investigate the micro-level goal labeled “interactive intention” in relation to information-seeking strategies. A total of 40 users from four types of libraries were selected for this study, and the analysis illustrates how changes in interactive intentions are associated with changes of information-seeking strategies. The results present how eight types of interactive intentions, four types of entities, eight types of methods, and six types of resources constitute the patterns of interactive intentions and information-seeking strategies. The implications for IR system design are further discussed.

Patterns between interactive intentions and information-seeking strategies

The emergence of Web-based IR systems calls for the need to support ease-of-use as well as user control This study attempts to investigate users' perceptions of ease-of-use versus user control, and desired functionalities as well as desired interface structure of online IR systems in supporting both ease-of-use and user control Forty subjects who had an opportunity to learn and use five online databases participated in the study Multiple methods were employed to collect data The qualitative and quantitative analysis of the data show that users consider both ease-of-use and user control are essential for effective retrieval The results are discussed within the context of a model of optimal support for ease-of-use and user control, particularly, emphasizing on the balance between system role and user involvement in achieving various IR sub-tasks

Supporting ease-of-use and user control: desired features and structure of web-based online IR systems

While some studies have investigated query reformulation in traditional online systems, there has been little understanding of how users reformulate their queries multiple times within search sessions on the Web. This paper reports on patterns and sequences of query reformulation based on query logs from a Web search engine. The data set contained only search sessions in which multiple query modifications were made. The analysis of data resulted in three facets of reformulation: content, format, and resource. Each facet was further categorized by 10 sub-facets. The results show that while most query reformulation involves content changes, about 15% of reformulation is related to format modifications. Six patterns of query reformulation emerged as a result of sequence analysis: specified reformulation, parallel reformulation, generalized reformulation, dynamic reformulation, format reformulation, and alternative reformulation. Each pattern is discussed with definitions and examples. The results indicate that both planned and situated aspects affect query reformulation in Web searching. The implications for new Web search engine tools and features are also discussed.

Patterns and Sequences of Multiple Query Reformulations in Web Searching: A Preliminary Study

Usage and user feedback about a state digital library, in which the developers/designers, content providers, different types of libraries and their staffs, and a variety of user groups represent a loose federation of separate organizations with diverse expectations and needs, are investigated. Through corroboratory evidence from usage statistics of Internet-based database services available through the digital library, responses to a statewide-administered library survey, and a Web-based survey of end users, the authors identify contributing factors for the organizational usability of state digital libraries. The authors refine and enhance an organizational usability model for the unique environment of state digital libraries and identify three modes of interaction (influence, communication, activity) and the challenges each interaction presents: in addressing diverse player needs and expectations; the unequal awareness and training in using state digital libraries; and the lack of sufficient communication channels among players. In addition, the findings highlight the double-edged impact of physical libraries on the state digital library.

Hong (Iris) Xie

Papers

Analysis of multiple query reformulations on the web: The interactive information retrieval context

Patterns between interactive intentions and information-seeking strategies

Supporting ease-of-use and user control: desired features and structure of web-based online IR systems

Patterns and Sequences of Multiple Query Reformulations in Web Searching: A Preliminary Study

State digital library usability: contributing organizational factors