In 2011, researchers at Bucknell University and Illinois Wesleyan University compared the search efficacy of Serial Solutions Summon, EBSCO Discovery Service, Google Scholar, and conventional library databases. Using a mixed-methods approach, qualitative and quantitative data were gathered on students’ usage of these tools. Regardless of the search system, students exhibited a marked inability to effectively evaluate sources and a heavy reliance on default search settings. This article describes these results and makes recommendations for libraries considering these tools.

/pdf/paths-of-discovery-comparing-the-search-effectiveness-of-3tm3x80g65.pdf

Paths of Discovery: Comparing the Search Effectiveness of EBSCO Discovery Service, Summon, Google Scholar, and Conventional Library Resources.

Many academic libraries have either implemented or are considering a Web-scale discovery system, but few usability studies have been published in the library literature. This article describes the usability testing performed at Tulane University on the Primo discovery system. Several usability challenges were identified, particularly with the least experienced users; however, there is strong evidence that users adapt quickly to the new interface. Most usability challenges can be alleviated with simple terminology changes. Also, despite some struggles in the testing, users typically rated the system highly in both usability and quality of results.

Usability Testing of a Web-Scale Discovery System at an Academic Library

One of the presumed advantages of next-generation library catalogue interfaces is that the user experience is improved—that it is both richer and more intuitive. Often the interfaces come with little or no user-facing documentation or imbedded "help" for patrons based on an assumption of ease of use and familiarity of the experience, having followed best practices in use on the Web. While there has been much gray literature (published on library Web sites, etc.) interrogating these implicit claims and contrasting the new interfaces to traditional Web-based catalogues, this article details a consistent and formal comparison of whether users can actually accomplish common library tasks, unassisted, using these interfaces. The author has undertaken a task-based usability test of vendor-provided next-generation catalogue interfaces and Web-scale discovery tools (Encore Synergy, Summon, WorldCat Local, Primo Central, EBSCO Discovery Service). Testing was done with undergraduates across all academic disciplines. The resulting qualitative data, noting any demonstrated trouble using the software as well as feedback or suggested improvements that the users may have about the software, will assist academic libraries in making or validating purchase and subscription decisions for these interfaces as well as help vendors make data-driven decisions about interface and experience enhancements.

/pdf/comparative-user-experiences-of-next-generation-catalogue-1fslzdrs13.pdf

Comparative User Experiences of Next-Generation Catalogue Interfaces

Web-scale discovery services promise fast, easy searching from a single Google-like box, pleasing users and making library resources more discoverable. Some librarians embrace the concept of giving users what they have come to expect from Google, while others are concerned that this will “dumb down” searching and undermine information literacy. In this article we explore the potential impact of Web-scale discovery tools on information literacy, focusing particularly on undergraduate research skills. We review the existing literature and present findings and experiences from two mid-sized academic libraries that have adopted EBSCO Discovery Service as their library home page portal.

/pdf/still-desperately-seeking-citations-undergraduate-research-2d7spinc14.pdf

Still Desperately Seeking Citations: Undergraduate Research in the Age of Web-Scale Discovery

Purpose – This paper aims to determine the current usage of next generation online public access catalogs (OPACs) and discovery tools in academic libraries in the USA and Canada.Design/methodology/approach – Using the same random sample of 260 colleges and universities in the USA and Canada from their original study, the authors revisited each institution's library web page to ascertain whether the OPAC interface(s) offered were the same or different than in their initial data collection. Data was collected and analyzed in October and November 2011.Findings – Discovery tool use has practically doubled in the last two years, from 16 percent to 29 percent. A total of 96 percent of academic libraries using discovery tools still provide access to their legacy catalog. The percentage of institutions using ILS OPACs with faceted navigation has increased from 2 percent to 4 percent. Combining the use of discovery tools and faceted OPACs, at least 33 percent of academic libraries are now using a faceted interface...

“Discovering” what's changed: a revisit of the OPACs of 260 academic libraries

Discovery tools are the next phase of library search systems. Illinois State University's Milner Library implemented EBSCO Discovery Service in August 2010. The authors conducted usability studies on the system in the fall of 2010. The aims of the study were twofold: first, to determine how Milner users set about using the system in order to better inform customization choices, which in turn would create better search experiences, and second, to find out whether discovery tools fix the problems of federated search. With federated search technology, users often felt frustrated by the search experience. Some reasons for the frustration included a desire for better ways to determine the relevancy of search results and for more information about the material included in the records. The authors determined that while many federated search problems were solved, some issues persisted. Overall, the move to EBSCO Discovery Service at Milner Library has been a positive experience for its users.

Promise Fulfilled? An EBSCO Discovery Service Usability Study

Web-scale discovery systems are gaining momentum among academic libraries as libraries seek a means to provide their users with a one-stop searching experience. Illinois State University's Milner Library found itself in the unique position of having access to two distinct discovery products, EBSCO Discovery Service and Serials Solutions’ Summon. Two researchers at Milner conducted a usability study for the former product in 2010, and now two other researchers, including one involved with the EBSCO Discovery Service study, have conducted the same study on the latter product. The goals of the study were twofold: first, to identify user behavior while using discovery systems’ search features and to see whether using these features would improve the user's searching experience, and second, to compare user experiences with EBSCO Discovery Service and Summon at Illinois State University. The similarities and differences in user expectations, use, manipulation, and satisfaction with both discovery tools are expl...

A Tale of Two Discoveries: Comparing the Usability of Summon and EBSCO Discovery Service

Determining Librarian Research Preferences: A Comparison Survey of Web-Scale Discovery Systems and Subject Databases

abstract:In fiscal year 2017, The Ohio State University Libraries in Columbus piloted the purchase of research data sets to explore how to integrate this format into the standard workflows of the collections strategist and electronic resources officer. The pilot project had few restrictions except that one-time money must be used and purchases must be available to the entire campus community. This pilot enabled the libraries to purchase several large-scale data sets while exploring issues around licensing, technical deployment, support, and assessment in an organization without a data librarian. This article details the pilot process and outlines the resulting considerations for future purchases of data sets.

/pdf/piloting-the-purchase-of-research-data-sets-as-collections-2z34zp1g3o.pdf

Piloting the Purchase of Research Data Sets as Collections: Navigating the Unknowns

Libraries continue to shift budgets toward obtaining more electronic resources. Electronic resources can develop problems at any time when a library offers access. Staff collaboration is vital in ensuring availability to those resources. Partnering with areas in the library that work most closely with patrons can help share the load of the technical services staff that maintain such resources. At Milner Library, the authors observed anecdotally that faculty and staff had varying opinions toward reporting problems with electronic resources. The authors polled Milner's faculty and staff to identify factors that lead them to report problems.

Anita K. Foster

Papers

Promise Fulfilled? An EBSCO Discovery Service Usability Study

A Tale of Two Discoveries: Comparing the Usability of Summon and EBSCO Discovery Service

Determining Librarian Research Preferences: A Comparison Survey of Web-Scale Discovery Systems and Subject Databases

Piloting the Purchase of Research Data Sets as Collections: Navigating the Unknowns

We're All in This Together: Library Faculty and Staff and Their Reporting of Electronic Resource Problems.