We describe the primary ways researchers can determine the size of a sample of research participants, present the benefits and drawbacks of each of those methods, and focus on improving one method that could be useful to the CHI community: local standards. To determine local standards for sample size within the CHI community, we conducted an analysis of all manuscripts published at CHI2014. We find that sample size for manuscripts published at CHI ranges from 1 -- 916,000 and the most common sample size is 12. We also find that sample size differs based on factors such as study setting and type of methodology employed. The outcome of this paper is an overview of the various ways sample size may be determined and an analysis of local standards for sample size within the CHI community. These contributions may be useful to researchers planning studies and reviewers evaluating the validity of results.

/pdf/local-standards-for-sample-size-at-chi-4ob283byv5.pdf

Local Standards for Sample Size at CHI

This paper presents the results of a systematic review of existing literature on the integration of agile software development with user-centered design approaches. It shows that a common process model underlies such approaches and discusses which artifacts are used to support the collaboration between designers and developers.

/pdf/user-centered-design-and-agile-methods-a-systematic-review-4g6r8hblnw.pdf

User-Centered Design and Agile Methods: A Systematic Review

Interactive products designed for children--whether toys, games, educational products, or websites--are increasingly embedded in children's lives and school experiences. Making these products safe, effective, and entertaining requires new methodologies for carrying out sound and unbiased evaluations for these users with unique requirements, environments, and ethical considerations. 

This book directly addresses this need by thoroughly covering the evaluation of all types of interactive technology for children. Based on the authors' workshops, conference courses, and own design experience and research, this highly practical book reads like a handbook, while being thoroughly grounded in the latest research. Throughout, the authors illustrate techniques and principles with numerous mini case studies and highlight practical information in tips and exercises and conclude with three in-depth case studies. Essential reading for usability experts, product developers, and researchers in the field.

* Presents an essential background in child development and child psychology, particularly as they relate to technology. 

* Captures best practices for observing and surveying children, training evaluators, and capturing the child user experience using audio and visual technology.

* Examines ethical and legal issues involved in working with children and offers guidelines for effective risk management.

Evaluating Children's Interactive Products: Principles and Practices for Interaction Designers

The Experience Sampling Method (ESM) is used by scientists from various disciplines to gather insights into the intra-psychic elements of human life. Researchers have used the ESM in a wide variety of studies, with the method seeing increased popularity. Mobile technologies have enabled new possibilities for the use of the ESM, while simultaneously leading to new conceptual, methodological, and technological challenges. In this survey, we provide an overview of the history of the ESM, usage of this methodology in the computer science discipline, as well as its evolution over time. Next, we identify and discuss important considerations for ESM studies on mobile devices, and analyse the particular methodological parameters scientists should consider in their study design. We reflect on the existing tools that support the ESM methodology and discuss the future development of such tools. Finally, we discuss the effect of future technological developments on the use of the ESM and identify areas requiring further investigation.

/pdf/the-experience-sampling-method-on-mobile-devices-2sp1765hg0.pdf

The Experience Sampling Method on Mobile Devices

The current paper articulates how common difficulties encountered when attempting to implement or scale-up evidence-based treatments are exacerbated by fundamental design problems, which may be addressed by a set of principles and methods drawn from the contemporary field of user-centered design. User-centered design is an approach to product development that grounds the process in information collected about the individuals and settings where products will ultimately be used. To demonstrate the utility of this perspective, we present four design concepts and methods: (a) clear identification of end users and their needs, (b) prototyping/rapid iteration, (c) simplifying existing intervention parameters/procedures, and (d) exploiting natural constraints. We conclude with a brief design-focused research agenda for the developers and implementers of evidence-based treatments.

/pdf/user-centered-design-for-psychosocial-intervention-4y050rfw4o.pdf

User-Centered Design for Psychosocial Intervention Development and Implementation

Do you love your mobile phone? Your MP3 player? Your e-book reader? You laptop or tablet PC? There's a reason for that. Usability. When usability testing is part of the design and development of products, the results are better products that users want and like. You may be doing testing now or want to help your company get started, but you may not have all the tools to know how to properly prepare, test, analyze, and measure the results across a multitude of cultures, generations, and countries. And you may be facing tight budgets and short timeframes for testing. If this is your situation, this essential handbook gives you a variety of options and strategies for testing in numerous situations. Usability Testing Essentials presents a practical, step-by-step approach to learning the entire process of planning and conducting a usability test. It also explains how to analyze and apply the results and what to do when confronted with budgetary and time restrictions. This is the ideal book for anyone involved in usability or user-centered design-from students to seasoned professionals. *Provides comprehensive coverage of all phases of usability testing *Fully updated four color edition features important usability topics such as international testing, persona creation, remote testing, and accessibility *Follow-up to Usability Testing and Research (9780205315192, Longman, 2002), winner of the highest-level award from the Society for Technical Communication *Presents a step-by-step approach to the entire process of planning and conducting a usability test--an essential component of designing usable products*Comprehensive coverage of one of the most important skills necesary for usability and user experience practioners, and the first book of its kind to include international testing*Follow-up to Usability Testing and Research, which won the highest-level award from the Society for Technical Communication, and is already listed among the most widely recommended books in the field.

Understanding Your Users: A Practical Guide to User Requirements Methods, Tools, and Techniques

This new and completely updated edition is a comprehensive, easy-to-read, "how-to" guide on user research methods. You'll learn about many distinct user research methods and also pre- and post-method considerations such as recruiting, facilitating activities or moderating, negotiating with product developments teams/customers, and getting your results incorporated into the product. For each method, you'll understand how to prepare for and conduct the activity, as well as analyze and present the data - all in a practical and hands-on way. 

Each method presented provides different information about the users and their requirements (e.g., functional requirements, information architecture). The techniques can be used together to form a complete picture of the users' needs or they can be used separately throughout the product development lifecycle to address specific product questions. These techniques have helped product teams understand the value of user experience research by providing insight into how users behave and what they need to be successful. You will find brand new case studies from leaders in industry and academia that demonstrate each method in action. 

This book has something to offer whether you are new to user experience or a seasoned UX professional. After reading this book, you'll be able to choose the right user research method for your research question and conduct a user research study. Then, you will be able to apply your findings to your own products.



Completely new and revised edition includes 30+% new content!
Discover the foundation you need to prepare for any user research activity and ensure that the results are incorporated into your products 
Includes all new case studies for each method from leaders in industry and academia



Table of Contents


Preface

Part 1: What You Need to Know Before Choosing An Activity 1. Introduction to User Experience 2. Before You Choose an Activity: Learning About Your Product and Users 3. Ethical and Legal Considerations 4. Setting Up Research Facilities 5. Choosing a User Experience Research Activity

Part 2: Get Up and Running 6. Preparing For Your User Research Activity 7. During Your User Research Activity

Part 3: The Methods 8. Diary Studies 9. Interviews 10. Surveys 11. Card Sorting 12. Focus Groups 13. Field Studies 14. Evaluating Methods

Part 4: Wrapping Up 15. Concluding Final

Part 5: Appendices Appendix A. Requirements for Creating a Participant Recruitment Database Appendix B. Report Template Appendix C. Glossary Appendix D. References Index

Understanding Your Users: A Practical Guide to User Research Methods

Chapter 1 – introduction to user requirements

Agile development is being adopted by many leading software companies, such as those represented by this panel. Though many instructional resources exist to guide companies through a change to Agile Development, there are few resources available on the subject of Agile development and User Centered Design (UCD). As a result, user experience practitioners have had to develop their own tactics and strategies for maintaining sound UCD practices within their organizations when moving to Agile. This panel consists of six practitioners who actively work with development teams using Agile. Panel members will share the challenges and successes they face while championing UCD within their respective development organizations. Panelists will focus on adaptations to research methodology and strategy that make UCD possible to attain within Agile cultures.

Extreme usability: adapting research approaches for agile development

The Experience Sampling Method (ESM) enables researchers to capture information about participants' experiences in the moment. Adding an end-of-day retrospective survey also allows participants to elaborate on those experiences. Although the use of photos in retrospective interviews and surveys for memory elicitation is well known, little research has investigated the use of photos in ESM studies. As smartphone adoption increases facilitating ESM studies and making photo sharing easier, researchers need to continuously evaluate the method and investigate the role of photos in such studies. We conducted a large-scale ESM and retrospective survey study via Android smartphones with more than 1,000 US participants, and analyzed participants' photo submissions, including how photo use correlated with participants' data quality and what, if any, value photos added for researchers. Our study sheds light on the role of photos in ESM and retrospective studies that researchers can reference when constructing future study designs.

/pdf/photographing-information-needs-the-role-of-photos-in-6k73uupmc3.pdf

Kathy Baxter

Papers

Understanding Your Users: A Practical Guide to User Requirements Methods, Tools, and Techniques

Understanding Your Users: A Practical Guide to User Research Methods

Chapter 1 – introduction to user requirements

Extreme usability: adapting research approaches for agile development

Photographing information needs: the role of photos in experience sampling method-style research