What Video Games Have to Teach Us about Learning and Literacy

This paper examines the literature on computer games and serious games in regard to the potential positive impacts of gaming on users aged 14 years or above, especially with respect to learning, skill enhancement and engagement. Search terms identified 129 papers reporting empirical evidence about the impacts and outcomes of computer games and serious games with respect to learning and engagement and a multidimensional approach to categorizing games was developed. The findings revealed that playing computer games is linked to a range of perceptual, cognitive, behavioural, affective and motivational impacts and outcomes. The most frequently occurring outcomes and impacts were knowledge acquisition/content understanding and affective and motivational outcomes. The range of indicators and measures used in the included papers are discussed, together with methodological limitations and recommendations for further work in this area.

A systematic literature review of empirical evidence on computer games and serious games

BACKGROUND: Postal and electronic questionnaires are widely used for data collection in epidemiological studies but non-response reduces the effective sample size and can introduce bias. Finding ways to increase response to postal and electronic questionnaires would improve the quality of health research. OBJECTIVES: To identify effective strategies to increase response to postal and electronic questionnaires. SEARCH STRATEGY: We searched 14 electronic databases to February 2008 and manually searched the reference lists of relevant trials and reviews, and all issues of two journals. We contacted the authors of all trials or reviews to ask about unpublished trials. Where necessary, we also contacted authors to confirm methods of allocation used and to clarify results presented. We assessed the eligibility of each trial using pre-defined criteria. SELECTION CRITERIA: Randomised controlled trials of methods to increase response to postal or electronic questionnaires. DATA COLLECTION AND ANALYSIS: We extracted data on the trial participants, the intervention, the number randomised to intervention and comparison groups and allocation concealment. For each strategy, we estimated pooled odds ratios (OR) and 95% confidence intervals (CI) in a random-effects model. We assessed evidence for selection bias using Egger's weighted regression method and Begg's rank correlation test and funnel plot. We assessed heterogeneity among trial odds ratios using a Chi(2) test and the degree of inconsistency between trial results was quantified using the I(2) statistic. MAIN RESULTS: PostalWe found 481 eligible trials. The trials evaluated 110 different ways of increasing response to postal questionnaires. We found substantial heterogeneity among trial results in half of the strategies. The odds of response were at least doubled using monetary incentives (odds ratio 1.87; 95% CI 1.73 to 2.04; heterogeneity P < 0.00001, I(2) = 84%), recorded delivery (1.76; 95% CI 1.43 to 2.18; P = 0.0001, I(2) = 71%), a teaser on the envelope - e.g. a comment suggesting to participants that they may benefit if they open it (3.08; 95% CI 1.27 to 7.44) and a more interesting questionnaire topic (2.00; 95% CI 1.32 to 3.04; P = 0.06, I(2) = 80%). The odds of response were substantially higher with pre-notification (1.45; 95% CI 1.29 to 1.63; P < 0.00001, I(2) = 89%), follow-up contact (1.35; 95% CI 1.18 to 1.55; P < 0.00001, I(2) = 76%), unconditional incentives (1.61; 1.36 to 1.89; P < 0.00001, I(2) = 88%), shorter questionnaires (1.64; 95% CI 1.43 to 1.87; P < 0.00001, I(2) = 91%), providing a second copy of the questionnaire at follow up (1.46; 95% CI 1.13 to 1.90; P < 0.00001, I(2) = 82%), mentioning an obligation to respond (1.61; 95% CI 1.16 to 2.22; P = 0.98, I(2) = 0%) and university sponsorship (1.32; 95% CI 1.13 to 1.54; P < 0.00001, I(2) = 83%). The odds of response were also increased with non-monetary incentives (1.15; 95% CI 1.08 to 1.22; P < 0.00001, I(2) = 79%), personalised questionnaires (1.14; 95% CI 1.07 to 1.22; P < 0.00001, I(2) = 63%), use of hand-written addresses (1.25; 95% CI 1.08 to 1.45; P = 0.32, I(2) = 14%), use of stamped return envelopes as opposed to franked return envelopes (1.24; 95% CI 1.14 to 1.35; P < 0.00001, I(2) = 69%), an assurance of confidentiality (1.33; 95% CI 1.24 to 1.42) and first class outward mailing (1.11; 95% CI 1.02 to 1.21; P = 0.78, I(2) = 0%). The odds of response were reduced when the questionnaire included questions of a sensitive nature (0.94; 95% CI 0.88 to 1.00; P = 0.51, I(2) = 0%).ElectronicWe found 32 eligible trials. The trials evaluated 27 different ways of increasing response to electronic questionnaires. We found substantial heterogeneity among trial results in half of the strategies. The odds of response were increased by more than a half using non-monetary incentives (1.72; 95% CI 1.09 to 2.72; heterogeneity P < 0.00001, I(2) = 95%), shorter e-questionnaires (1.73; 1.40 to 2.13; P = 0.08, I(2) = 68%), including a statement that others had responded (1.52; 95% CI 1.36 to 1.70), and a more interesting topic (1.85; 95% CI 1.52 to 2.26). The odds of response increased by a third using a lottery with immediate notification of results (1.37; 95% CI 1.13 to 1.65), an offer of survey results (1.36; 95% CI 1.15 to 1.61), and using a white background (1.31; 95% CI 1.10 to 1.56). The odds of response were also increased with personalised e-questionnaires (1.24; 95% CI 1.17 to 1.32; P = 0.07, I(2) = 41%), using a simple header (1.23; 95% CI 1.03 to 1.48), using textual representation of response categories (1.19; 95% CI 1.05 to 1.36), and giving a deadline (1.18; 95% CI 1.03 to 1.34). The odds of response tripled when a picture was included in an e-mail (3.05; 95% CI 1.84 to 5.06; P = 0.27, I(2) = 19%). The odds of response were reduced when "Survey" was mentioned in the e-mail subject line (0.81; 95% CI 0.67 to 0.97; P = 0.33, I(2) = 0%), and when the e-mail included a male signature (0.55; 95% CI 0.38 to 0.80; P = 0.96, I(2) = 0%). AUTHORS' CONCLUSIONS: Health researchers using postal and electronic questionnaires can increase response using the strategies shown to be effective in this systematic review.

/pdf/methods-to-increase-response-to-postal-and-electronic-4sjz3r84m4.pdf

Methods to increase response to postal and electronic questionnaires

Factors affecting response rates of the web survey: A systematic review

One question that arises when discussing the usefulness of web-based surveys is whether they gain the same response rates compared to other modes of collecting survey data. A common perception exists that, in general, web survey response rates are considerably lower. However, such unsystematic anecdotal evidence could be misleading and does not provide any useful quantitative estimate. Metaanalytic procedures synthesising controlled experimental mode comparisons could give accurate answers but, to the best of the authors' knowledge, such research syntheses have so far not been conducted. To overcome this gap, the authors have conducted a meta-analysis of 45 published and unpublished experimental comparisons between web and other survey modes. On average, web surveys yield an 11% lower response rate compared to other modes (the 95% confidence interval is confined by 15% and 6% to the disadvantage of the web mode). This response rate difference to the disadvantage of the web mode is systematically influenced by the sample recruitment base (a smaller difference for panel members as compared to one-time respondents), the solicitation mode chosen for web surveys (a greater difference for postal mail solicitation compared to email) and the number of contacts (the more contacts, the larger the difference in response rates between modes). No significant influence on response rate differences can be revealed for the type of mode web surveys are compared to, the type of target population, the type of sponsorship, whether or not incentives were offered, and the year the studies were conducted. Practical implications are discussed.

Web Surveys versus other Survey Modes: A Meta-Analysis Comparing Response Rates:

A study was conducted to evaluate user performance and satisfaction in completion of a set of text creation tasks using three commercially available continuous speech recognition systems. The study also compared user performance on similar tasks using keyboard input. One part of the study (Initial Use) involved 24 users who enrolled, received training and carried out practice tasks, and then completed a set of transcription and composition tasks in a single session. In a parallel effort (Extended Use), four researchers used speech recognition to carry out real work tasks over 10 sessions with each of the three speech recognition software products. This paper presents results from the Initial Use phase of the study along with some preliminary results from the Extended Use phase. We present details of the kinds of usability and system design problems likely in current systems and several common patterns of error correction that we found.

/pdf/patterns-of-entry-and-correction-in-large-vocabulary-3n4cjiqfe1.pdf

Patterns of entry and correction in large vocabulary continuous speech recognition systems

http://edutainment.pbworks.com/f/orvis_horn_belanich_2008.pdf

The roles of task difficulty and prior videogame experience on performance and motivation in instructional videogames

An experiment was conducted to determine the effectiveness of three invitation and incentive combinations in a web-based survey. A stratified convenience sample of 434 researchers who were target users of a collaboratory for earthquake engineering was randomly divided into three experimental conditions: (a) a $5 bill sent with the survey instructions via first class mail, (b) a $5 gift certificate code to Amazon.com sent with the survey instructions via first-class mail, or (c) a $5 gift certificate code to Amazon.com sent with the survey instructions via e-mail. Overall response was 43%. Results show that $5 bills led to significantly higher response rates than either gift certificate condition (57% for cash vs. 36% for the two gift certificate conditions, χ2(1)=9.3, p < .01). This suggests that cash is a superior incentive for an online survey, even with technologically sophisticated respondents. This may be due to the perceived limitations, delayed payoff, or reduced visibility of online gift certificates.

http://www-personal.umich.edu/~danhorn/reprints/Horn_2004_Web_Survey_Incentives_SSCORE.pdf

The effects of cash, electronic, and paper gift certificates as respondent incentives for a web-based survey of technologically sophisticated respondents

Automatic Speech Recognition (ASR) systems have improved greatly over the last three decades. However, even with 98% reported accuracy, error correction still consumes a significant portion of user effort in text creation tasks. We report on data collected during a study of three commercially available ASR systems that show how initial users of speech systems tend to fixate on a single strategy for error correction. This tendency coupled with application assumptions about how error correction features will be used, combine to make a very frustrating, and unsatisfying user experience. We observe two distinct error correction patterns: spiral depth (Oviatt & van Gent, 1996) and cascades. In contrast, users with more extensive experience learn to switch correction strategies more quickly.

/pdf/the-beauty-of-errors-patterns-of-error-correction-in-desktop-58i4zatjll.pdf

The Beauty of Errors: Patterns of Error Correction in Desktop Speech Systems.

In this paper, we describe the evolution and impact of computer-supported cooperative work (CSCW) research through social network analysis of coauthorship data. A network of authors as nodes and shared papers as links is used to compare patterns of growth and collaboration in CSCW with other domains, such as high-energy physics and computer science. Further, the coauthorship network data are used to depict dynamic changes in the structure of CSCW collaborations over time. Examination of these changes shows high volatility in the composition of the CSCW research community over decade-long time spans. These data are augmented by a brief citation analysis of recent CSCW conferences. We discuss the implications of the CSCW findings in terms of the influence of CSCW research on the larger field of HCI research as well as the general utility of social network analysis for understanding patterns of collaboration.

/pdf/six-degrees-of-jonathan-grudin-a-social-network-analysis-of-29v6uyrh3p.pdf

Daniel B. Horn

Papers

Patterns of entry and correction in large vocabulary continuous speech recognition systems

The roles of task difficulty and prior videogame experience on performance and motivation in instructional videogames

The effects of cash, electronic, and paper gift certificates as respondent incentives for a web-based survey of technologically sophisticated respondents

The Beauty of Errors: Patterns of Error Correction in Desktop Speech Systems.

Six degrees of jonathan grudin: a social network analysis of the evolution and impact of CSCW research