Showing papers in "Computers in Education in 2014"
TL;DR: Testing both social networking and gamification in an undergraduate course found that both approaches presented better performance than a traditional e-learning approach in terms of academic achievement for practical assignments, but that, when it came to assessing knowledge, theTraditional e- learning approach was better.
Abstract: While social networking has already demonstrated its efficiency in e-learning, gamification, which is the use of game-thinking and playful design in non-game contexts, has only shown its potential as a motivational tool. This paper presents the results of testing both social networking and gamification in an undergraduate course, comparing them in terms their effect on students' academic achievement, participation and attitude. The effects of a gamification plugin deployed in a learning management system were compared to those of a social networking site in the same educational setting. We found that both approaches presented better performance than a traditional e-learning approach in terms of academic achievement for practical assignments, but that, when it came to assessing knowledge, the traditional e-learning approach was better. Also challenging current assumptions, participation rates and scores remained low with the new tools, although students' attitudes were positive.
482 citations
TL;DR: This study applies a framework for institutional BL adoption to 11 U. S. institutions participating in a Next Generation Learning Challenge (NGLC) grant and attempting to transition from an awareness/exploration of BL to the adoption/early implementation phase and identifies patterns and distinctions.
Abstract: Relatively little of the current research on blended learning (BL) addresses institutional adoption issues. Additional research is needed to guide institutions of higher education in strategically adopting and implementing blended learning on campus. The authors conducted a prior study in which they proposed a framework for institutional BL adoption (Graham, Woodfield, & Harrison, 2012), identifying three stages: (1) awareness/exploration, (2) adoption/early implementation, and (3) mature implementation/growth. The framework also identified key strategy, structure, and support issues universities may address at each stage. The current study applies this adoption framework to 11 U. S. institutions participating in a Next Generation Learning Challenge (NGLC) grant and attempting to transition from an awareness/exploration of BL to the adoption/early implementation phase. The study also compares U.S. institutional strategy, structure, and support approaches to BL adoption and identifies patterns and distinctions.
420 citations
TL;DR: Three implications are drawn for enhancing the pedagogical designs in digital classrooms that put emphasis on fostering students' development of information literacy competency and critical thinking skills through day-to-day domain knowledge learning in class.
Abstract: A study was conducted for creating digital classrooms to support students to develop information literacy competency and critical thinking skills through domain knowledge learning in digital classrooms. A total of 107 students from four Secondary 1 classes were invited from a secondary school in Hong Kong to participate in the study. In the 13-week trial teaching, every three students shared a Tablet PC for learning two topics in the Integrated Humanities subject. The pre- and post-tests of the two target subject topics found that the students had a statistically significant growth in domain knowledge. The three identical information literacy tests and critical thinking tests throughout the trial teaching found that the students had a statistically significant growth in information literacy competency and critical thinking skills. The semi-structured interviews found that the students and teachers positively perceived the effectiveness of the pedagogical designs of the digital classrooms on supporting the development of information literacy competency and critical thinking skills. Three implications are drawn for enhancing the pedagogical designs in digital classrooms that put emphasis on fostering students' development of information literacy competency and critical thinking skills through day-to-day domain knowledge learning in class.
367 citations
TL;DR: Overall, the study provides the first path model investigating early childhood educators’ technology use and provides practical considerations to aid teachers’ use of technology in the classroom.
Abstract: The current study uses path modeling to investigate the relationship between extrinsic and intrinsic factors that influence early childhood educators’ digital technology use. Survey data from 1234 early childhood educators indicate that attitudes toward the value of technology to aid children’s learning have the strongest effect on technology use, followed by confidence and support in using technology. Additionally, student SES has the strongest effect on attitudes, while support and technology policy influence teacher confidence, which in turn influences attitudes. In contrast, more experienced teachers have more negative attitudes. Overall, the study provides the first path model investigating early childhood educators’ technology use and provides practical considerations to aid teachers’ use of technology in the classroom.
296 citations
TL;DR: The results suggest that the predicted negative consequences of external rewards may be addressed in this new generation of learning environments.
Abstract: This study investigated the effects of external rewards on fifth graders' motivation, engagement and learning while playing an educational game. We were interested in exploring whether the feedback-rich environment of the game could mitigate the predicted negative effects of external rewards. Data of students' engagement and learning were collected and analyzed at multiple levels. A quasi-experimental design was used to examine the effect of external rewards in one group (n = 50) compared to a control group without such rewards (n = 56). According to the results, the external rewards did not undermine students' motivation (e.g., at proximal and distal levels), however they did not foster disciplinary engagement. On the other hand, students in the reward condition showed significantly larger gains in conceptual understanding (proximal) and non-significantly larger gains in achievement (distal). These results suggest that the predicted negative consequences of external rewards may be addressed in this new generation of learning environments. Future research and contributions of the study are provided.
211 citations
TL;DR: Women taking a math test in a virtual representation of a classroom after being exposed to one of three leaderboard conditions performed more poorly on the math test than those in the male leaderboard condition, yet demonstrated a higher level of academic identification than thoseIn the male and control conditions.
Abstract: Gamification includes the use of gaming features, such as points or leaderboards, in non-gaming contexts, and is a frequently-discussed trend in education. One way of gamifying the classroom is to introduce leaderboards. Leaderboards allow students to see how they are performing relative to others in the same class. Little empirical research has investigated the impact of leaderboards on academic performance. In this study, 80 female undergraduates took a math test in a virtual representation of a classroom after being exposed to one of three leaderboard conditions: a leaderboard where men held the majority of the top positions, a leaderboard where women held the majority of top positions, and a no leaderboard condition. Participants in the female majority leaderboard condition performed more poorly on the math test than those in the male leaderboard condition, yet demonstrated a higher level of academic identification than those in the male and control conditions. The authors conclude with a discussion of the implications that this study's findings may have for the use of leaderboards within educational environments.
200 citations
TL;DR: A location-based augmented reality (AR) environment with a five-step guiding mechanism is developed to guide students to share knowledge in inquiry learning activities to provide guidance for helping teachers develop effective strategies and learning designs for conducting inquiry-based learning activities.
Abstract: Inquiry learning has been developing for years and many countries have incorporated inquiry learning into the scope of K-12 education. Educators have indicated the importance of engaging students in knowledge-sharing activities during the inquiry learning process. In this study, a location-based augmented reality (AR) environment with a five-step guiding mechanism is developed to guide students to share knowledge in inquiry learning activities. To evaluate the effectiveness of the proposed approach in terms of promoting the knowledge sharing behaviors of students, an experiment has been conducted in an elementary school natural science course. The participants were 57 fourth-grade students from an elementary school in Northern Taiwan, divided into an experimental group of 28 students who learned with the AR-based approach and a control group of 29 students who learned with the conventional in-class mobile learning approach. The students' learning behaviors, including their movements in the real-world environment and interactions with peers, were recorded. Accordingly, the learning patterns and interactions of the two groups were analyzed via lag-sequential analysis and quantitative content analysis. It was found that, in comparison with the conventional inquiry-based mobile learning activity, the AR-based inquiry learning activity is able to engage the students in more interactions for knowledge construction. The findings of this study provide guidance for helping teachers develop effective strategies and learning designs for conducting inquiry-based learning activities.
195 citations
TL;DR: Higher rates of internet use were associated with lower test grades and students' beliefs about this relationship did not reflect their ability to multi-task effectively, and students discounted the effect of using portable devices on learning over time.
Abstract: The use of laptops and cell phones in the classroom is increasing but there is little research assessing whether these devices create distraction that diminishes learning. Moreover, the contribution of intellectual ability to the relationship between learning and portable device use has not been thoroughly investigated. To bridge this gap, students in an introductory psychology class were surveyed about the frequency and duration of their use of various portable devices in the classroom. Internet use negatively predicted exam scores and added to the prediction of classroom learning, above a measure of intellectual ability. Furthermore, students discounted the effect of using portable devices on learning over time. Concomitantly, those with higher intellectual ability reported using the internet more in class over time. Thus, higher rates of internet use were associated with lower test grades and students' beliefs about this relationship did not reflect their ability to multi-task effectively.
187 citations
TL;DR: It is found that, on average, participants did increase their understanding as a result of learning with the Internet, and that a data-driven approach to understanding relations among SRL, EC, and learning yielded the most powerful representation of these phenomena.
Abstract: The growing prominence of the Internet, and other digital environments, as educational tools requires research regarding learners' digital literacy. We argue that two critical aspects of digital literacy are the ability to effectively plan and monitor the efficacy of strategies used to search and manage the wealth of information available online, and the knowledge to appropriately vet and integrate those information sources. Therefore, digital literacy requires effective self-regulated learning (SRL) skills, and availing epistemic cognition (EC). Although numerous researchers and scholars have examined the role of SRL in online learning (e.g., Efklides, 2011 ; Lee and Tsai, 2010 , Williams and Hellman, 2004 , Winters et al., 2008 ), there is a need for additional empirical research on how SRL and EC interact, and relate to learning in digital environments. In this study, we used a powerful, but little-used data collection methodology, think-aloud protocol (TAP) analysis, to investigate the relations among SRL, EC, and learning gains with 20 college students who studied vitamins on the Internet. We also contributed to the literature by exploring alternative techniques for preparing, analyzing, and representing these data, accounting for the strengths and challenges of TAPs. We found that, on average, participants did increase their understanding as a result of learning with the Internet, and that a data-driven approach to understanding relations among SRL, EC, and learning yielded the most powerful representation of these phenomena. Our study has implications for future research on digital literacy using TAPs, as well as the relative contribution of SRL and EC, as aspects of digital literacy, to online learning.
177 citations
TL;DR: Higher homework task motivation and self-efficacy to concentrate on homework were associated with less frequent and shorter durationMultitasking behaviors, while greater negative affect was linked to longer duration multitasking behaviors during the session.
Abstract: We investigated the frequency and duration of distractions and media multitasking among college students engaged in a 3-h solitary study/homework session. Participant distractions were assessed with three different kinds of apparatus with increasing levels of potential intrusiveness: remote surveillance cameras, a head-mounted point-of-view video camera, and a mobile eyetracker. No evidence was obtained to indicate that method of assessment impacted multitasking behaviors. On average, students spent 73 min of the session listening to music while studying. In addition, students engaged with an average of 35 distractions of 6 s or longer over the course of 3 h, with an aggregated mean duration of 25 min. Higher homework task motivation and self-efficacy to concentrate on homework were associated with less frequent and shorter duration multitasking behaviors, while greater negative affect was linked to longer duration multitasking behaviors during the session. We discuss the implications of these data for assessment and for understanding the nature of distractions and media multitasking during solitary studying.
161 citations
TL;DR: Controlling for relevant background characteristics; students who take some of their early courses online or at a distance have a significantly better chance of attaining a community college credential than do their classroom only counterparts.
Abstract: Using a nationally representative sample (The Beginning Postsecondary Student Survey, BPS 04/09), this study examined the associations between enrollment in credit-bearing distance education courses and degree attainment. We sought to determine whether US students enrolled in distance education courses during their first year of study at a community college tend to complete a degree (certificate, associate, or bachelor's) at significantly lower rates than those who were not enrolled in such courses or programs. Consistent with previous large-scale research at the State level in Virginia and Washington (Smith Jaggars & Xu, 2010; Xu & Smith Jaggars, 2011), we hypothesized that community college students who participate in distance education in early semesters graduate at lower rates than students who do not. Contrary to expectations, the study found that controlling for relevant background characteristics; students who take some of their early courses online or at a distance have a significantly better chance of attaining a community college credential than do their classroom only counterparts. These results imply that a new model of student retention in the age of the internet, one that assumes transactional adaptation, may be warranted.
TL;DR: Examination of the role of academic emotions in learning demonstrated that enjoyment mediated the relationship between perceived academic control and self-regulated learning, but the moderating effect of enjoyment was not significant.
Abstract: Self-regulated learning is recognized as a critical factor for successful online learning, and students' perceived academic control and academic emotions are important antecedents of self-regulated learning. Because emotions and cognition are interrelated, investigating the joint relationship between perceived academic control and academic emotions on self-regulated learning would be valuable to understanding the process of self-regulated learning. Therefore, this study examined the role of academic emotions (enjoyment, anxiety, and boredom) in the relationship between perceived academic control and self-regulated learning in online learning. The path model was proposed to test the mediating and moderating effects of academic emotions. Data were collected from 426 Korean college students registered in online courses, and a path analysis was conducted. The results demonstrated that enjoyment mediated the relationship between perceived academic control and self-regulated learning, but the moderating effect of enjoyment was not significant. Boredom and anxiety did not have significant mediating effects on self-regulated learning, whereas they showed significant moderating effects in the relationship between perceived academic control and self-regulated learning. The role of academic emotions in learning and their implications for facilitating students' self-regulated learning in online learning were discussed based on the findings.
TL;DR: Findings indicate that student–content interaction had a larger effect on student learning outcomes than other forms of dialogue, as measured by student satisfaction and student grades.
Abstract: This study measured how student interactions (as captured by Transactional Distance dialogue ( Moore, 1993 )) in online and blended learning environments impacted student learning outcomes, as measured by student satisfaction and student grades. Dialogue was measured as student interactions with other students (student–student interaction), the technologies used (student–technology interaction), the instructors (student–teacher interaction), and the course contents (student–content interaction). In addition, moderating effects of media and modality of interactions and individual differences on student learning outcomes were also measured. Data was obtained from 342 online and blended students between 2010 and 2013. Findings indicate that student–content interaction had a larger effect on student learning outcomes than other forms of dialogue. Implications for educational policies that require teacher-presence (student–teacher) and student–student interactions in distance learning environments are also discussed.
TL;DR: A combination of surveys and in-class observations are used to study how students use their laptops in an unmonitored and unrestricted class setting—a large lecture-based university class with nearly 3000 enrolled students.
Abstract: Students often have their own individual laptop computers in university classes, and researchers debate the potential benefits and drawbacks of laptop use. In the presented research, we used a combination of surveys and in-class observations to study how students use their laptops in an unmonitored and unrestricted class setting—a large lecture-based university class with nearly 3000 enrolled students. By analyzing computer use over the duration of long (165 minute) classes, we demonstrate how computer use changes over time. The observations and studentreports provided similar descriptions of laptop activities. Note taking was the most common use for the computers, followed by the use of social media web sites. Overall, the data show that students engaged in off-task computer activities for nearly two-thirds of the time. An analysis of the frequency of the various laptop activities over time showed that engagement in individual activities varied significantly over the duration of the class.
TL;DR: The important role teachers play in helping young students build oral-interaction strategies to capitalise on high levels of learning engagement is discussed, and the unique features of these devices are discussed.
Abstract: In the few years since its release, Apple's iPad has generated much discussion about its potential to support student learning at all levels of the education system. Much of this has focused on its physical and technical attributes, such as portability, touch-display, connectivity, and large array of apps. However, a few studies have begun to explore possible advantages of iPads being used as public work spaces, enabling students to interact more collaboratively when creating learning outputs. These studies point to other affordances such as the iPad's ability to lay flat on a desk or be propped at a convenient angle, its wide viewing range and multi-user accessible interface, as being particularly relevant in supporting collaboration. Between June and November 2013, researchers from the University of Waikato used a specifically developed ‘observeware’ app to capture display and audio data while young students (5 year olds) were using iPads in pairs for developing numeracy, literacy and problem-solving/decision-making skills. The study used Mercer's (1994) talk types framework to explore the nature of talk students engaged in while they were using the iPads and interacting with each other and their teacher, and also how features of the device may have influenced this. Results indicated exceptionally high levels of on-task talk, but that this was mostly of an affirming and non-critical nature and unsupportive of outcome improvement or refinement. While the iPad offered unique potential as a shared, public learning device, the pedagogical role of the teacher in realising this by helping students learn appropriate ‘ground rules’ to raise talk quality, was critical. This article details the methodology used and the results of the study. It discusses the important role teachers play in helping young students build oral-interaction strategies to capitalise on high levels of learning engagement, and the unique features of these devices.
TL;DR: Loneliness was a stronger indicator of college adjustment than any dimension of Facebook usage, and compulsive use of Facebook had a stronger association with academic motivation than habitual use ofFacebook, but neither were directly correlated with academic performance.
Abstract: The popularity of social network sites (SNSs) among college students has stimulated scholarship examining the relationship between SNS use and college adjustment. The present research furthers our understanding of SNS use by studying the relationship between loneliness, varied dimensions of Facebook use, and college adjustment among first-year students. We looked at three facets of college adjustment: social adjustment, academic motivation, and perceived academic performance. Compulsive use of Facebook had a stronger association with academic motivation than habitual use of Facebook, but neither were directly correlated with academic performance. Too much time spent on Facebook was weakly but directly associated with poorer perceived academic performance. Loneliness was a stronger indicator of college adjustment than any dimension of Facebook usage.
TL;DR: Investigating the effects of using mobile tablet PCs in an online ERP on adolescent English learners' online activities, reading ability and users' perceptions found the results favored the mobile group who not only outperformed the PC group in online activities and reading achievement but also showed greater appreciation of the online ERPs than their PC counterparts.
Abstract: Previous studies on Extensive Reading Programs (ERPs) have reached positive conclusions, namely, that an ERP for language learners is effective in improving their linguistic abilities related to reading and promoting their motivation and attitudes toward reading. Current mobile devices, even though suitable for reading, have not yet been applied to develop language learners' linguistic proficiency and affective abilities in any ERP. The aim of the present study was to address this gap in literature by investigating the effects of using mobile tablet PCs in an online ERP on adolescent English learners' online activities, reading ability and users' perceptions. Two intact classes taught by a same English teacher in a senior high school in Taiwan were recruited to participate in a ten-week online ERP. One class was assigned to the mobile group reading their assignments on their tablet PCs and the other, the PC group, reading theirs on desktop PCs. During the online ERP, each class dedicated one class period every week for in-class reading and the participants in both classes were encouraged to read as many as possible after the class period. The results favored the mobile group who not only outperformed the PC group in online activities and reading achievement but also showed greater appreciation of the online ERP than their PC counterparts. The study also proposed two directions for future studies on mobile-assisted reading. They included learners' studying textbooks and their reading strategies on mobile devices.
TL;DR: Analysis of 145 contributions made by a teacher to two groups of postgraduate students of the same course whose task was to develop collaboratively a rubric for assessing teacher competencies shows that the teacher offered both elaboration and verification feedback, not only regarding the learning content but also the students' approach to the academic task and their social participation in the group.
Abstract: The aim of the present study is to contribute to the understanding of the assistance provided by the teacher through feedback to support knowledge building among higher education students working in small groups in an online collaborative learning environment. The analysis examines 145 contributions made by a teacher to two groups of postgraduate students (group 1: 5 students; group 2: 4 students) of the same course whose task was to develop collaboratively a rubric for assessing teacher competencies by means of the Knowledge Forum platform. The results show that the teacher offered both elaboration and verification feedback, not only regarding the learning content but also the students' approach to the academic task and their social participation in the group. This would seem appropriate in terms of supporting the process of knowledge building in this kind of setting. The results also highlight that, when evaluating whether the feedback given is well matched to the needs of student groups engaged in online collaborative learning, it is important to take into account the timing of the teacher's interventions.
TL;DR: Survey results identified that students experienced higher levels of perceived social interaction and course community and, overall, hadHigher levels of satisfaction with OSN software than those using LMS software, providing a more engaging learning experience.
Abstract: In this research we explore aspects of learning, social interaction and community across online learning, also known as distance learning, in higher education. We measure the impact of online social networking (OSN) software versus traditional learning management system (LMS) software. Guided by a theoretical model for how individuals learn and interact within online communities, we measure student perceptions of learning, social interaction and course community before and after our interventions. Survey instruments measure perceived learning, social interaction and community, which we further explore using social network analysis (SNA). Survey results identified that students experienced higher levels of perceived social interaction and course community and, overall, had higher levels of satisfaction with OSN software than those using LMS software. Along this line, SNA results corroborated that OSN software yielded a higher number of interactions, providing a more engaging learning experience.
TL;DR: The main results indicated that the students in the experimental condition (M EL-enhanced) outperformed the children from the control group (MEL-original), although the former group did not spend more time with the learning material than the latter, and that theStudents in the Experimental group valued MEL-enhance more than theChildren from the Control group valued the original application.
Abstract: Two groups participated in a study on the added value of a gaming context and intelligent adaptation for a mobile learning application. The control group worked at home for a fortnight with the original Mobile English Learning application (MEL-original) developed in a previous project. The experimental group worked at home for a fortnight with MEL-enhanced, the original application embedded in an adventure game and augmented with intelligent adaptation. Two learning themes were used: Zoo animals and Neighbourhood. Both groups attended lessons at school on Zoo Animals and Neighbourhood during the same periods they were allowed to work with the application at home. A pre- and post-test were conducted to establish the initial vocabulary knowledge and the knowledge acquired during the learning phase. The main results indicated that the students in the experimental condition (MEL-enhanced) outperformed the children from the control group (MEL-original), although the former group did not spend more time with the learning material than the latter, and that the students in the experimental group valued MEL-enhanced more than the children from the control group valued MEL-original.
TL;DR: A collaborative reading annotation system with a reading annotation and interactive discussion scaffold (CRAS-RAIDS) for improving reading performance in collaborative digital reading environments and shows that the experimental group significantly outperformed the control group in direct and explicit comprehension, inferential comprehension performance, and use of reading strategy.
Abstract: As children now spend considerable time reading electronic media, digital reading skills and good reading comprehension are essential. However, many studies agree that screen-based reading leads to shallow reading, short attention spans, and poor comprehension. Therefore, this work presents a collaborative reading annotation system with a reading annotation and interactive discussion scaffold (CRAS-RAIDS) for improving reading performance in collaborative digital reading environments. This study used a quasi-experimental design. Fifty-three Grade 5 students were recruited from two classes of an elementary school in Taoyuan County, Taiwan. One class was randomly designated the experimental group used the proposed CRAS-RAIDS support for collaborative reading. The other class was designated the control group and used the traditional paper-based reading annotation method and face-to-face discussions. The two groups were then compared in terms of reading attitude, reading comprehension, and use of reading strategy in an active reading context. Analytical results show that the experimental group significantly outperformed the control group in direct and explicit comprehension, inferential comprehension performance, and use of reading strategy. Moreover, the experimental group, but not the control group, had a significantly improved reading attitude in the total dimensions and in the behavioral and affective sub-dimensions. Additionally, the experimental group showed positive interest and high learning satisfaction.
TL;DR: The present tertiary meta-analytic review re-assesses outcomes presented in three previous meta-analyses and indicates the importance of including implementation factors such as training and support, when considering the relative effectiveness of ICT interventions.
Abstract: Identifying effective literacy instruction programs has been a focal point for governments, educators and parents over the last few decades (Ontario Ministry of Education, 2004, 2006; Council of Ontario Directors of Education, 2011). Given the increasing use of computer technologies in the classroom and in the home, a variety of information communication technology (ICT) interventions for learning have been introduced. Meta-analyses comparing the impact of these programs on learning, however, have yielded inconsistent findings ( Andrews et al., 2007 , Torgerson and Zhu, 2003 , Slavin et al., 2008 , Slavin et al., 2009 ). The present tertiary meta-analytic review re-assesses outcomes presented in three previous meta-analyses. Four moderator variables assessed the impact of the systematic review from which they were retrieved, training and support, implementation fidelity and who delivered the intervention (teacher versus researcher). Significant results were found when training and support was entered as a moderator variable with the small overall effectiveness of the ICTs (ES = 0.18), similar to those found in previous research, increasing significantly (ES = 0.57). These findings indicate the importance of including implementation factors such as training and support, when considering the relative effectiveness of ICT interventions.
TL;DR: Findings reveal that learners in the instruction condition outperformed the others in both the inquiry task of the instructional context and, more importantly, in the transfer inquiry task.
Abstract: This study examines the effectiveness of a short-term instructional intervention in the school context. The aim was to provide students with essential declarative knowledge on what to consider when evaluating the authoritativeness of Web sources, and the accuracy of their information. It also provided the opportunity to apply this declarative knowledge in a basic inquiry task on the controversial topic of the possible harm caused by mobile phones. Participants were 134 ninth graders, randomly assigned to the instruction or no-instruction condition. In both conditions the same multiple Internet sources, varying for authoritativeness and stance, were given for the basic and transfer (about GM food) inquiry tasks. Findings reveal that learners in the instruction condition outperformed the others in both the inquiry task of the instructional context and, more importantly, in the transfer inquiry task. These learners showed more appropriate navigation behavior and greater source evaluation, as well as better surface and deeper comprehension of the accessed information on GM food. In addition, prior knowledge moderated the latter. Theoretical and practical significance of the study is outlined.
TL;DR: Teachers have a generally positive level of technology acceptance and the TAMPST is a valid tool to be applied to teachers although it was originally developed to test pre-service teachers, according to results.
Abstract: This study examines the factors that explain teachers' technology acceptance. A sample of 673 primary and secondary school teachers gave their responses to a 16-item technology acceptance measure for pre-service teachers (TAMPST). Results of this study showed teachers have a generally positive level of technology acceptance and that the TAMPST is a valid tool to be applied to teachers although it was originally developed to test pre-service teachers. Tests for measurement invariance and latent mean differences on the five factors in the TAMPST provided support for full and partial configural, metric, and partial scalar invariance by gender, length of service in teaching, and teaching level. The tests of latent mean differences found significant differences by gender for perceived ease of use, with male teachers rating higher than their female counterparts. Between teachers with shorter and longer years of teaching service, statistical significance was found in the mean differences for perceived ease of use and attitude towards technology use. No significant mean differences in each of the five factors were found between the primary and secondary teachers.
TL;DR: The development of a performance-based digital test and the validation of a direct measure of ICT competence through the use of item response theory (IRT) are outlined, indicating that the instrument is particularly reliable for low and median ability levels.
Abstract: In the past decade, several studies have measured ICT competences from the perspective of ICT self-efficacy. Such indirect measurements tend to have validity problems, as they depend on the pupils' ability to judge their own ICT competences. This study outlines the development of a performance-based digital test and the validation of a direct measure of ICT competence through the use of item response theory (IRT). More specifically, the test and the developed measure focus on primary-school pupils' proficiency in digital information processing and communication. 56 Items were administered to 560 pupils at the end of their primary-school education (age between 10.79 and 13.85 years old). The items were controlled for dimensionality, model-data fit, local item dependence and monotonicity. The final measure contains 27 items that refer to retrieving and processing digital information, and communication with a computer. The results indicate that the instrument is particularly reliable for low and median ability levels. Further refinement and possible future use of the instrument is discussed.
TL;DR: Using the 2011 ‘Trends in International Mathematics and Science Study’ data, data suggests that a correction for characteristics related to the student population, teaching staff, administrative personnel and school management is warranted in the evaluation of the impact of ICT.
Abstract: ICT infrastructure investments in educational institutions have been one of the key priorities of education policy during the last decade. Despite the attention, research on the effectiveness and efficiency of ICT is inconclusive. This is mainly due to small-scale research with weak identification strategies which lack a proper control group. Using the 2011 ‘Trends in International Mathematics and Science Study’ (TIMSS) data, we define by a Mahalanobis matching a control group with similar student, teacher, school and regional characteristics. The results indicate that accounting or not accounting for these characteristics, may considerably alter the estimated impact of ICT. This suggests that a correction for characteristics related to the student population, teaching staff, administrative personnel and school management is warranted in the evaluation of the impact of ICT.
TL;DR: The results provide empirical support for the hypothesis that participation in the GDL program leads to measurable cognitive changes in children's problem-solving skills.
Abstract: The Game-Design and Learning (GDL) initiative engages middle school students in the process of game-design in a variety of in-school, after-school, and summer camp settings. The goal of the GDL initiative is to leverage students' interests in games and design to foster their problem-solving and critical reasoning skills. The present study examines the effectiveness of an after-school version of the GDL program using a quasi-experimental design. Students enrolled in the GDL program were guided in the process of designing games aimed at solving problems. Compared to students in a control group who did not attend the program ( n = 24), the children who attended the GDL program ( n = 20) showed a significant increase in their problem-solving skills. The results provide empirical support for the hypothesis that participation in the GDL program leads to measurable cognitive changes in children's problem-solving skills. This study bears important implications for educators and theory.
TL;DR: The findings indicated significant and substantial improvements from pre-test to training in all conditions, and participants in the Mixed A, Mixed B, and Video conditions outperformed those in the Paper-based condition.
Abstract: Instruction on software usage has long been dominated by the paper-based tutorial. This dominance is now being challenged with the rise of facilities for producing and publishing recorded demonstrations (video). Typically, each instructional medium has its own qualities. The present study aimed to optimize the design of a video tutorial for software training by attending to both its strengths and its weaknesses vis-a-vis a paper-based tutorial. Based on a distinction between two functionally different components in software tutorials, four tutorial configurations were compared: Paper-based, Mixed A (paper-based preview and video procedure), Mixed B (video preview and paper-based procedure), and Video. The 111 fifth and sixth grade participants (mean age 11.8) received instructions about Word's formatting options. The findings indicated significant and substantial improvements from pre-test to training in all conditions. In addition, participants in the Mixed A, Mixed B, and Video conditions outperformed those in the Paper-based condition. Significant and substantial learning gains were found from pre-test to post-test. Both the Mixed B and Video conditions outperformed the Paper-based condition. The success of the Mixed A, Mixed B, and Video tutorials is ascribed to the use of design guidelines for software training that direct the designer to optimize video's strong qualities and moderate or reduce its relative weaknesses
TL;DR: Investigation of how some current high school students as the digital learners engage with technology at home and school and how these two types of engagement overlap in their learning inside the classroom shows that the overlap between the personal and educational digital engagement of these students was not necessarily positive as portrayed by the prevalent discourses of technology enthusiasts.
Abstract: Current K-12 students are considered digital learners because technology is as pervasive in their academic world as in their personal lives. Technology enthusiasts argue that these learners are the “digital natives” having sophisticated technology knowledge and skills that can be potentially harnessed for better learning engagement inside the classroom. This phenomenological study investigates how some current high school students as the digital learners engage with technology at home and school; and how these two types of engagement overlap in their learning inside the classroom. Data were gathered from phenomenological three series in-depth interviews with five participants and also field observation. Findings show that the overlap between the personal and educational digital engagement(s) of these students was not necessarily positive as portrayed by the prevalent discourses of technology enthusiasts. The overlapping had mixed roles – facilitative as well as obstructive. Pedagogical and future research implications are discussed.
TL;DR: The development and validation of an automated system for recording and analyzing aspects of classroom discourse that can result in timely feedback is reported on, which enables timely and relatively inexpensive generation of a classroom discourse profile, which helps teachers to visualize and potentially improve their classroom discourse management skills.
Abstract: Classroom discourse is the primary medium through which teaching and learning occur. Managed skillfully, it can provide an opportunity for students to develop their understanding and to profit from the ideas of their peers and the teacher. Yet it is difficult for teachers to be mindful of the nature and distribution of classroom discourse at the same time as they juggle other instructional concerns. It is possible to record, transcribe, and analyze classroom discourse, but it is not possible to do this quickly enough to give a teacher timely feedback. We report on the development and validation of an automated system for recording and analyzing aspects of classroom discourse that can result in timely feedback. Based on the LENA system, it aims to identify three common discourse activities: teacher lecturing, whole class discussion and student group work. The system consists of a speech processing module (diarisation performed by the LENA system) and an activity detection module that detects the discourse activities by using classification analysis. Results showed that our automatic detection of discourse activities converged well with those of human coders. The system enables timely and relatively inexpensive generation of a classroom discourse profile, which helps teachers to visualize and potentially improve their classroom discourse management skills.