Assessment and Classroom Learning
01 Mar 1998-Assessment in Education: Principles, Policy & Practice (Taylor & Francis Group)-Vol. 5, Iss: 1, pp 7-74
TL;DR: A review of the literature on classroom formative assessment can be found in this article, where the authors consider the perceptions of students and their role in self-assessment alongside analysis of the strategies used by teachers and the formative strategies incorporated in such systemic approaches as mastery learning.
Abstract: This article is a review of the literature on classroom formative assessment. Several studies show firm evidence that innovations designed to strengthen the frequent feedback that students receive about their learning yield substantial learning gains. The perceptions of students and their role in self‐assessment are considered alongside analysis of the strategies used by teachers and the formative strategies incorporated in such systemic approaches as mastery learning. There follows a more detailed and theoretical analysis of the nature of feedback, which provides a basis for a discussion of the development of theoretical models for formative assessment and of the prospects for the improvement of practice.
Citations
More filters
Book•
01 Jan 1999
TL;DR: New developments in the science of learning as mentioned in this paper overview mind and brain how experts differ from novices how children learn learning and transfer the learning environment curriculum, instruction and commnity effective teaching.
Abstract: New developments in the science of learning science of learning overview mind and brain how experts differ from novices how children learn learning and transfer the learning environment curriculum, instruction and commnity effective teaching - examples in history, mathematics and science teacher learning technology to support learning conclusions from new developments in the science of learning.
13,889 citations
TL;DR: This paper provided a conceptual analysis of feedback and reviewed the evidence related to its impact on learning and achievement, and suggested ways in which feedback can be used to enhance its effectiveness in classrooms.
Abstract: Feedback is one of the most powerful influences on learning and achievement, but this impact can be either positive or negative. Its power is frequently mentioned in articles about learning and teaching, but surprisingly few recent studies have systematically investigated its meaning. This article provides a conceptual analysis of feedback and reviews the evidence related to its impact on learning and achievement. This evidence shows that although feedback is among the major influences, the type of feedback and the way it is given can be differentially effective. A model of feedback is then proposed that identifies the particular properties and circumstances that make it effective, and some typically thorny issues are discussed, including the timing of feedback and the effects of positive and negative feedback. Finally, this analysis is used to suggest ways in which feedback can be used to enhance its effectiveness in classrooms.
7,222 citations
TL;DR: In this paper, the research on formative assessment and feedback is reinterpreted to show how these processes can help students take control of their own learning, i.e. become self-regulated learners.
Abstract: The research on formative assessment and feedback is reinterpreted to show how these processes can help students take control of their own learning, i.e. become self-regulated learners. This reformulation is used to identify seven principles of good feedback practice that support self-regulation. A key argument is that students are already assessing their own work and generating their own feedback, and that higher education should build on this ability. The research underpinning each feedback principle is presented, and some examples of easy-to-implement feedback strategies are briefly described. This shift in focus, whereby students are seen as having a proactive rather than a reactive role in generating and using feedback, has profound implications for the way in which teachers organise assessments and support learning.
4,204 citations
Cites background from "Assessment and Classroom Learning"
... Black and Wiliam (1998) drew together over 250 studies of feedback carried out since 1988 spanning all educational sectors....
[...]
...Black and Wiliam (1998) drew together over 250 studies of feedback carried out since 1988, spanning all educational sectors....
[...]
...Students can only achieve learning goals if they understand those goals, assume some ownership of them, and can assess progress (Sadler, 1989; Black & Wiliam, 1998)....
[...]
...As Black and Wiliam (1998) note, feedback that draws attention away from the task and towards self-esteem can have a negative effect on attitudes and performance....
[...]
...The student also actively constructs his or her own understanding of feedback messages derived from external sources (Ivanic, Clark and Rimmershaw, 2000; Black and Wiliam, 1998 )....
[...]
Journal Article•
TL;DR: In this paper, the authors present an essential component of classroom work and can raise student achievement, which can be seen as a formative assessment, and can be used as a reward.
Abstract: Formative assessment is an essential component of classroom work and can raise student achievement.
3,144 citations
Cites background from "Assessment and Classroom Learning"
...The review has been published in the journal “Assessment in Education” ( Black and Wiliam, 1998 ) together with comments on our work by leading educational experts from Australia, France, Hong Kong, Southern Africa and the USA....
[...]
TL;DR: This article reviewed the corpus of research on feedback, with a focus on formative feedback, defined as information communicated to the learner that is intended to modify his or her thinking or behavior to improve learning.
Abstract: This article reviews the corpus of research on feedback, with a focus on formative feedback—defined as information communicated to the learner that is intended to modify his or her thinking or behavior to improve learning According to researchers, formative feedback should be nonevaluative, supportive, timely, and specific Formative feedback is usually presented as information to a learner in response to some action on the learner’s part It comes in a variety of types (eg, verification of response accuracy, explanation of the correct answer, hints, worked examples) and can be administered at various times during the learning process (eg, immediately following an answer, after some time has elapsed) Finally, several variables have been shown to interact with formative feedback’s success at promoting learning (eg, individual characteristics of the learner and aspects of the task) All of these issues are discussed This review concludes with guidelines for generating formative feedback
2,893 citations
References
More filters
TL;DR: The role of stereotype vulnerability in the standardized test performance of ability-stigmatized groups is discussed and mere salience of the stereotype could impair Blacks' performance even when the test was not ability diagnostic.
Abstract: Stereotype threat is being at risk of confirming, as self-characte ristic, a negative stereotype about one's group. Studies 1 and 2 varied the stereotype vulnerability of Black participants taking a difficult verbal test by varying whether or not their performance was ostensibly diagnostic of ability, and thus, whether or not they were at risk of fulfilling the racial stereotype about their intellectual ability. Reflecting the pressure of this vulnerability, Blacks underperformed in relation to Whites in the ability-diagnostic condition but not in the nondiagnostic condition (with Scholastic Aptitude Tests controlled). Study 3 validated that ability-diagnosticity cognitively activated the racial stereotype in these participants and motivated them not to conform to it, or to be judged by it. Study 4 showed that mere salience of the stereotype could impair Blacks' performance even when the test was not ability diagnostic. The role of stereotype vulnerability in the standardized test performance of ability-stigmatized groups is discussed. Not long ago, in explaining his career-long preoccupation with the American Jewish experience, the novelist Philip Roth said that it was not Jewish culture or religion per se that fascinated him, it was what he called the Jewish "predicament." This is an apt term for the perspective taken in the present research. It focuses on a social-psychological predicament that can arise from widely-known negative stereotypes about one's group. It is this: the existence of such a stereotype means that anything one does or any of one's features that conform to it make the stereotype more plausible as a self-characterization in the eyes of others, and perhaps even in one's own eyes. We call this predicament stereotype threat and argue that it is experienced, essentially, as a self-evaluative threat. In form, it is a predicament that can beset the members of any group about whom negative stereotypes exist. Consider the stereotypes elicited by the terms yuppie, feminist, liberal, or White male. Their prevalence in society raises the possibility for potential targets that the stereotype is true of them and, also, that other people will see them that way. When the allegations of the stereotype are importantly
7,282 citations
TL;DR: In this article, Dweck describes adaptive and maladaptive motivational patterns and presents a research-based model of motivational processes and argues that this approach has important implications for practice and the design of interventions to change maladaptative motivational processes, and observes that empirically based interventions may prevent current achievement discrepancies.
Abstract: Motivational processes influence a child's acquisition, transfer, and use of knowledge and skills, yet educationally relevant conceptions of motivation have been elusive. Using recent research within the social-cognitive framework, Dweck describes adaptive and maladaptive motivational patterns and presents a research-based model of motivational processes. This model shows how the particular goals children pursue on cognitive tasks shape their reactions to success and failure and influence the quality of their cognitive performance. Dweck argues that this approach has important implications for practice and the design of interventions to change maladaptive motivational processes. She presents a compelling proposal for explaining motivational influences on gender differences in mathematics achievement and observes that empirically based interventions may prevent current achievement discrepancies.--The Editors Most research on effective learning and performance of cognitive tasks analyzes the particular cognitive skills required to succeed at those tasks. In contrast, the focus here is on motivational processes that affect success on cognitive tasks. That is, the focus is on psychological factors, other than ability, that determine how effectively the individual acquires and uses skills. It has long been known that factors other than ability influence whether children seek or avoid challenges, whether they persist or withdraw in the face of difficulty, and whether they use and develop their skills effectively. However, the components and bases of adaptive motivational patterns have been poorly understood. As a resuit, commonsense analyses have been limited and have not provided a basis for effective practices. Indeed, many \"commonsense\" beliefs have been called into question or seriously qualified by recent research--for example, the belief that large amounts of praise and success will establish, maintain, or reinstate adaptive patterns, or that \"brighter\" children have more adaptive patterns and thus are more likely to choose personally challenging tasks or to persist in the face of difficulty. In the past 10 to 15 years a dramatic change has taken place in the study of motivation. This change has resulted in a coherent, replicable, and educationally relevant body of findings--and in a clearer understanding of motivational phenomena. During this time, the emphasis has shifted to a social-cognitive approachwaway from external contingencies, on the one hand, and global, internal states on the other. It has shifted to an emphasis on cognitive mediators, that is, to how children construe the situation, interpret events in the situation, and process information about the situation. Although external contingencies and internal affective states are by no means ignored, they are seen as part of a process whose workings are best penetrated by focusing on organizing cognitive variables. Specifically, the social-cognitive approach has allowed us to (a) characterize adaptive and maladaptive patterns, (b) explain them in terms of specific underlying processes, and thus (c) begin to provide a rigorous conceptual and empirical basis for intervention and practice. Adaptive and Maladaptive Motivational Patterns The study of motivation deals with the causes of goaloriented activity (Atkinson, 1964; Beck, 1983; Dollard & Miller, 1950; Hull, 1943; Veroff, 1969). Achievement motivation involves a particular class of goals--those involving competence--and these goals appear to fall into two classes: (a) learning goals, in which individuals seek to increase their competence, to understand or master something new, and (b) performance goals, in which individuals seek to gain favorable judgments of their competence or avoid negative judgments of their competence (Dweck & Elliott, 1983; NichoUs, 1984; Nicholls & Dweck, 1979). l Adaptive motivational patterns are those that promote the establishment, maintenance, and attainment of personally challenging and personally valued achievement goals. Maladaptive patterns, then, are associated with a failure to establish reasonable, valued goals, to maintain effective striving toward those goals, or, ultimately, to attain valued goals that are potentially within one's reach. Research has clearly documented adaptive and maladaptive patterns of achievement behavior. The adaptive (\"mastery-oriented\") pattern is characterized by challenge seeking and high, effective persistence in the face of obstacles. Children displaying this pattern appear to enjoy exerting effort in the pursuit of task mastery. In contrast, the maladaptive (\"helpless\") pattern is characterized by challenge avoidance and low persistence in the face of difficulty. Children displaying this pattern tend to evidence negative affect (such as anxiety) and negative self-cogniCorrespondence concerning this article should be addressed to Carol S. Dweck, Department of Psychology, University of Illinois, 603 E. Daniel, Champaign, IL 61820. l The word performance will be used in several ways, not only in connection with performance goals. It will also be used to refer to the child's task activity (performance of a task) and to the product of that activity (level of performance). The meaning should be clear from the context. 1040 October 1986 9 American Psychologist Copyrisht 1986 by the American Psychological Association, Inc. 0003-066X/86/$00.75 Vol. 41, No. 10, 1040-1048 Table 1 Achievement Goals and Achievement Behavior Confidence in Theory of intelligence Goal orientation present ability Behavior pattern Entity theory (Intelligence is fixed) Incremental theory (Intelligence is malleable) > Performance goal (Goal is to gain positive judgments/avoid negative judgments of competence) > Learning goal (Goal is to increase competence) If high ---> Mastery-oriented Seek challenge but High persistence If low ~ Helpless Avoid challenge Low persistence If high > Mastery-oriented ioOr ~ ' Seek challenge (that fosters learning) High persistence tions when they confront obstacles (e.g., Ames, 1984; C. Diener & Dweck, 1978, 1980; Dweck & Reppucci, 1973; Nicholls, 1975). Although children displaying the different patterns do not differ in intellectual ability, these patterns can have profound effects on cognitive performance. In experiments conducted in both laboratory and classroom settings, it has been shown that children with the maladaptive pattern are seriously hampered in the acquisition and display of cognitive skills when they meet obstacles. Children with the adaptive pattern, by contrast, seem undaunted or even seem to have their performance facilitated by the increased challenge. If not ability, then what are the bases of these patterns? Most recently, research has suggested that children's goals in achievement situations differentially foster the two patterns. That is, achievement situations afford a choice of goals, and the one the child preferentially adopts predicts the achievement pattern that child will display. Table 1 summarizes the conceptualization that is emerging from the research. BasieaUy, children's theories of intelligence appear to orient them toward different goals: Children who believe intelligence is a fixed trait tend to orient toward gaining favorable judgments of that trait (performance goals), whereas children who believe intelligence is a malleable quality tend to orient toward developing that quality (learning goals). The goals then appear to set up the different behavior patterns. 2 Learning and Performance Goals Contrasted How and why do the different goals foster the different patterns? How do they shape task choice and task pursuit to facilitate or impede cognitive performance? The research reviewed below indicates that with performance goals, the entire task choice and pursuit process is built around children's concerns about their ability level. In contrast, with learning goals the choice and pursuit processes involve a focus on progress and mastery through 2 See M. Bandura and Dweck (1985), Dweck and Elliott (1983), and Leggett (1985) for a more extensive treatment of children's theories of intelligence. The present article will focus on achievement goals and their allied behavior patterns. effort. Further, this research shows how a focus on ability judgments can result in a tendency to avoid and withdraw from challenge, whereas a focus on progress through effort creates a tendency to seek and be energized by challenge. Although relatively few studies as yet have explicitly induced and compared (or measured and compared) learning versus performance goals (see M. Bandura & Dweck, 1985; Elliott & Dweck, 1985; FarreU & Dweck, 1985; Leggett, 1985, 1986), many have manipulated the salience and value of performance goals, and hence the relative value of the two types of goals. This has been done, for example, by instituting a competitive versus individual reward structure (e.g., Ames, 1984; Ames, Ames, & Felker, 1977), by varying the alleged diagnosticity of the task vis vis important abilities (e.g., Nicholls, 1975), by introducing an audience or evaluator versus allowing the individual to perform privately or focusing his or her attention on the task (e.g., Brockner & Hulton, 1978; Carver & Scheier, 1981; E. Diener & SruU, 1979), and by presenting the task with \"test\" instructions versus \"game\" or neutral instructions (e.g., Entin & Raynor, 1973; Lekarczyk & Hill, 1969; McCoy, 1965; Sarason, 1972). Taken together, the results suggest that highlighting performance goals relative to learning goals can have the following effects on achievement behavior. Goals and Task Choice Appropriately challenging tasks are often the ones that are best for utilizing and increasing one's abilities. Recent research has shown that performance goals work against the pursuit of challenge by requiring that children's perceptions of their ability be high (and remain high) before the children will desire a challenging task (M. Bandura & D
6,360 citations
TL;DR: In this paper, the authors examine the classroom learning environment in relation to achievement goal theory of motivation and argue for an identification of classroom structures that can contribute to a mastery orientation, a systematic analysis of these structures, and a determination of how these structures relate to each other.
Abstract: This article examines the classroom learning environment in relation to achievement goal theory of motivation. Classroom structures are described in terms of how they make different types of achievement goals salient and as a consequence elicit qualitatively different patterns of motivation. Task, evaluation and recognition, and authority dimensions of classrooms are presented as examples of structures that can influence children's orientation toward different achievement goals. Central to the thesis of this article is a perspective that argues for an identification of classroom structures that can contribute to a mastery orientation, a systematic analysis of these structures, and a determination of how these structures relate to each other
6,050 citations
TL;DR: In this article, KlUGER and Denisi analyzed all the major reasons to reject a paper from the meta-analysis, even though the decision to exclude a paper came at the first identification of a missing inclusion criterion.
Abstract: the total number of papers may exceed 10,000. Nevertheless, cost consideration forced us to consider mostly published papers and technical reports in English. 4 Formula 4 in Seifert (1991) is in error—a multiplier of n, of cell size, is missing in the numerator. 5 Unfortunately, the technique of meta-analysis cannot be applied, at present time, to such effects because the distribution of dis based on a sampling of people, whereas the statistics of techniques such as ARIMA are based on the distribution of a sampling of observations in the time domain regardless of the size of the people sample involved (i.e., there is no way to compare a sample of 100 points in time with a sample of 100 people). That is, a sample of 100 points in time has the same degrees of freedom if it were based on an observation of 1 person or of 1,000 people. 258 KLUGER AND DENISI From the papers we reviewed, only 131 (5%) met the criteria for inclusion. We were concerned that, given the small percentage of usable papers, our conclusions might not fairly represent the larger body of relevant literature. Therefore, we analyzed all the major reasons to reject a paper from the meta-analysis, even though the decision to exclude a paper came at the first identification of a missing inclusion criterion. This analysis showed the presence of review articles, interventions of natural feedback removal, and papers that merely discuss feedback, which in turn suggests that the included studies represent 1015% of the empirical FI literature. However, this analysis also showed that approximately 37% of the papers we considered manipulated feedback without a control group and that 16% reported confounded treatments, that is, roughly two thirds of the empirical FI literature cannot shed light on the question of FI effects on performance—a fact that requires attention from future FI researchers. Of the usable 131 papers (see references with asterisks), 607 effect sizes were extracted. These effects were based on 12,652 participants and 23,663 observations (reflecting multiple observations per participant). The average sample size per effect was 39 participants. The distribution of the effect sizes is presented in Figure 1. The weighted mean (weighted by sample size) of this distribution is 0.41, suggesting that, on average, FI has a moderate positive effect on performance. However, over 38% of the effects were negative (see Figure 1). The weighted variance of this distribution is 0.97, whereas the estimate of the sampling error variance is only 0.09. A potential problem in meta-analyses is a violation of the assumption of independence. Such a violation occurs either when multiple observations are taken from the same study (Rosenthal, 1984) or when several papers are authored by the same person (Wolf, 1986). In the present investigation, there were 91 effects derived from the laboratory experiments reported by Mikulincer (e.g., 1988a, 1988b). This raises the possibility that the average effect size is biased, because his studies manipulated extreme negative FIs and used similar tasks. In fact, the weighted average d in Mikulincer's studies was —0.39; whereas in the remainder of the
5,126 citations
Book•
13 Dec 1991
TL;DR: In this article, the authors provide an overview of the experience of teaching and learning from the student's point of view, out of which grows a set of prinicples for effective teaching in higher education.
Abstract: This bestselling book is a unique introduction to the practice of university teaching and its underlying theory. This new edition has been fully revised and updated in view of the extensive changes which have taken place in higher education over the last decade and includes new material on the higher education context, evaluation and staff development.The first part of the book provides an outline of the experience of teaching and learning from the student's point of view, out of which grows a set of prinicples for effective teaching in higher education. Part two shows how these ideas can enhance educational standards, looking in particular at four key areas facing every teacher in higher education:* Organising the content of undergraduate courses* Selecting teaching methods* Assessing student learning* Evaluating the effectivenesss of teaching.Case studies of exemplary teaching are used throughout to connect ideas to practice and to illustrate how to ensure better student learning. The final part of the book looks in more detail at appraisal, performance indicators, accountability and educational development and training. The book is essential reading for new and experienced lecturers, particularly those following formal programmes in university teaching, such as courses leading to ILT accreditation.
4,517 citations