Peer versus expert feedback: An investigation of the quality of peer feedback among secondary school students

TLDR: It was found that the majority of changes proposed by peer assessors were scientifically accurate and assessee groups employed decision-making strategies to screen and process peer and expert feedback.

Abstract: Few studies have focused on peer assessment at the secondary school level. Consequently, we know very little about the quality of the feedback secondary school students can produce and its potential usefulness. This study was implemented in the context of reciprocal online peer assessment of web-portfolios in a secondary school science course. We evaluated both quantitative (grades) and qualitative (written comments) feedback on student science web-portfolios to assess the quality of peer feedback. We further investigated whether either peer or expert feedback led peer assesses to revise their work in any way. Participants (28 seventh-graders) anonymously assessed each other's web-portfolios on designing a CO"2-friendly house. Peer assessors and an expert assessor used the same pre-specified assessment criteria. Peer assessees made revisions as they saw fit after reviewing the feedback. The data sources were: the feedback produced, screen capture and video data and questionnaires. The quantitative feedback was found to differ between peer assessors and the expert and also between peer assessors assessing the same web-portfolio, which resulted in low validity and reliability. Qualitative written feedback from student and expert assessors appeared similar in its structural components. It differed in that students placed less emphasis on peer assessees' skills, provided fewer suggestions for changes, provided more positive judgments, and provided more negative/critical judgments that were not accompanied by evidence. Finally, we found that the majority of changes proposed by peer assessors were scientifically accurate and assessee groups employed decision-making strategies to screen and process peer and expert feedback. These findings yield a number of implications for practice and policy. The mere explanation of the assessment criteria or prior experience with peer assessment procedures is not enough; teachers, researchers and policy makers should focus on the type of training and scaffolding that peer assessors need in order to produce high quality feedback.