TriGrade - Method to comparative peer assessment and feedback in Large Online Design Classes

Abstract

Peer review entrusts young learners to take on the role of an evaluator, though they lack expertise and perspective. We present TriGrade peer review system, to guide learners give appropriate feedback and look at their peers’ work through an expert lens. TriGrade is built, based on theories of learning through contrasting cases for effective peer review, and has built a structured comparison platform. This platform was put to test across four courses where 634 students submitted 1865 assignments. It was recorded that the learners had completed 5403 peer reviews with 937 self-assessments. Peers were randomly assigned three submissions to compare side-by-side, grade them on a Likert scale and write reviews individually. Learners spent more time in the review process and responded with longer and insightful feedback. The accuracy of grading was ascertained as all submissions to be peer graded using TriGrade were earlier range fixed and calibrated to the instructors range. The experiments demonstrated that learner considered comparative grading fair. Furthermore it was found to be more effective in visual works. Lastly the results demonstrate that comparative assessment helps reviewers give better feedback on peer work and helps reflect on their own work better.