Comparative Judgement is a better predictor of marks than marking!

Chris Wheadon
The No More Marking Blog
1 min readNov 28, 2018

Yesterday, Ofqual published a study that looked in detail at alternatives to marking, including Comparative Judgement. Their key finding, rather buried in the report, is that, for their study of AS History:

  • Comparative Judgement achieves the same reliability as single marking after 4 judgements per script;
  • Comparative Judgement achieves the same reliability as double marking after 5 judgements per script;
  • After 5 judgements per script the reliability of Comparative Judgement continues to increase exponentially compared to marking.
  • Comparative Judgement rewards the same abilities as marking, simply with much higher reliability.

All of this is on page 27 of the report Marking reliability studies 2017.

We recommend as a minimum 10 judgements per script, which teachers achieve in around the same time as traditional marking, giving us a huge advantage over traditional marking methods!

What Ofqual don’t go on to examine, is how, with Comparative Judgement, you can moderate teacher assessment nationally without any fear of gaming and bias in a way that you never could with a traditional marking approach.

Little wonder that Ofqual have decided that Comparative Judgement is worthy of further research!

Sign up to discover human stories that deepen your understanding of the world.

Free

Distraction-free reading. No ads.

Organize your knowledge with lists and highlights.

Tell your story. Find your audience.

Membership

Read member-only stories

Support writers you read most

Earn money for your writing

Listen to audio narrations

Read offline with the Medium app

Published in The No More Marking Blog

No More Marking simplifies assessment for schools through its Comparative Judgement Engine. The blog presents findings from our projects and our more general research.

No responses yet

What are your thoughts?