Comparative Judgement methods
Speaker(s):
Bio: Ian is a Reader in Educational Assessment at the Department of Mathematics Education, Loughborough University. After completing his PhD at the University of Warwick he received a 5-year Fellowship from the Royal Society to develop comparative judgement methods. For the past 12 years he has led a programme of research at Loughborough to explore the reliability and validity of comparative judgement as a research tool within education and across other disciplines.
Rowland Seymour, University of Birmingham
Bio: Marie-Josee is a Senior Lecturer at De Montfort University in the Division of Psychology. Her research expertise is in facilitating learning in the field of second language/foreign language acquisition. Before her current position, she worked as a post-doctoral researcher on a comparative judgment project at Loughborough University.
Abstract:
Comparative judgement methods can be used to construct reliable measurement scales that elude more traditional methods. Such scales typically measure important but nebulous theoretical ideas such as ‘beauty’ or ‘writing quality’. Comparative judgement involves no coding schemes and no categorisation; instead judges make holistic decisions about which of two presented objects better represents the theoretical idea of interest. These methods have a long history but are only now gaining traction due to technological developments making them more accessible to researchers. Following an NCRM online training event in 2022, this panel event will feature three experts across five parts as follows:
1. What is a comparative judgement? An introduction and example (20mins, Rowland Seymour).
2. Comparative judgement in second language acquisition research (10mins, Marie-Josee Bisson).
3. Comparative judgement methods for comparing standards (10mins, Ian Jones).
4. Comparative judgement resources for researchers (5mins, Ian Jones).
5. Q&A (5mins, all panel members).