Mr Martin Roberts

Mr Martin Roberts

Lecturer and Lead in Assessment Psychometrics (Education)

Peninsula Medical School (Faculty of Medicine and Dentistry)


Psychometrician / Statistician / Researcher


BA (Hons) Mathematics, University of Cambridge, 1975
Certificate in Education, University of Plymouth, 1996
MSc Applied Statistics with Statistical Education, Sheffield Hallam University, 2006

Research interests

Statistical and psychometric analysis of assessment data in the field of undergraduate, postgraduate and continuing medical education. Applications to undergraduate assessments in medicine and dentistry and to  workplace-based and simulation-based assessments of doctors'clinical and non-technical skills, such as:

  • the validity of assessment processes for selecting junior doctors to specialty training posts
  • workplace-based assessments, multisource feedback and professional examinations for assessing the performance of qualified doctors
  • patient feedback on satisfaction with care received in general practices
  • the use of simulation for training and assessment of medical students & doctors and students in allied healthcare professions
  • the development, use and evaluation of rating scales and assessment instruments.

Key publications are highlighted

Price TJ, Lynn N, Coombes L, Roberts M, Gale T, Regan de Bere S & Archer J 2018 'The International Landscape of Medical Licensing Examinations: A Typology Derived From a Systematic Review' International Journal of Health Policy and Management , DOI PEARL
Gale TCE, Lambe PJ & Roberts MJ 2017 'Factors associated with junior doctors’decisions to apply for general practicetraining programmes in the UK: secondaryanalysis of data from the UKMED project' BMC Medicine , DOI PEARL
Hancock J, Hammond JA, Roberts M & Mattick K 2017 'Comparing Tolerance of Ambiguity in Veterinary and Medical Students' Journal of Veterinary Medical Education 44, (3) 523-530 , DOI PEARL
Traynor M, Galanouli D, Roberts M, Leonard L & Gale T 2016 'Identifying applicants suitable to a career in nursing: a value-based approach to undergraduate selection' Journal of Advanced Nursing , DOI PEARL
Davey AF, Roberts MJ, Mounce L, Maramba I & Campbell JL 2016 'Test–retest stability of patient experience items derived from the national GP patient survey' SpringerPlus 5, (1) , DOI PEARL
Zahra D, Robinson I, Roberts M, Coombes L, Cockerill J & Burr S 2016 'Rigour in moderation processes is more important than the choice of method' Assessment & Evaluation in Higher Education 1-9 Author Site , DOI PEARL
Archer J, Lynn N, Coombes L, Roberts M, Gale T, Price T & Regan de Bere S 2016 'The impact of large scale licensing examinations in highly developed countries: a systematic review' BMC Medical Education 16, (1) , DOI PEARL
Archer J, Lynn N, Coombes L, Roberts M, Gale T & Regan de Bere S 2016 'The medical licensing examination debate' Regulation & Governance , DOI PEARL
Wright C, Campbell J, McGowan L, Roberts MJ, Jelley D & Chatterjee A 2016 'Interpreting multisource feedback: online study of consensus and variation among GP appraisers' British Journal of General Practice 66, (645) e277-e284 , DOI PEARL
Hinde T, Gale T, Anderson I, Roberts M & Sice P 2016 'A study to assess the influence of interprofessional point of care simulation training on safety culture in the operating theatre environment of a university teaching hospital' Journal of Interprofessional Care 30, (2) 251-253 , DOI
Coombes L, Roberts M, Zahra D & Burr S 2015 'Twelve tips for assessment psychometrics' Medical Teacher 38, (3) 250-254 , DOI PEARL
Roberts MJ, Gale TCE, McGrath JS & Wilson MR 2015 'Rising to the challenge: acute stress appraisals and selection centre performance in applicants to postgraduate specialty training in anaesthesia' ADVANCES IN HEALTH SCIENCES EDUCATION 21, (2) 323-339 Author Site , DOI PEARL
Hill MR, Roberts MJ, Alderson ML & Gale TCE 2015 'Safety culture and the 5 steps to safer surgery: an intervention study' Br J Anaesth 114, (6) 958-962 Author Site , DOI
Maramba ID, Davey A, Elliott MN, Roberts M, Roland M, Brown F, Burt J, Boiko O & Campbell J 2015 'Web-based textual analysis of free-text patient experience comments from a survey in primary care' JMIR Med Inform 3, (2) Author Site , DOI PEARL
Mujica-Mota RE, Roberts M, Abel G, Elliott M, Lyratzopoulos G, Roland M & Campbell J 2015 'Common patterns of morbidity and multi-morbidity and their impact on health-related quality of life: evidence from a national survey' Qual Life Res 24, (4) 909-918 Author Site , DOI PEARL
Hancock J, Roberts M, Monrouxe L & Mattick K 2015 'Medical student and junior doctors’ tolerance of ambiguity: development of a new scale' Advances in Health Sciences Education 20, (1) 113-130 , DOI PEARL
Roberts MJ, Campbell JL, Abel GA, Davey AF, Elmore NL, Maramba I, Carter M, Elliott MN, Roland MO 2014 'Understanding high and low patient experience scores in primary care: analysis of patients' survey data for general practices and individual doctors' BMJ 349, Author Site , DOI PEARL
Jenkinson CE, Winder RE, Sugg HVR, Roberts MJ, Ridgway N, Kuyken W, Wiles N, Kessler D & Campbell J 2014 'Why do GPs exclude patients from participating in research? An exploration of adherence to and divergence from trial criteria' Fam Pract 31, (3) 364-370 Author Site , DOI
Roland M, Roberts M, Rhenius V & Campbell J 2013 'GPAQ-R: development and psychometric properties of a version of the General Practice Assessment Questionnaire for use for revalidation by general practitioners in the UK' BMC FAMILY PRACTICE 14, Author Site , DOI PEARL
Roberts MJ, Gale TCE, Sice PJA & Anderson IR 2013 'The relative reliability of actively participating and passively observing raters in a simulation-based assessment for selection to specialty training in anaesthesia' Anaesthesia 68, (6) 591-599 Author Site , DOI
Campbell JL, Carter M, Davey A, Roberts MJ, Elliott MN & Roland M 2013 'Accessing primary care: a simulated patient study' Br J Gen Pract 63, (608) e71-e76 Author Site , DOI
Croker JE, Swancutt DR, Roberts MJ, Abel GA, Roland M & Campbell JL 2013 'Factors affecting patients’ trust and confidence in GPs: evidence from the English national GP patient survey' BMJ Open 3, (5) e002762-e002762 , DOI PEARL
Roberts MJ, Campbell JL, Richards SH & Wright C 2013 'Self-other agreement in multisource feedback: the influence of doctor and rater group characteristics' J Contin Educ Health Prof 33, (1) 14-23 Author Site , DOI
Wright C, Richards SH, Hill JJ, Roberts MJ, Norman GR, Greco M, Taylor MRS & Campbell JL 2012 'Multisource feedback in evaluating the performance of doctors: the example of the UK General Medical Council patient and colleague questionnaires' Acad Med 87, (12) 1668-1678 Author Site , DOI
Dickinson A, Roberts MJ, Kumar A, Weaver A & Lockey DJ 2012 'Falls from Height: Injury and Mortality' Journal of the Royal Army Medical Corps 158, (2) 123-127
Crossingham GV, Sice PJA, Roberts MJ, Lam WH & Gale TCE 2012 'Development of workplace-based assessments of non-technical skills in anaesthesia*' Anaesthesia 67, (2) 158-164 , DOI
Campbell JL, Roberts M, Wright C, Hill J, Greco M, Taylor M & Richards S 2011 'Factors associated with variability in the assessment of UK doctors' professionalism: analysis of survey results' BRITISH MEDICAL JOURNAL 343, Author Site , DOI PEARL
Crossingham G, Gale T, Roberts M, Carr A, Langton J & Anderson I 2011 'Content validity of a clinical problem solving test for use in recruitment to the acute specialties' Clin Med (Lond) 11, (1) 23-25 Author Site
Gale TCE, Roberts MJ, Sice PJ, Langton JA, Patterson FC, Carr AS, Anderson IR, Lam WH & Davies PRF 2011 'Reply from the authors † †© Crown copyright [2011]' British Journal of Anaesthesia 106, (2) 277-278 , DOI
Gale TCE, Roberts MJ, Sice PJ, Langton JA, Patterson FC, Carr AS, Anderson IR, Lam WH & Davies PRF 2010 'Predictive validity of a selection centre testing non-technical skills for recruitment to training in anaesthesia' Br J Anaesth 105, (5) 603-609 Author Site , DOI
Conference Papers
Crossingham G, Gale T, Berrisford R, Roberts M & Hill M 2015 'Captured debriefing after elective and specific emergencies in obstetric theatre can address latent threats and safety issues and improves the safety culture' 86-86
Crossingham G, Sice P, Roberts M, Gale T, Lam H, Anderson I, Carr A, Davies P & Langton J 2010 'Improving work place assessments in anaesthesia' 100-101 , DOI
Crossingham G, Gale T, Roberts M, Lam H, Sice P, Davies P, Anderson I, Carr A & Langton J 2009 'Validation of a six station OSCE style selection centre model for recruitment to anaesthesia in the South West Peninsula deanery' 317-317
Archer J, Cameron N, Lewis M, Marshall M, O'Hanlon J, Regan de Bere S, Walshe K, Baines R, Boyd A, et. al 2018 UMbRELLA: Evaluating the regulatory impacts of medical revalidation – final report. General Medical Council Publisher Site
Archer J, Roberts M, Zahra D, Bryce ME & O'Brien T 2017 Analysis of fitness to practise case data for the General Dental Council: Summary and Main Report. General Dental Council Publisher Site