Short courses


Assessing Measurement Reliability and Validity

  • 9:30am to 1pm
  • 2 days


This online short course offers an introduction to the principles, methods of assessment, and appropriateness of statistical analyses for different types of measurement validity and reliability.

Particular focus is given to statistical assessment of reliability over time, context and rater.

This course takes place online, over two mornings (9:30am to 1pm). 

This course is delivered by UCL's Centre for Applied Statistics Courses (CASC), part of the UCL Great Ormond Street Institute of Child Health (ICH).

Course content

Understanding and assessing reliability and validity are important when developing and using new tests and measurement tools.

This course will introduce you to to the concepts of reliability and validity, how the two are associated, and the methods commonly used for assessing these factors in different data types and study designs.

The following topics will be covered:

  • Types of validity
  • Assessing validity of numeric and categorical outcomes
  • Types of reliability
  • Assessing reliability for numeric outcomes
  • Bland-Altman limits of agreement
  • Intraclass correlation
  • Assessing reliability for categorical outcomes
  • Kappa
  • Internal reliability of assessment measures
  • Correlation

Learning outcomes

By the end of the course you should be able to:

  • understand the importance of validity and reliability assessment and the link between the two
  • understand and differentiate validity types and the relevance of statistical analysis for each type
  • understand and differentiate key types of reliability
  • select appropriate methods for reliability analyses based on data type and study design
  • understand the basic principles and calculations behind common tests of reliability

Cost and concessions

The fees are as follows:

  • External delegates (non UCL) - £150
  • UCL staff, students, alumni - £75*
  • ICH/GOSH staff and students - free    

* valid UCL email address and/or UCL alumni number required upon registration


You can request a certificate of attendance for this course once you've completed it. Please send your request to ich.statscou@ucl.ac.uk

Include the following in your email:

  • the name of the completed course for which you'd like a certificate
  • how you'd like your name presented on the certificate (if the name/format differs from the details you gave during registration)


Read the cancellation policy for this course on the ICH website. Please send all cancellation requests directly to the course administrator

Find out about other statistics courses

CASC's stats courses are for anyone requiring an understanding of research methodology and statistical analyses. The courses will allow non-statisticians to interpret published research and/or undertake their own research studies.

Find out more about CASC's full range of statistics courses, and the continuing statistics training scheme (book six one-day courses and get a seventh free.)

Course team

Dr Dean Langan - Course Lead

Dr Dean Langan - Course Lead

Dean is a Senior Teaching Fellow in CASC. He has a Bachelor’s degree in Mathematics from University of Liverpool, a Master's degree in Medical Statistics from University of Leicester, and a PhD from University of York for his research in statistical methods for random-effects meta-analysis. He's worked as a statistician on a number of clinical trials related to stroke and myeloma at the Clinical Trials Research Unit in Leeds. His specialist areas include statistical methods for meta-analysis, R programming, clinical trial methodology and research design.

Learner reviews

"This course was very helpful to me. While I have some limited experience of the tests discussed, the course very much helped to consolidate and develop this base knowledge. [...] The course-book notes are excellent. Thanks."

"I liked the course very much though and it will help me a lot. Many thanks."

"Overall an excellent workshop, one of the best - if not the best - I have been to."

"Very good course. Tutor was knowledgeable, frank and approachable."

"I really liked this course, the presentation was good and the notes good. The lecturer didn't go too fast and it was possible to follow. Would highly recommend."

Course information last modified: 24 Jun 2021, 08:26