XClose

Short courses

Home
Menu

Assessing Measurement Reliability and Validity

  • 9:30am to 1pm
  • 2 days

Overview

This online short course offers an introduction to the principles, methods of assessment, and appropriateness of statistical analyses for different types of measurement validity and reliability.

Particular focus is given to statistical assessment of reliability over time, context and rater.

This course takes place online, over two mornings (9:30am to 1pm). 

This course is delivered by UCL's Centre for Applied Statistics Courses (CASC), part of the UCL Great Ormond Street Institute of Child Health (ICH).

Course content

Understanding and assessing reliability and validity are important when developing and using new tests and measurement tools.

This course will introduce you to to the concepts of reliability and validity, how the two are associated, and the methods commonly used for assessing these factors in different data types and study designs.

The following topics will be covered:

  • Types of validity
  • Assessing validity of numeric and categorical outcomes
  • Types of reliability
  • Assessing reliability for numeric outcomes
  • Bland-Altman limits of agreement
  • Intraclass correlation
  • Assessing reliability for categorical outcomes
  • Kappa
  • Internal reliability of assessment measures
  • Correlation

Learning outcomes

By the end of the course you should be able to:

  • understand the importance of validity and reliability assessment and the link between the two
  • understand and differentiate validity types and the relevance of statistical analysis for each type
  • understand and differentiate key types of reliability
  • select appropriate methods for reliability analyses based on data type and study design
  • understand the basic principles and calculations behind common tests of reliability

Cost and concessions

The fees are as follows:

  • External delegates (non UCL) - £150
  • UCL staff, students, alumni - £75*
  • ICH/GOSH staff and students - free    

* valid UCL email address and/or UCL alumni number required upon registration

Certificates

You can request a certificate of attendance for this course once you've completed it. Please send your request to ich.statscou@ucl.ac.uk

Include the following in your email:

  • the name of the completed course for which you'd like a certificate
  • how you'd like your name presented on the certificate (if the name/format differs from the details you gave during registration)

Cancellations

Read the cancellation policy for this course on the ICH website. Please send all cancellation requests directly to the course administrator

Find out about other statistics courses

CASC's stats courses are for anyone requiring an understanding of research methodology and statistical analyses. The courses will allow non-statisticians to interpret published research and/or undertake their own research studies.

Find out more about CASC's full range of statistics courses, and the continuing statistics training scheme (book six one-day courses and get a seventh free.)

Course team

Dr Catalina Rivera Suarez

Dr Catalina Rivera Suarez

Catalina has been an Associate Lecturer (Teaching) at CASC since January 2021. She has a PhD in Psychology and an MSc in Applied Statistics from Indiana University. She’s passionate about teaching courses in research methods, statistics, and statistical software. Catalina’s research focuses on studying how caregivers support the development of children's attentional control and language. She implements multilevel modeling techniques to investigate the moment-to-moment dynamics of shared joint visual engagement, as well as the quality of the language input, influencing infant learning and sustained attention at multiple timescales.  

Dr Eirini Koutoumanou

Dr Eirini Koutoumanou

Eirini has a BSc in Statistics from Athens University of Economics and Business and an MSc in Statistics from Lancaster University (funded by the Engineering and Physical Sciences Research Council). She joined UCL GOS Institute of Child Health in 2008 to develop a range of short courses for anyone interested in learning new statistical skills. Soon after, CASC was born. In 2014, she was promoted to Senior Teaching Fellow. In 2019, she successfully passed her PhD viva on the topic of Copula models and their application within paediatric data. Since early 2020 she has been co-directing CASC with its founder, Emeritus Professor Angie Wade, and has been the sole Director of CASC since January 2022.

Learner reviews

"This course was very helpful to me. While I have some limited experience of the tests discussed, the course very much helped to consolidate and develop this base knowledge. [...] The course-book notes are excellent. Thanks."

"I liked the course very much though and it will help me a lot. Many thanks."

"Overall an excellent workshop, one of the best - if not the best - I have been to."

"Very good course. Tutor was knowledgeable, frank and approachable."

"I really liked this course, the presentation was good and the notes good. The lecturer didn't go too fast and it was possible to follow. Would highly recommend."

Course information last modified: 19 Apr 2022, 10:12