Assessing Measurement Reliability and Validity
11 March 2024, 9:30 am–5:00 pm
This course offers an introduction to the principles, methods of assessment, and the appropriateness of statistical analyses for different types of measurement validity and reliability. Particular focus is given to statistical assessment of reliability over time, context and rater.
Centre for Applied Statistics Courses
NOTE: This course will be delivered exclusively online via zoom. You can expect the same level of group and individual support as you would have received in our face-to-face/hybrid courses.
Additionally, we now offer this as a self-paced, online course that you can register for and start at any time. Click below under the 'Online/Self-Paced Materials' tab to register and gain access.
Understanding and assessing reliability and validity are important when developing and using new tests and measurement tools. This course gives an introduction to the concepts of reliability and validity, how the two are associated, and the methods commonly used for assessing these factors in different data types and study designs. Knowledge of basic statistical concepts (e.g., p-values, confidence intervals) is beneficial for this course. The following topics will be covered during this one-day course:
- Types of validity
- Assessing validity of numeric and categorical outcomes
- Types of reliability
- Assessing reliability for numeric outcomes
- Bland-Altman Limits of Agreement
- Intraclass Correlation
- Assessing reliability for categorical outcomes
- Internal reliability of assessment measures
Computers are not required for the face-to-face / hybrid version of this course.
Course fees (live)
Below are the course fees for all courses delivered live either face-to-face, or through online video feed.
External Delegates (Non-UCL) £150.00 UCL Staff and Students £75.00 * UCL Alumni £75.00 Staff and Doctoral Students from ICH/GOSH FREE †
* Valid UCL email address and/or UCL alumni number required upon registration. Please note, this category does not include hospital staff unless you hold an official contract with the university.
† Limited free spaces available. If there are no free places remaining, Staff and Doctoral Students from ICH/GOSH can still register at the UCL rate.
Cancellations: Cancellation Policy
Course Fees (self-paced)
Below are the fees for access to the online, self-paced version of this course (including VAT).
External Delegates (Non-UCL) £75.00 UCL Staff, Students and alumni £37.50* Staff and Doctoral Students from ICH/GOSH FREE †
* A valid UCL email address and/or UCL alumni number required. Please note, this category does not include hospital staff unless you have a formal affiliation with the university. To get this discount, please email email@example.com to confirm your eligibility and receive a code that can be entered at the checkout.
† If you are a doctoral student from SLMS (School of Life and Medical Sciences), you can get access to this, and all other self-paced courses developed by CASC by filling in this online form.
- Future Dates
Dates Time Apply 11th of March 2024 9.30am - 5.00pm Book Now
^For those attending online, we recommend logging in 10 minutes prior to the scheduled start time to access materials and ensure the course can start promptly at 9.30am.
- Online / self-paced materials
An online, self-paced version of this course is available that includes the following materials:
- Full electronic notes
- Short lecture videos (recorded outside of the classroom) that follow closely with the notes
- Accessible materials with alternative text for images, and captions/transcripts for each video
- Interactive multiple choice quizzes
- Extended practical exercises (with solutions) for further comprehension
Support: The course includes unlimited support through a forum that will be manned by one of our teaching fellows. We aim to provide responses to all questions on Tuesday and Friday each working week. Note that questions can only relate directly to the course materials and should not be used as a consultancy service for your own projects.
Personalised certificates will be generated automatically on completion.
UCL extend: The link below leads to the UCL extend store where this self-paced course is available for purchase. If you are eligible for a discount, then please email firstname.lastname@example.org to receive a voucher code that can be used on checkout. UCL delegates should use their university email address to register, and external delegates can use any other account.
Alternatively, if you are a doctoral student from SLMS (School of Life and Medical Sciences), you can get access to this, and all other self-paced courses developed by CASC by filling in this online form.
"Excellent course - reinforced self-learning. I liked the fact it wasn't software dependent - e.g. not 'Reliability using R' - but they still provided code for the major statistical packages. It was obvious that the lecturer had excellent knowledge on the subject. It was the first time that I had attended one of the CASC courses, and I wouldn't hesitate to attend one again."
"I really enjoyed the course as it was very well taught and presented"
"Really good presenter, clear slides and well-paced day. The content was very useful, but I had specific questions about this topic before I came and the presenter found time to answer them, which I really appreciated"
"Very useful course, presented clearly and coherently"
"I thought the presentation style was great and the content pitched appropriately."