Scale Development and Psychometrics
in person in Calgary | July 19-20, 2024, during Rocky Mountain Methodology Academy
$895 (Canadian dollars) + 5% GST. Discounts available for graduate students and multi-course enrollment.
Researchers in the academic and private sectors often need to measure some aspect of people’s psychology be it their attitudes, satisfaction, motivation or intentions. We assume that the numbers these scales, questionnaires, tests and surveys produce are meaningful: that someone with a higher satisfaction score is in fact more satisfied than someone with a lower score. Because scale scores are used to make decisions like how to measure critical outcomes in a research study, develop a product, or admit a student or promote an employee, researchers need to thoroughly evaluate their validity. This short course will cover how to develop, evaluate, and refine scales using modern psychometric methods.
INSTRUCTOR: Dr. Jessica Flake, PhD
In this course, you will learn how to apply modern validity theory and psychometric methods to appropriately develop and use scales measuring psychological attributes.
- Overview of construct validity theory and types of validity evidence
- Item writing
- Item content review and think-aloud protocol
- Interpreting item analysis
- Overview of types of factor analysis
- Interpreting exploratory factor analysis
- Interpreting reliability analysis
- Interpreting and evaluating validity evidence for scale selection and use
The course will be delivered in person at the University of Calgary July 19-20, 2024, during Rocky Mountain Methodology Academy. The course meets from 9.00am to 5.00pm each day.
The course will focus on scale development and refinement with psychometric methods that can be implemented in many statistical software packages. Because this is a hands-on course, learners are encouraged to bring a laptop to class with a copy of R or SPSS installed. However, instruction will focus on demonstrating the statistical techniques and interpreting the most common outputs in various software programs. Provided materials and examples will include analysis scripts with annotated output from both SPSS and R.
This course will be helpful for researchers in any field —including psychology, sociology, education, business, human development, social work, public health, communication and others that rely on social science methodology —who want to develop and use scales to measure psychological attributes. Learners should have background knowledge in introductory statistics topics such as univariate statistical tests, descriptive statistics, and correlation. Ideally learners should be comfortable with multiple regression techniques. Though proficiency in a specific software isn’t required, ideally participants will have some familiarity with running analyses using some type of statistical software (e.g., R, SPSS, SAS, STATA).
Upon completing this course, you will
- Be able to define construct validity and describe different forms of validity evidence
- Evaluate scale items for poor, confusing, or problematic wording
- Use descriptive statistics to quantitatively evaluate item properties
- Use qualitative approaches to review item content
- Compare different approaches to factor analysis
- Compare different approaches to quantifying reliability
- Interpret an exploratory factor analysis
- Interpret a reliability analysis
- Evaluate multiple sources of validity evidence to select a scale
- Evaluate multiple sources of validity evidence to develop or refine a scale
A certificate of completion from the Canadian Centre for Research Analysis and Methods is provided at the end of the course.