If you’re a regular follower here, you’ll know how much I stress the importance of choosing assessments that are statistically reliable and valid. This doesn’t mean you need to study assessment manuals, looking at every little detail, but it’s a good idea to have a glance, and see if there are any gaps. Remember, it’s not enough to say that it works based on anecdotal evidence; proving it works will get you good results.
CLSR Inc. has been representing the COPSystem in Canada since we opened our doors in 1998, and company director Denise Hughes has been representing it since the 1980s. The COPSystem is one of my favourite career assessments because it looks at values, interests, and abilities when considering career options. The editors’ commitment keeping it current through research and re-testing makes it a favourite with career professionals across Canada.
Below is a brief summary of the reliability and validity of the COPSystem assessments, provided by the publisher EdITS. You can see for yourself the quality of results this suite of assessments produces. Want to know more about the COPSystem, or how the internet version stacks up against the paper version, reach out to me, I’m happy to have a conversation.
A career guidance assessment program is a valuable way to increase self-awareness and professional competence among students and working adults. The COPSystem consists of the COPS Interest Inventory, the CAPS ability battery, and the COPES work values survey. All three are long-established, reliable, and valid assessments relating interests, abilities and values to occupations and occupational information. Reliability and validity information is presented in this article.
Career Occupational Preference System Interest Inventory (COPS)
In terms of reliability for the COPS, alpha coefficients for each scale range from .83 to .91. Numerous studies have been conducted to establish the construct validity of the COPS. Correlations of the COPS interest scales to other similar assessments have been used to establish concurrent validity. In comparing the COPS with the Kuder, correlations between conceptually similar scales ranged from .21 to .49 which were significant and were as high as would be expected. In this study, 89% had at least one of their top three areas of interest the same on both the COPS and the Kuder.
When compared to the Holland-based Vocational Preference Inventory (VPI), correlations between conceptually similar scales ranged from .50 to .70. To add further support to the construct validity of the COPS, declared major of entering college freshmen was compared to COPS scores and for 71% of the sample, declared major matched one of the top three measured interests. A long-term predictive validity study showed that 64% of students were in a job or college major that matched one of their three highest interest areas from one to seven years after taking the COPS.
Career Ability Placement Survey (CAPS)
The CAPS test-retest reliability coefficients ranged from .70 to .95. To establish concurrent validity, correlations with the Differential Aptitude Tests (DAT) were obtained and ranged from .65 to .81 between conceptually similar tests. Correlations were obtained between CAPS tests and grades in specific subject areas. These correlations ranged from .30 to .60 between the CAPS tests and the subject to which it was most closely related. For example, the CAPS numerical ability test had the highest correlations with grades in math. These results are significant and demonstrate the validity of the CAPS. Predictive validity studies show that ability scores are significantly related to subsequent career choice.
Career Orientation Placement and Evaluation Survey (COPES)
With regards to the COPES, alpha reliabilities ranged from .60 to .85. Concurrent validity studies demonstrated that the scales on the COPES are correlated .40 to .60 to conceptually similar scales on the DF Opinion Survey and the Allport Vernon which are as high as would be predicted. The COPS scores were compared to the COPES scores to confirm the validity of the values scores as related to the interest clusters. This analysis explored the relationship between interests and work values by selecting a sample of examinees with scores in a single interest area at the 75th percentile or higher and establishing a COPES profile.
The findings demonstrated the relationship between work values and interest scores that is reflected on the COPSystem Comprehensive Career Guide. A preliminary follow-up study for the COPES found an 89% hit rate for work values matched to subsequent career or college major choice. This article is a brief summary of technical information. For a more comprehensive discussion of the reliability and validity of the COPSystem please see the individual Technical and/or Examiner’s Manual for each assessment.
Republished with permission. ©2019 EdITS www.edits.net
The COPS is my most effective tool I use for building confidence in youth who are out of esteem. Since it shows their percentiles in all 14 career streams they usually score in the top 25 percentile in at least one stream, which is a good predictor of success. It helps them focus on their area of strength.