{"id":34085,"date":"2022-10-20T06:43:00","date_gmt":"2022-10-20T06:43:00","guid":{"rendered":"https:\/\/hoozoocomm.co.za\/cognadev\/?p=34085"},"modified":"2026-06-29T09:56:05","modified_gmt":"2026-06-29T09:56:05","slug":"predicting-job-performance","status":"publish","type":"post","link":"https:\/\/hoozoocomm.co.za\/cognadev\/2022\/10\/20\/predicting-job-performance\/","title":{"rendered":"Predicting Job Performance"},"content":{"rendered":"<div class=\"wpb-content-wrapper\"><p>[vc_row][vc_column][vc_empty_space height=&#8221;20px&#8221;][vc_custom_heading text=&#8221;Predicting Job Performance&#8221; font_container=&#8221;tag:h1|font_size:35px|text_align:left|color:%23049EB3&#8243; google_fonts=&#8221;font_family:Arvo%3Aregular%2Citalic%2C700%2C700italic|font_style:700%20bold%20regular%3A700%3Anormal&#8221; css=&#8221;&#8221;][vc_empty_space height=&#8221;10px&#8221;][vc_custom_heading text=&#8221;By Paul Barrett&#8221; font_container=&#8221;tag:p|font_size:20px|text_align:left|color:%23000000&#8243; google_fonts=&#8221;font_family:Lato%3A100%2C100italic%2C300%2C300italic%2Cregular%2Citalic%2C700%2C700italic%2C900%2C900italic|font_style:700%20bold%20regular%3A700%3Anormal&#8221; css=&#8221;&#8221;][\/vc_column][\/vc_row][vc_row][vc_column][vc_empty_space height=&#8221;40px&#8221;][vc_column_text css=&#8221;&#8221;]<\/p>\n<div>\n<p>The now famous article by Schmidt, F.L., &amp; Hunter, J.E. (1998).\u00a0<a href=\"https:\/\/doi.org\/10.1037\/0033-2909.124.2.262\" target=\"_blank\" rel=\"noopener\">The Validity and Utility of Selection Methods in Personnel Psychology: practical and theoretical implications of 85 years of research findings.\u00a0<\/a><em>Psychological Bulletin<\/em>\u00a0124, 2, 262-274; made available a list of meta-analytic validity coefficients of predictors of job performance which have been, and still are, regarded by many as the\u00a0<em>de facto<\/em>\u00a0values for the workplace.<\/p>\n<p>However, in 2013, Frank Schmidt, In-Sue Oh, and Jonathan Shaffer presented some updated validities in a talk presented at a Personnel Testing Council Metropolitan Washington (PCTMU) meeting: Schmidt, F.L., Oh, I-S., &amp; Shaffer, J. (2013)\u00a0<a href=\"https:\/\/nanopdf.com\/download\/table-1-8_pdf#\" target=\"_blank\" rel=\"noopener\">The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 95 years of research findings; An update\u00a0<\/a>, pp 1-9\u00a0(open-access).<\/p>\n<p>Then, in 2016, the 2013 conference paper was augmented substantially and published as a major preprint article on the Social Science Research Network (SSRN) site, It was eventually taken down off the SSRN website as the authors sought formal publication in a journal. The link here is to a pdf copy of the article on the University of Baltimore website\u00a0(open-access). Schmidt, F.L., Oh, I-S., &amp; Shaffer, J.A. (2016).\u00a0<a href=\"https:\/\/home.ubalt.edu\/tmitch\/645\/session%204\/Schmidt%20&amp;%20Oh%20validity%20and%20util%20100%20yrs%20of%20research%20Wk%20PPR%202016.pdf\" target=\"_blank\" rel=\"noopener\">The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 100 years of research findings\u00a0<\/a>, pp. 1-74.<\/p>\n<p>As far as I&#8217;m aware (having exchanged emails with In-Sue Oh), the two remaining authors are still trying to get the paper published\u00a0<strong>(sadly, Frank Schmidt passed away in August 2021)<\/strong>, after the initial 2016 submission attracted limited interest. Since 2020, the paper has been in the process of a Revise and Resubmit procedure with a major psychology journal.<\/p>\n<p>I have included its indices here as some of its revised estimates are astounding (e.g. unstructured employment interviews have the same validity as structured ones; although querying this with In-Sue Oh, it would appear the studies used for the meta-analysis of unstructured interviews were actually structured to some degree, although not to the more organized levels of the structured interview studies).<\/p>\n<blockquote><p>Finally, a more recent article is &#8220;in Press&#8221; in an APA journal: Sackett, P.R., Zhang, C., Berry, C.M., &amp; Lievens, F. (2022).\u00a0<a href=\"https:\/\/doi.org\/10.1037\/apl0000994\" target=\"_blank\" rel=\"noopener\">Revisiting meta-analytic estimates of validity in personnel selection: Addressing systematic overcorrection for restriction of range\u00a0<\/a>.\u00a0<em>Journal of Applied Psychology<\/em>, Advance online publication, pp. 1-104. This paper recalculates the Schmidt and Hunter (1998) validities based upon a revision of the estimates used to correct for restriction of range in the original paper.\u00a0&#8220;We conclude that our selection procedures remain useful, but selection predictor-criterion relationships are considerably lower than previously thought.&#8221;\u00a0.<\/p><\/blockquote>\n<p>The figure below presents the validity estimates from the three papers introduced above. It is a dynamic graph in that if you hover over any legend entry atthe top of the graph, it will highlight the bars for that publication.<\/p>\n<p>If you click on any legend entry, it will toggle the removal or re-display of the bars for that publication, allowing you to more easily make pairwise comparisons of validity estimates.<\/p>\n<p>Page 2 of the figure provides the table of all the validity coefficients from each article, as plotted in the figure.<\/p>\n<\/div>\n<p>[\/vc_column_text][vc_column_text css=&#8221;&#8221;]<\/p>\n<div class=\"infogram-embed\" data-id=\"_\/9X4AbW0PNhHajRcLtazG\" data-type=\"interactive\" data-title=\"Meta-Analytic Validity Coefficients for Predictors of Job Performance\"><\/div>\n<p><script>!function(e,n,i,s){var d=\"InfogramEmbeds\";var o=e.getElementsByTagName(n)[0];if(window[d]&&window[d].initialized)window[d].process&&window[d].process();else if(!e.getElementById(i)){var r=e.createElement(n);r.async=1,r.id=i,r.src=s,o.parentNode.insertBefore(r,o)}}(document,\"script\",\"infogram-async\",\"https:\/\/e.infogram.com\/js\/dist\/embed-loader-min.js\");<\/script><\/p>\n<div style=\"padding: 8px 0; font-family: Arial!important; font-size: 13px!important; line-height: 15px!important; text-align: center; border-top: 1px solid #dadada; margin: 0 30px;\"><a style=\"color: #989898!important; text-decoration: none!important;\" href=\"https:\/\/infogram.com\/1prl2yjl1zydxmcgqgkq9d9mm7im655wnvv\" target=\"_blank\" rel=\"noopener\">Meta-Analytic Validity Coefficients for Predictors of Job Performance<\/a><br \/>\n<a style=\"color: #989898!important; text-decoration: none!important;\" href=\"https:\/\/infogram.com\" target=\"_blank\" rel=\"nofollow noopener\">Infogram<\/a><\/div>\n<p>[\/vc_column_text][vc_column_text css=&#8221;&#8221;]<\/p>\n<div>\n<p>From these data, it is no longer clear whether Big Five personality attributes are even worth assessing via self-report, contextualised or otherwise, such is their explanatory inaccuracy. However, as shown in: Oh, I-S., Wang, G., &amp; Mount, M.K. (2011).\u00a0<a href=\"https:\/\/doi.org\/10.1037\/a0021832\" target=\"_blank\" rel=\"noopener\">Validity of observer ratings of the five-factor model of personality traits: A meta-analysis\u00a0<\/a>.\u00a0<em>Journal of Applied Psychology<\/em>, 96, 4, 762-773, Big Five validities computed using single-rater observed ratings do exceed self-report questionnaire validities.<\/p>\n<p>As to GMA, its 1998 validity has almost halved given the more recent article from Sackett et al (2022). I have said more on this issue in a recent\u00a0<a href=\"https:\/\/www.cognadev.com\/blog_152.html\" target=\"_blank\" rel=\"noopener\">Cognadev blog\u00a0<\/a>. And, an earlier article: Richardson, K., &amp; Norgate, S.H. (2015).\u00a0<a href=\"https:\/\/doi.org\/10.1080\/10888691.2014.983635\" target=\"_blank\" rel=\"noopener\">Does IQ Really Predict Job Performance?\u00a0<\/a><em>Applied Developmental Science,<\/em>\u00a019, 3, 153-169.\u00a0(open-access)\u00a0had already questioned the accuracy of the earlier meta-analytic validity estimates in this area.<\/p>\n<p>Anyway, I&#8217;m sure controversy will remain as to the wisdom or otherwise of correcting correlations for attenuation due to a variety of factors, but the graph above does at least present the competing evidence to date.<\/p>\n<\/div>\n<p>[\/vc_column_text][\/vc_column][\/vc_row]<\/p>\n<\/div>","protected":false},"excerpt":{"rendered":"<p>[vc_row][vc_column][vc_empty_space height=&#8221;20px&#8221;][vc_custom_heading text=&#8221;Predicting Job Performance&#8221; font_container=&#8221;tag:h1|font_size:35px|text_align:left|color:%23049EB3&#8243; google_fonts=&#8221;font_family:Arvo%3Aregular%2Citalic%2C700%2C700italic|font_style:700%20bold%20regular%3A700%3Anormal&#8221; css=&#8221;&#8221;][vc_empty_space height=&#8221;10px&#8221;][vc_custom_heading text=&#8221;By Paul Barrett&#8221; font_container=&#8221;tag:p|font_size:20px|text_align:left|color:%23000000&#8243; google_fonts=&#8221;font_family:Lato%3A100%2C100italic%2C300%2C300italic%2Cregular%2Citalic%2C700%2C700italic%2C900%2C900italic|font_style:700%20bold%20regular%3A700%3Anormal&#8221; css=&#8221;&#8221;][\/vc_column][\/vc_row][vc_row][vc_column][vc_empty_space height=&#8221;40px&#8221;][vc_column_text css=&#8221;&#8221;] The now famous<\/p>\n","protected":false},"author":1,"featured_media":34084,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[44],"tags":[],"class_list":["post-34085","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-assessment-issues"],"_links":{"self":[{"href":"https:\/\/hoozoocomm.co.za\/cognadev\/wp-json\/wp\/v2\/posts\/34085","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/hoozoocomm.co.za\/cognadev\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/hoozoocomm.co.za\/cognadev\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/hoozoocomm.co.za\/cognadev\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/hoozoocomm.co.za\/cognadev\/wp-json\/wp\/v2\/comments?post=34085"}],"version-history":[{"count":7,"href":"https:\/\/hoozoocomm.co.za\/cognadev\/wp-json\/wp\/v2\/posts\/34085\/revisions"}],"predecessor-version":[{"id":34092,"href":"https:\/\/hoozoocomm.co.za\/cognadev\/wp-json\/wp\/v2\/posts\/34085\/revisions\/34092"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/hoozoocomm.co.za\/cognadev\/wp-json\/wp\/v2\/media\/34084"}],"wp:attachment":[{"href":"https:\/\/hoozoocomm.co.za\/cognadev\/wp-json\/wp\/v2\/media?parent=34085"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/hoozoocomm.co.za\/cognadev\/wp-json\/wp\/v2\/categories?post=34085"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/hoozoocomm.co.za\/cognadev\/wp-json\/wp\/v2\/tags?post=34085"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}