Click on image to enlarge
Thursday, October 01, 2026
Another AI evaluation framework informed by the human CHC cognitive abilities taxonomy
According to my tracking of the literature (of course, most likely not complete), here is a third article (open access from the Journal of Intelligence) that proposes using the CHC cognitive ability taxonomy (or parts of it) to evaluate an aspect of AI performance—in this case AI-assisted organizational decision-making. The other two proposed AI evaluation framework articles using the CHC taxonomy (alone or as part of a much grander framework) can be found here and here.
In a related development, Kameron Green—the developer behind an ambitious and grand AI evaluation framework (in second to last link above)—today posted a link to an AI generated video summary overview of his HCQM taxonomic model—which would help most readers understand his lengthy HCQM paper.
Tuesday, September 02, 2025
From the #Cattell-Horn-Carroll (#CHC) #cognitive #intelligence theory archives: Photos of important 1999 Carroll, Horn, Woodcock, Roid et al. meeting in Chapel Hill, NC.
I was recently cleaning my office when I stumbled upon these priceless photos from a 1999 historical meeting in Chapel Hill, NC that involved John Horn, Jack Carroll, Richard Woodcock, Gale Roid, John Wasserman, Fred Schrank and myself). The provenance (I’ve always wanted to use this word 😉) for the meeting is provided below the pictures in the form of extracted quotes from Wasserman (2019) and McGrew (2023) (links below), which I confirmed with John Wasserman via a personal email on August, 30, 2025.
The 1990 CHC-based WJ-R had already been published and the WJ III author team were nearing completion of the CHC-based WJ III (2001). Unbeknownst to many is the fact that Woodock was originally planned to be one of the coauthors of the SB5 (along with Gale Roid), which explains his presence in the photo’s that document one of several planning meetings for the CHC-based SB5.
I was also involved as a consultant during the early planning for the CHC-based SB5 because of my knowledge of the evolving CHC theory. My role was to review and integrate all available published and unpublished factor analysis research on all prior editions of the different SB legacy tests. I post these pictures with the names of the people included in each photo immediately below the photo. No other comments (save for the next paragraph) are provided.
To say the least, my presence at this meeting (as well as many other meetings with Carroll and Horn together, as well as with each alone, that occured when planning the various editions of the WJ’s) was surrealistic. One could sense a paradigm shift in intelligence testing that was happening in real time during the meetings! The expertise of the leading theorists regarding what became known as CHC theory, together with the expertise of the applied test developers of Woodcock and Roid, provided me with learning experiences that cannot be captured in any book or university course work.
Click on images to enlarge.
Be gentle, these are the best available copies of images taken with an old-school camera (not smart-phone based digital images)
“It was only when I left TPC for employment with Riverside Publishing (now Houghton-Mifflin-Harcourt; HMH) in 1996 that I met Richard W. Woodcock and Kevin S. McGrew and became immersed in the extended Gf-Gc (fluid-crystallized)/ Horn-Cattell theory, beginning to appreciate how Carroll's Three-Stratum (3S) model could be operationalized in cognitive-intellectual tests. Riverside had been the home of the first Gf-Gc intelligence test, the Stanford–Binet Intelligence Scale, Fourth Edition (SB IV; R. L. Thorndike, Hagen, & Sattler, 1986), which was structured hierarchically with Spearman's g at the apex, four broad ability factors at a lower level, and individual subtests at the lowest level. After acquiring the Woodcock–Johnson (WJ-R; Woodcock & Johnson, 1989) from DLM Teaching Resources, Riverside now held a second Gf-Gc measure. The WJ-R Tests of Cognitive Ability measured seven broad ability factors from Gf-Gc theory with an eighth broad ability factor possible through two quantitative tests from theWJ-R Tests of Achievement. When I arrived, planning was underway for new test editions – the WJ III (Woodcock, McGrew, & Mather, 2001) and the SB5 (Roid, 2003) – and Woodcock was then slated to co-author both tests, although he later stepped down from the SB5. Consequently, I had the privilege of participating in meetings in 1999 with John B. Carroll and John L. Horn, both of whom had been paid expert consultants to the development of the WJ-R” (Wasserman, 2019, p. 250)
——————-
“In 1999, Woodcock brokered the CHC umbrella term with Horn and Carroll for practical reasons (McGrew 2005)—to facilitate internal and external communication regarding the theoretical model of cognitive abilities underlying the then-overlapping test development activities (and some overlapping consultants, test authors, and test publisher project directors; John Horn, Jack Carroll, Richard Woodcock, Gale Roid, Kevin McGrew, Fred Schrank, and John Wasserman) of the Woodcock–Johnson III and the Stanford Binet–Fifth Edition by Riverside Publishing” (McGrew, 2023, p. 3)
Friday, January 17, 2025
#WJV and #CHC theory of #cognitive abilities: An animated video overview of CHC theory model used in WJ V revision - attention #schoolpsychology #SLD #SPED #psychology #intelligence
Warning. If I access this video directly (outside of blogger platform) from my browser, it runs just fine. But, if you click on the third image below (that should start the video), you may likely get a message that you “need to sign in” to view the video…and I can’t figure it out…perhaps you can. So, if that happens, either click on the raw URL link that follows or in blue font or cut and paste that lin (just the link info between the “ ” marks) into your web browser… “ https://www.youtube.com/watch?v=6FVEyaBT2R4”. I hope one option works. If not…”it is what it is”..it is worth the extra small effort. The YouTube video is the third image down. I can’t control if YouTube inserts brief ads, it is what they do these days with many uploaded videos.
This 2018 version of the CHC theory is the theoretical blueprint for the forthcoming WJ V revision, scheduled for launch in Feb. 2025. Additional free information about the WJ’s and CHC theory can be found at my MindHub web page. COI disclosure—I am the senior author of the WJ V and a coauthor of the current WJ V
Enjoy
Thursday, November 14, 2024
Stay tunned!!!! #WJV g and non-g multiple #CHC theoretical models to be presented in the forthcoming (2025) technical manual: Senior author’s (McGrew) position re the #pscyhometric #g factor and #bifactorg models.
(c) Copyright, Dr. Kevin S. McGrew, Institute for Applied Psychometrics (11-14-24)
Warning, may be TLDR for many. :). Also, I will be rereading again multiple times and may tweak minor (not substantive) errors and post updates….hey….blogging has an earthy quality to it:)
The classic hierarchical g model “places a psychometric g stratum III ability at the apex over multiple broad stratum II CHC abilities” (McGrew et al., 2023, p. 2). This model is most often associated with Carroll (1993; 2003) and is called (in panel A in the above figure) the Carroll hierarchical g broad CHC model. In this model the shared variance of subsets of moderately to highly correlated tests are first specified as 10 CHC broad ability factors (i.e., the measurement model; Gf, Gc, Gv, etc.). Next the covariances (latent factor correlations) among the broad CHC factors are specified as being the direct result of a higher-order psychometric g factor (i.e., the structural model).
Because…the complexity involved in specifying and evaluating bi-factor g models with 60 cognitive and achievement tests was found to be extremely complex and fraught with statistical convergence issues. Trust me…I tried hard and long to run bifactor g models for the WJ V norm data. It was possible to run bifactor g models separately on the cognitive and achievement sets of WJ V tests, but that does not allow for the direct comparison to the other three structural models that utilized all 60 cognitive and achievement tests in single CFA models. Instead, at of the time the WJ V technical manual analyses were being completed and are now being summarized, the Riverside Insights (RI) internal psychometric research team was tackling the complex issues involved in completing WJ V bifactor g models, first in the separate sets of cognitive and achievement tests. Stay tunned for future professional conference paper presentations, white papers, or journal article submissions by the RI research team.
Friday, November 08, 2024
On the origin and evolution (from 1997 chapter to 2025 #WJV) of the #CHC #intelligence theories definitions: The missing CHC definition’s birth certificate
The historical development of the CHC model of intelligence has been documented by McGrew (2005) and Schneider and McGrew (2012) and summarized by Kaufman and colleagues (Kaufman, 2009; Kaufman, Raiford & Coalson, 2016). Additional extensions and historical anecdotes were rececntly presented by McGrew (2023) in an article included in a special issue of the Journal of Intelligence focused on Jack Carroll’s tri-stratum theory @ 30 years. McGrew (2023) recommended that CHC theory should now be referred to as a group of CHC theories (i.e., a family of orthogonally correlated models) that recognizes the similarities and differences between the theoretical models of Cattell, Horn and Carroll.
An unexplained crucial, yet missing piece of the CHC story, is the origin of the original CHC broad and narrow ability definitions. The CHC ability definition birth certificate, until recently, had not been revealed. To fend off possible CHC “birther” controversies, I will now set the record straight again (as was first done in 2017) regarding the heritage of the past and current CHC definitions.
Wednesday, November 06, 2024
On the conflation of #psychometric and theoretical #g (general #intelligence): Is g the Loch Ness Monster of psychology?
Monday, November 04, 2024
A Psychometric Network Analysis of CHC Intelligence Measures: Implications for Research, Theory, and Interpretation of Broad CHC Scores "Beyond g"
(Note. I’ve made several similar posts with a similar message on several social media outlets over the last 1.5 years)
Yes. This may be seen as a brag post (I plead the fifth). But, I really want (need?) to share this recent publication (January 2023). Why? Because, after 40 years of scholarship, I consider this article (which is open access and can be downloaded and read freely) to be one of my 5 top peer-reviewed research publications. The article is part of a special issue (Assessment of Human Intelligence-State of the Art in the 2020s) of the Journal of Intelligence, edited by Alan Kaufman et al. Warning—it is a long article. The article is the result of collaboration with Joel Schneider, Scott Decker and Okan Bulut.
The content of the article pushes the “edge of the envelop” regarding intelligence theories and testing via the use of exploratory psychometric network analysis (PNA) within the context of network non-g (i.e., psychometric g) models of intelligence. This approach represents an emerging paradigm shift for thinking about intelligence theories and testing. As stated by Savi et al. (2021) "factor analysis models dominated the 20th century of intelligence research, but network models will dominate the 21st." I believe Savi et al. are more-or-less correct. I believe PNA and non-g network models can move intelligence theories and testing forward—as they have become stagnant via the repeated use of "common cause" descriptive and taxonomic-generating factor analysis methods. Used in isolation, factor analysis-based intelligence test and theory models constrain school psychologists and other assessment professionals from moving forward (as described in the paper). For far too long, especially in school psychology, we have been "stuck on g" factor analysis based models of test interpretation.
As stated in our article, "newer non-g emergent property theories of intelligence might lead to better intervention research for individuals who have been marginalized by society. Holden and Hart (2021) suggest that network-based non-g theories, particularly those that feature Gwm-AC mechanisms [the working memory-attentional control complex] (process overlap theory in particular) may hold promise as a vehicle for improving, and not harming, social justice and equity practices and valued outcomes for individuals in marginalized groups" (McGrew et al., 2023). Read the original Holden and Hart article if you are interested in the social justice implications of a new way of thinking about intelligence grounded in modern network non-g conceptualizations of intelligence.
Even if the methodological material is not your cup of tea, much of the McGrew et al. (2023) introduction is relevant to assessment practitioners. Also, several sections in the discussion deal with practical implications for understanding new insights into intelligence theories, broad cluster test interpretation in general, and some strengths and weaknesses of the WJ IV CHC test and cluster scores.
If you are not familiar with the Journal of Intelligence (JOI), I would suggest SPs take a look. It is not the Intelligence journal from ISIR. It is the "new kid on the block" and has quickly become a prestigious open access publication outlet with a top notch editorial board. Since it is open access, all articles can be downloaded, read, and shared freely—an awesome free source of emerging thinking in the field of intelligence. JOI is publishing interesting articles from a wide variety of perspectives by a diversity of scholars interested in intelligence, cognition, and related topics. It has become one of my favorite journals the past few years.
Finally, exploratory hierarchical psychometric network analysis methods (along with traditional structural analysis methods) were applied to the WJ V norm data—these results will be in the WJ V Technical Manual (LaForte, Dailey, McGrew, 2025).
My WJ IV conflict of interest (COI) is included in the linked PDF article. My WJ V COI and additional COI information can be found at the MindHub web portal.
























