Showing posts with label BAT III. Show all posts
Showing posts with label BAT III. Show all posts

Monday, March 06, 2017

CHC impact: The Cattell-Horn-Carroll (CHC) taxonomy of cognitive abilities has gone global



[Note.  Original post on March 6, 2017 has now been updated (March 7, 2017) to include reference to research in Spain]

The CHC taxonomy is officially a globetrotter with a large bank of frequent flier miles.   An indicator of the increasing prominence and spread of the CHC taxonomy is reflected in the globalization of CHC assessment activities in countries beyond the United States.  Several examples, which are not exhaustive, are summarized below. 

The influence of CHC theory, primarily via university assessment training in the use of the CHC-based Batería III Woodcock-Munoz (BAT III; Muñoz-Sandoval, Woodcock, McGrew, Mather, N. (2005a, 2005b), is prominent in Spanish speaking countries south of the US border.  This includes training, research or clinical use of the BAT III in Cuba, Mexico, Chile, Costa Rica, Panama, and Guatemala.[1]  Farther south, researchers in Brazil were early adopters of the CHC taxonomy as a guide for intelligence test development (Primi, 2003; Wechsler & de Cassia Nakano, 2016).  For example, Wechsler and colleagues (Wechsler & Schelini, 2006; Wechsler Nunes, Schelini, Pasian, Homsi, Moretti, & Anache, 2010; Wechsler, Vendramini, & Schelini, 2007) completed several studies in an attempt to adapt the CHC-based WJ III to Brazil.  More recently, Wechsler, Vendramini, Schelini, Lourenconi, de Souza and Bundim (2014) developed the Brazilian Adult Intelligence Battery (BAIB), which although only measuring Gf and Gc, is grounded in CHC theory.  Other Brazilian researchers have focused on the nature and measurement of Gf (Primi, Maria Ferrã, Almeida, 2010; Primi, 2014) with their research clearly couched in the context of the CHC model.  Even broader in scope, I (Kevin McGrew) together with Dr. Joel Schneider consulted with researchers from the Brazilian Ayrton Senna Institute (from 2016 to 2017) on the use of the CHC model as the key cognitive ability framework for developing measures of critical thinking and creativity as per the Organization for Economic Cooperationand Development (OECD, 2016) efforts to develop 21st century skills in students.

CHC influences are also present north of the US border in Canada.  The CHC-based WJ III has been used by practitioners in Canada based on a US-Canadian matched sampled comparison study (Ford, Swart, Negreiros, Lacroix & McGrew, 2010).  The WJ IV is also sold and used in Canada.  Additionally, a school-based group administered CHC test (Insight; Beal, 2011) measuring Gf, Gc, Gv, Ga, Gwm, Glr, Gs, CDS (Gt) is available in Canada.  CHC theory and testing has a prominent place in school psychology assessment courses in several major Canadian universities (e.g., University of British Columbia; University of Alberta).[2]

One of first systematic global CHC test development outreach project was efforts, led by Richard Woodcock and the Woodcock-Munoz Foundation, to provide Eastern European countries with cost-effective briefer versions of the CHC-based Woodcock-Johnson Tests of Cognitive Ability—Third Edition.   The WJ III-IE (international editions) projects started in the early 2000’s and continued until approximately 2015.  WJ III-IE norming efforts occurred in the Czech Republic, Hungary, Latvia, Romania, and Slovakia.  Other European efforts include the development of the Austrian-developed computerized Intelligence Structure Battery (INSBAT; Arendasy, Hornket, Sommer, Wagner-Menghin, Gittler, Hausler, Bongnar, & Wenzl, 2012) that measures six broad CHC abilities (Gf, Gq, Gc, Gwm, Gv, Glr).  The spread of CHC theory has also reached France and Spain.  French researchers have analyzed French versions of the various Wechsler scales from the perspective of the CHC framework (e.g., see Golay, Reverte, Rossier J, Favez N and Lecerf, 2013; also, Lecerf, Rossier, Favez, Revert and Coleaux, 2010).  In Spain, researchers in computer science education have used the CHC taxonomy to analyze the components of the Computational Thinking Test (CTt; Roman-Gonzalez, Perez-Gonzalez, Jimenez-Fernandez, 2016). German intelligence research has also been influenced by the CHC model (e.g., see Baghaei & Tabatabaee, 2015) as best illustrated by its incorporation in the popular German-based Berlin Intelligence Structure (BIS) program of research literature (Beauducel, Brocke & Liepmann, 2001; SÜß & Beauducel, 2015; Vock, Preckel, Holling, 201X),  Additionally, the Wuerzburger Psychologische Kurz-Diagnostik (WUEP-KD), a neuropsychological battery used in German speaking countries, is grounded in the CHC model (Ottensmeier, Zimolong, Wolff, Ehrich, Galley, von Hoff , Kuehl and Rutkowski, 2015).

Additional emerging CHC outposts in northern Europe include the Netherlands and Belgium.  Hurksa and Bakker (2016) reviewed the influence of CHC theory, as well as the neuropsychological PASS theory, in an article providing a historical overview of intelligence testing efforts in the Netherlands.  A strong indicator of the growing interest in CHC theory was a CHC theory and assessment conference (New angles on intelligence! A closer look on the CHC–model) at Thomas More University, Antwerp Belgium, in February 2015.  Faculty at Thomas More University have developed a CHC assessment battery (CoVaT-CHC) for children in Flanders that measures the CHC domains of Gf, Gc, Gv, Gwm, and Gs. 

Transported via the Chunnel to the United Kingdom and Northern Ireland, the CHC flame has been lit, but has not yet resulted in significant CHC test development.  In the 1990’s the WJ III author team was consulted to develop Irish norms for the WJ III.  One of the WJ III authors (Fred Schrank) visited and consulted at several universities in Ireland (University College Dublin, in particular) and continues to do so regarding the WJ IV (Fred Schrank, personal communication, March 2, 2017).  The CHC theory is now the dominant cognitive taxonomy taught in psychology departments (Trevor James, personal communication, March 3, 2017). 

Traveling to the Middle East, known CHC activities have been occurring in Jordan and Turkey.  Under the direction of Bashir Abu-Hamour (Abu-Hamour, 2014; Abu-Hamour, Hmouz, Mattar & Muhaidat, 2012;), the CHC-based WJ III has received considerable attention and the WJ IV was recently translated, adapted, and nationally normed in Jordan (Abu-Hamour & Al-Hmouz, 2017).  In Turkey, the first national intelligence test (Anatolu-Sak Intelligence Scale; ASIS) was developed between 2015-2017.  Although the ASIS composite scores are not couched in the CHC nomenclature, the theories listed as the foundation for the Turkish ASIS are general intelligence, CHC and PASS.  Additionally, I (Kevin McGrew) worked with two universities in 2016 in the preparation of government sponsored grant proposals for additional national intelligence test development in Turkey, both that proposed to use the CHC taxonomy. 

Pivoting toward Asia and the world “down under” reveals major CHC test development efforts.  Since the publication of the CHC-based WJ III several key universities and an Australian publisher have delved deep into CHC theory and assessment.  Psychological Assessments Australia (PAA) has translated, adapted, and normed the CHC-based WJ III and WJ IV in Australia and New Zealand.  The Melbourne area has been a particular flash point for CHC training and research.  Neuropsychologist and researcher Stephen Bowden and his students at the University of Melbourne have produced a series of multiple sample confirmatory factor analysis studies with markers of CHC abilities to investigate the constructs measured by neuropsychological tests measures.  The University of Monash, initially under the direction of John Roodenburg, and subsequently by his students, placed the CHC model at the core of their assessment course sequence and have influenced in the infusion of the CHC framework into the assessment practices of Australian psychologists (James, Jacobs, Roodenburg, 2015). 

Finally, one of the most ambitious CHC test development projects has been occurring in Indonesia since 2013.  Sponsored and directed by the Yayasan Dharma Bermakna Foundation (YDB), a nationally normed (over 4000 individuals) individually administered CHC-based battery of tests for school age children (ages 5-18) is, at the time of this writing, nearing completion.  The AJT Cognitive Assessment Test (AJT-CAT) will be one of the most comprehensive individually administered tests of cognitive abilities in the world.  The AJT-CAT currently consists of 27 individual cognitive tests designed to measure 21 different narrow CHC abilities (and two psychomotor tests to screen for motor difficulties) and preliminary confirmatory factor analysis indicated that the battery measure eight broad CHC cognitive domains (Gf, Gc, Gv, Gwm, Ga, Gs, Gl, Gr) and the Gp motor domain.[3]





[1] Thanks to Dr. Todd Fletcher for providing this information.

[2] Thanks to Laurie Ford and Damien Cormier for this information.


[3] Kevin McGrew has served as the CHC and applied psychometric expert consultant on this project and helped complete these preliminary structural analyses. 

Wednesday, April 21, 2010

IQ Test DNA Fingerprints: Comparison of WJ III/BAT III to WJ-R/BAT-R

Here is another of IQ's Corner "IQ Test CHC DNA Fingerprint" test comparison series.  This particular CHC fingerprint figure compares the CHC composition of the respective full scale total composite IQ scores from the WJ III/BAT III and the the earlier version of these batteries....the WJ-R/BAT-R.

Background information regarding the development, use and interpretation of this IQ global IQ score feature can be found at a prior post and in the IQ Test CHC DNA Fingerprint section on the blog side bar.  More can be found at IQ's Corner sister blog...the ICDP blog.

I now present a comparison of the R/III versions of the WJ/BAT batteries as I have seen psych reports where a subject had previously been administered the WJ-R and was later tested with the revised WJ III (in the case of Spanish-speaking individuals, I've seen the BAT-R and the BAT-III---click here for more background information on the Spanish version of the WJ III...the BAT III).  

In the case of the WJ-R/BAT-R, the full scale IQ composite is called the Broad Cognitive Ability (BCA) cluster.  The name was changed in the WJ III/BAT III to General Intellectual Ability (GIA) cluster.  The name change was not cosmetic.  The use of the term "general intellectual ability" in the newest WJ III/BAT III reflects the fact that this global IQ composite score is designed to be the best statistical estimate of the theoretical construct of general intelligence (g) via the use of differential test weights.

Using principal components analysis, a g-factor was extracted from the seven WJ III/BAT III Standard Cognitive battery tests (at each age level), g-factor weights calculated (by age---they shift slightly as a function of age), and the g-weights used to differentially weight the contribution of the seven tests to the composite GIA-Standard cluster score.  The same process was completed for the 14 test GIA-Extended cluster score.  This procedure is explained in detail in the WJ III/BAT III technical manuals/reports and is also briefly summarized in a free on-line Assessment Service Bulletin technical abstract.

In the case of the WJ-R/BAT-R, the respective 7-test BCA-Standard and 14-test BCA-Extended cluster scores are based on the simple arithmetic average of each set of scores, thus resulting in an equally weighted global IQ score.

Thus, differences between the global WJ-R/BAT-R and WJ III/BAT III IQ scores may occur as a function of the respective scores reflecting differential contributions of the broad Gf-Gc abilities as per the CHC theoretical model that underlies the batteries.

Below is the IQ Test CHC DNA Fingerprint comparison of the two respective editions of the WJ-R/BAT-R and WJ III/BAT III.  The weights presented for the WJ III/BAT III are the median (average) weights across all age groups.  The previously referenced ASB (see above) includes a table of the specific weights by age.

[double click on figure to enlarge]

Although the CHC composition of the respective global IQ scores did not change dramatically, there are enough differences by CHC ability to suggest that slightly different global IQ scores may be produced for the same individual depending on whether they took the WJ-R/BAT-R or the WJ III/BAT III (assuming proper administration, scoring, etc.).  Consistent with psychometric intelligence theory (aka., CHC theory), the WJ III/BAT III global IQ scores (GIA-Stnd; GIA-Ext) are more heavily weighted as per a subjects performance on the more g-loaded measures of Gf (fluid intelligence/reasoning), Gc (crystallized intelligence or comprehension-knowledge), and Glr (long-term storage and retrieval).  In contrast, abilities that are less cognitively demanding and more related to perceptual (Gv, Ga), speed (Gs), and short-term memory (Gsm) functioning contribute slightly less to an individuals WJ III/BAT III global IQ GIA score than was the case with the WJ-R/BAT-R.

If significant differences are found when comparing scores from the respective R/III editions of the WJ for an individual, examiners should review the Gf-Gc CHC test/cluster profiles to determine if some (or all) of the score differences might be related to the shift from an equally weighted global IQ score (WJ-R/BAT-R) to a differentially-weighted (WJ III/BAT III) global IQ score.  In theory, an individual could obtain very similar test-level scores on each battery, but because "all scores are not created equal" (in the estimation of general intelligence or g) in the case of the WJ III, a shift in the global GIA IQ scores may occur.

Other IQ Test CHC DNA Fingerprint comparisons can be found by clicking here.  More will be coming in the future.

[Conflict of interest note:  I am a co-author of the WJ III/BAT III]

Technorati Tags: , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ,

Thursday, October 02, 2008

BAT III Woodcock-Munoz Assessment Service Bulletin (ASB)

I was looking at the searches that led people to this blog and noticed a number of folks looking for information regarding the Batería III Woodcock-Muñoz.  In looking through my past posts I noticed only one post regarding the BAT III---a test review in APA Division 16's School Psychologist.

I realized that I did have access to an Assessment Service Bulletin (ASB) published by Riverside Publishing.  Below is the reference and a link to the PDf document.  I hope this helps those looking for additional information regarding the BAT III.

  • Schrank, F., McGrew, K., Ruef, M.,
    Alvarado, C., Muñoz-Sandoval, A. & Woodcock (2005). 
    Batería III Woodcock-Muñoz Assessment Service Bulletin
    Number 1:  Overview and Technical Supplement.  
    Itasca, IL: Riverside Publishing. (click to
    view)