Psychometric Network Analysis of the Hungarian WAIS

J. Intell. 2019, 7, 21; doi:10.3390/jintelligence7030021

Christopher J. Schmank, Sara Anne Goring, Kristof Kovacs and Andrew R. A. Conway

Received: 1 June 2019; Accepted: 24 August 2019; Published: 9 September 2019

Abstract: The positive manifold—the finding that cognitive ability measures demonstrate positive correlations with one another—has led to models of intelligence that include a general cognitive ability or general intelligence (g). This view has been reinforced using factor analysis and reflective, higher-order latent variable models. However, a new theory of intelligence, Process Overlap Theory (POT), posits that g is not a psychological attribute but an index of cognitive abilities that results from an interconnected network of cognitive processes. These competing theories of intelligence are compared using two different statistical modeling techniques: (a) latent variable modeling and (b) psychometric network analysis. Network models display partial correlations between pairs of observed variables that demonstrate direct relationships among observations. Secondary data analysis was conducted using the Hungarian Wechsler Adult Intelligence Scale Fourth Edition (H-WAIS-IV). The underlying structure of the H-WAIS-IV was first assessed using confirmatory factor analysis assuming a reflective, higher-order model and then reanalyzed using psychometric network analysis. The compatibility (or lack thereof) of these theoretical accounts of intelligence with the data are discussed.

Keywords: intelligence; Process Overlap Theory; psychometric network analysis; latent variable modeling; statistical modeling

Click on image to enlarge.

CHC theory and the Wechsler IQ scales and test development

In 1998 Dr. Dawn Flanagan and I published the Intelligence Test Desk Reference book which was the first thorough treatment of CHC theory (then called Extended Gf-Gc theory). This book is now out-of-print.


We then took the concepts from the ITDR and, together with Dr. Sam Ortiz, presented a cross-battery approach to interpreting the Wechsler batteries.


And again, this book is no longer in print. This also means we no longer receive any $ for sales (conflict of interest disclosure).


The research, theory, and conceptual material in the second book is nearly identical to the first, but it was presented in the context of how to upgrade interpretation and understanding of the Wechsler batteries according to the CHC framework. Since then the same CHC overview material has been tweaked and updated in a series of CHC cross-battery books by Flanagan et al. But, the foundation of CHC theory, and how it can be integrated within a conceptual framework of test development and interpretation, is largely the same in these newer CHC cross-battery books.

Thus, given that these "mother and father" books are no longer in print, I took the liberty of copying the first three chapters of the Wechsler oriented book and am now making them available for my readers (click here). I make this material available to provide psychologists who have not done much reading regarding CHC theory an opportunity to have access to the basic foundation of CHC theory to help them see how it can be applied to the interpretation of an intelligence battery (in this case the Wechslers). By choosing the Wechsler material this also helps understand how the Wechsler batteries are evolving (either implicitly or explicitly--see Keith and Reynolds, 2010) when viewed from the lens of CHC theory.

But, one must recognize that this material is a bit dated. An update of CHC theory was later published in 2005 (click here to access...plus some other chapters), and was again updated this year by Schneider and McGrew (click here).

However, the CHC chapter I provide in this blog post, particularly when placed in the context of the Wechsler batteries, provides a solid foundation for understanding CHC theory and its impact on contemporary intelligence test development and interpretation. My goal is to increase awareness of CHC theory and its relevance to psychological assessment and interpretation. My goal is to spur others to become more current re: this now dominant framework in the field of applied IQ testing.


- Posted using BlogPress from Kevin McGrew's iPad

IQ test battery publication timeline: Atkins MR/ID Flynn Effect cheat sheet

As I've become involved in consulting on Atkins MR/ID death penalty cases, a frequent topic raised is that of norm obsolescence (aka, the Flynn Effect). When talking with others I often have trouble spitting out the exact date of publication of the various revisions of tests, as I keep track of more than just the Wechsler batteries (which are the primary IQ tests in Atkins reports). I often wonder if others question my expertise...but most don't realize that there are more IQ batteries out there than just the Wechsler adult battery....and, in particular, a large number of child normed batteries and other batteries spanning childhood and adulthood. Thus, I decided to put together a cheat sheet for myself..one that I could print and have in my files. I put it together in the form of a simple IQ battery publication timeline. Below is an image of the figure. Double click on it to enlarge.

An important point to understand is that when serious discussions start focusing on the Flynn effect in trial's, most often the test publication date is NOT used in the calculation of how obsolete a set of test norms are. Instead, the best estimate of the year the test was normed/standardized is used, which is not included in this figure (you will need to locate this information). For example, the WAIS-R was published in 1981...but the manual states that the norming occurred from May 1976 to May 1980. Thus, in most Flynn effect discussions in court cases, the date of 1978 (middle of the norming period) is typically used. This makes recall of this information difficult for experts who track all the major individually administered IQ batteries.

Hope this helpful...if nothing else...you must admit that it is pretty :)  Click on image to view





- iPost using BlogPress from my Kevin McGrew's iPad

intelligence intelligence testing Atkins cases ICDP blog psychology school psychology neuropsychology Forensic psychology criminal psychology criminal justice death penalty capital punishment ABA IQ tests IQ scores adaptive behavior AAIDD mental retardation intellectual disability Flynn effect

IQ test selection could be life-or-death decision: WAIS v SB score differences in ID/MR sample

Interesting article "in press" in Intelligence that compares WAIS and Stanford Binet IQ scores (across different editions except the current SB5 and WAIS-IV) for adults with intellectual disability (ID/MR).  Although the mixing together of scores across different editions makes it impossible to make SB/WAIS-specific edition comparisons, the finding that the WAIS scores were, on the average (mean), almost 17 points higher may surprise many psychologists.  The authors discuss the real-life implications (i.e., Atkins ID death penalty decisions; eligibility for SS benefits, etc.) of different scores from different tests.  As outlined in a prior IAP AP101 special report, differences of this magnitude between different IQ tests should not be surprising. 

Silverman, W., Miezejeski, C., Ryan, R., Zigman, W., Krinsky-McHale & Urv, T. (in press).  tanford-Binet and WAIS IQ differences and their implications for adults with intellectual disability (aka mental retardation).  Intelligence.

Abstract

Stanford-Binet and Wechsler Adult Intelligence Scale (WAIS) IQs were compared for a group of 74 adults with intellectual disability (ID). In every case, WAIS Full Scale IQ was higher than the Stanford-Binet Composite IQ, with a mean difference of 16.7 points. These differences did not appear to be due to the lower minimum possible score for the Stanford-Binet. Additional comparisons with other measures suggested that the WAIS might systematically underestimate severity of intellectual impairment. Implications of these findings are discussed regarding determination of disability status, estimating prevalence of ID, assessing dementia and aging-related cognitive declines, and diagnosis of ID in forensic cases involving a possible death penalty.

A concluding comment from the authors

Nevertheless, psychologists cannot meet their ethical obligations in these cases without knowing which test provides the most valid estimate of true intelligence. The present data for individuals with relatively higher IQs, though sparse, indicate that differences between the Stanford-Binet and WAIS IQ tests can no longer be summarily dismissed as merely reflecting the scales' different floors. When test results are informing judgments of literal life and death, any suspected uncertainty regarding the validity of outcomes must be addressed aggressively.

Article Outline

1. Method
2. Results
3. Discussion

• 3.1. Disability determinations
• 3.2. Prevalence of ID
• 3.3. Declines with aging
• 3.4. Death penalty cases
• 3.5. Conclusion

Acknowledgements
References

Technorati Tags: psychology, educational psychology, school psychology, forensic psychology, court decisions, criminal psychology, criminal defense, Atkins cases, MR, ID, mental retardation, intellectual disability, death penalty, capital punishment, IQ, IQ scores, ABA, American Bar Association, ISIR, psychology and law, WAIS, Wechsler batteries, Stanford Binet, SB