Showing posts with label ID. Show all posts
Showing posts with label ID. Show all posts

Monday, July 27, 2026

Combining multiple intelligence test scores (IQs) into a grand psychometrically sound estimate. Joel Schneider’s free on-line web app.

In an earlier post in March, I alerted readers to a new journal publication that presented a psychometrically sound rational and method for combining multiple intelligence test scores into a single grand estimate.  Below is the formal APA reference:  Go to link above for more info.

Schneider, W. J., Reynolds, C. R., McGrew, K. S., & Salekin, K. L. (2026). Life-and-death psychometrics: Generalizable best methods for combining scores in intellectual disability and other diagnostic assessments. Journal of Pediatric Neuropsychology, 12(2), 47–65.

I’m pleased to report that Dr. Joel Schneider has developed a free on-line web app that allows users to implement the recommended method.  Thanks to Joel.


Click on image to enlarge for easy reading



Thursday, May 21, 2026

Breaking legal and research news: SCOTUS (US Supreme Court) decision re multiple IQ scores in intellectual disability (ID) death penalty case (Hamm v Smith) - A DIG decision upholding the lower court decision

Today SCOTUS ruled on the Hamm v Smith multiple IQ score Atkins intellectual disability (ID) case that was argued before SCOTUS last December. This important decision, with all concurring and dissenting opinions, is available here.  Interested parties should read all the opinions. 

All documents and the history of the case can be found in a prior IQs Corner post.  As noted in the prior lengthy post, APA submitted an Amicus brief that, based on the reading of some of the justices opinions, suggests it (together with a AAIDD Amicus Brief) played an important role in the decision.




Briefly, when SCOTUS dismisses the writ of certiorari as improvidently granted it means the justices recognized that they made a mistake in agreeing to hear the case and decided to dismiss it without issuing a ruling on the merits. In legal shorthand, this is often referred to as a "DIG" (Dismissed as Improvidently Granted). This typically happens after the Court has accepted the case, reviewed the briefs, and sometimes even heard oral arguments. 

In practice, this means that the lower court decision—which is consistent with APA’s Amicus brief—that argued that multiple IQ scores should be viewed holistically  augmented by clinical judgement—stands. This means Mr. Smith will not be executed and, more importantly, the ruling does not upset the status of prior Atkins case law.  Given the recent direction and flavor of SCOTUS, there was a fear that SCOTUS might render a formal decision that would set back prior SCOTUS Atkins ID decisions.  So, this is a win for maintaining the principles of clinical judgement, the opinions and standards established by the established medical communities (both APA’s, AAIDD), and the need for a holistic approach to the interpretation of multiple IQ scores together with adaptive behavior.

A reading of the concurring opinions indicates that APA’s brief, as well as several key APA and AAIDD ID-related publications referenced in their decisions, were influential in the decision.  Several of the dissenting opinions reveal some troubling thinking by several justices. 
As a potential conflict of interest (COI) notice, I (Dr. Kevin McGrew), together with Dr. Joel Schneider and Dr. Cecil Reynolds (as noted on page three the APA amicus brief), were consultants to APA in the drafting of that brief.
It should be noted that as a result of the work of APA Amicus brief working committee, a peer-reviewed paper outlining a psychometrically sound approach (developed by Dr. Joel Schneider) for integrating multiple IQ scores was started during the deliberations and was recently published (Schneider, Reynolds, McGrew & Salekin, 2026) after the oral argument's.  This issue will likely to be revisited in future state cases, with Schneider et al. (2026) now elevated to a scientifically sound multiple IQ composite score method.

Thursday, May 07, 2026

AI Brief: Is the Intellectual Functioning Component of AAIDD’s 12th Manual Satisficing?

AI Brief:  Is the Intellectual Functioning Component of AAIDD's 12th Manual Satisficing?

 (McGrew, 2021)




 

Dr. Kevin McGrew with assist from Google NotebookLM

 

In a commentary published in Intellectual and Developmental Disabilities, Kevin S. McGrew  evaluated the intellectual functioning section (prong 1) of the AAIDD’s 12th edition manual (2021) for diagnosing intellectual disabilities (ID). He commends the organization for finally adopting the Cattell-Horn-Carroll (CHC) theory, which aligns the manual with modern scientific consensus on cognitive abilities. However, the author expresses significant concern about the manual’s contradictory guidance on part scores, arguing that its ambiguous stance could lead to legal and diagnostic confusion. McGrew also highlights various technical measurement issues and numerous copyediting errors that he believes undermine the manual's status as an authoritative resource. He suggests that while the manual is satisfactory in its theoretical shift, it does not provide the precise clarity needed for high-stakes clinical and judicial settings.

 

_______________________

 

In his review of the 12th edition of the American Association on Intellectual and Developmental Disabilities (AAIDD) manual, McGrew (2021; link for downloading article) evaluates whether the "Intellectual Functioning Component" (aka.,prong 1 of a three-prong definition of intellectual disability—ID) provides a "satisficing"—or satisfactory and sufficient—solution for practitioners and scholars.[1] McGrew draws on over 45 years of experience in school psychology and intelligence research, theory, and test development. In addition, he draws on his expert work and consultation (since 2009) on Atkins intellectual disability (ID) death penalty cases in legal settings. McGrew provides an evaluation of the AAIDD’s manual's prong 1 (intellectual functioning) theoretical grounding, technical guidance, and professional polish. He does not evaluate the other two ID prongs (adaptive behavior and age of onset).


Advancement in Intelligence Theory

McGrew awards the manual a Grade B+ for its formal adoption of the Cattell-Horn-Carroll (CHC) theory of intelligence. This shift aligns the AAIDD manual with the contemporary consensus taxonomy of cognitive abilities, moving away from outdated models. However, McGrew notes that the manual "muddies the CHC waters" by giving preferential treatment to fluid (Gf) and crystallized (Gc) intelligence while neglecting other broad CHC abilities like learning efficiency (Gl), working memory (Gwm), retrieval fluency (Gr), auditory processing (Ga), visual-spatial processing (Gv), and processing speed (Gs). He suggests that a visual-graphic model of the CHC hierarchical model would have been a beneficial addition for users.


Measurement and Organizational Challenges

The manual receives a Grade B- for its treatment of major measurement issues. While it provides adequate coverage of such measurement issues as the standard error of measurement (SEM), confidence intervals, and the Flynn effect (aka., norm obsolescence), McGrew criticizes the lack of a topic index, which makes finding specific guidance very frustrating. For instance, practice effects are obscurely placed under "progressive error" in the glossary, and the Flynn effect is curiously categorized under "Making a Retrospective Diagnosis," despite being relevant to historical and current intellectual assessments.


The Part-Score Controversy

The most critical evaluation—a Grade C—is reserved for the manual's handling of part scores. McGrew identifies three primary failures in this area:

 

●      Inconsistency: The manual contradicts itself by advising against the use of part scores as proxies for general intelligence (psychometric g) while simultaneously suggesting that their valid use requires 3–6 subtests of Gf and Gc.


●      Variance with Other Authorities: This "just say no to part scores" stance conflicts with other major authoritative sources, such as the DSM-5, which acknowledges that highly discrepant subtest scores may invalidate an overall IQ score.


●      Scientific and Legal Tensions: McGrew argues that the manual fails to address the "General-2-individual" (G2i) legal principle which acknowledges that group-based scientific research (e.g., suggesting full-scale scores are always superior) may not apply to every unique individual case—the G2i principle conundrum is that scientists generalize; but courts must particularize to an individual. He warns that without clearer guidance; legal entities may fill the void with "remedies of dubious quality.”


Editorial Quality and Professionalism

McGrew gives the manual a Grade D for style and substance, citing at least 20 copyedit errors in the sections relevant to the intellectual functioning prong alone. These include misspellings of prominent researchers, incorrect terminology like "test e-norms," and frequent "misplaced italics.” He contends that such preventable errors tarnish the manual’s status as an "authoritative" and "definitive" source for diagnosing intellectual disabilities.


Conclusion

McGrew concludes that while the endorsement of CHC theory is a significant positive revision, the manual’s obfuscation regarding part scores and its numerous editorial flaws represent major missed opportunities. He emphasizes that practitioners cannot wait another decade for the next edition to offer more robust guidance, particularly in high-stakes legal and diagnostic settings. He concludes that while he may be a "tough grader," his critiques are intended to push AAIDD toward more robust and clearer guidance in future editions or supplements


[1] Nobel laureate Herb Simon advanced the behavioral economics concept of satisficing (Simon, 1956)—the idea that, although we may aspire to optimal solutions, real-world constraints often require us to settle on what is both satisfactory and sufficient (hence, the portmanteau term satisficing).


Sunday, November 24, 2024

#AAIDD's #IQ Part-Score Position (with reference to diagnosing #intellectual #disabiity [#ID]) Is at Variance With Other Authoritative Sources—Important for #schoolpsychologists



In a 2021 commentary regarding the most recent official AAIDD intellectual disability definition and classification manual (2021), I raised a concern regarding AAIDD’s position that only a full scale or global IQ score can be used for a Dx of ID.  No room was left for clinical judgement for n=1 unique cases.  Click here to download and read the complete article.  Below is some select text.

“AAIDD's [IQ] Part-Score Position Is at Variance With Other Authoritative Sources”

In AAIDD’s The Death Penalty and Intellectual Disability (Polloway, 2015), both McGrew (2015) and Watson (2015) suggest that [IQ] part scores can be used in special cases. (Note that these two chapters, although published in an AAIDD book, do not necessarily represent the official position of AAIDD.) The limited use of part scores is also described in the 2002 National Research Council book on ID and social security eligibility (see McGrew, 2015; Watson, 2015). The authoritative Diagnostic and Statistical Manual of Mental Disorder—Fifth Edition (DSM-5) manual implies that part scores may be necessary when it states that ‘‘highly discrepant subtest scores may make an overall IQ score invalid'' (American Psychiatric Association, 2013, p. 37). Finally, in the recent APA Handbook of Intellectual and Developmental Disabilities (Glidden, 2021), Floyd et al. (2021) state ‘‘in rare situations in which the repercussions of a false negative diagnostic decision would have undue or irreparable negative impact upon the client, a highly g-loaded part score (see McGrew, 2015a) might be selected to represent intellectual functioning'' (emphasis added; p. 412).

“ In a unique n = 1 high-stakes setting, a psychologist may be ethically obligated to proffer an expert opinion whether the full-scale score is (or is not) the best indicator of general intelligence. There must be room for the judicious use of clinical judgment-based part scores. AAIDD's purple manual complicates rather than elucidates guidance for psychologists and the courts. In high-stakes settings, a psychologist may be hard pressed to explain that their proffered expert opinions are grounded in the AAIDD purple manual, but then explain why they disagree with the ‘‘just say no to part scores'' AAIDD position.”

Tuesday, September 08, 2020

CA legislature passes law banning use of demographically-adjusted ("Heaten") norms for IQ tests to identify intellectual disability (ID)

The California Legislature has changed the definition of ID  to be less racially biased.  In particular, it now bans the use of  demographically adjusted or "Heaton" norms.    See story here...where a link is provided to download the PDF.

Saturday, July 26, 2014

More on Greenspan's model of personal competence: Relationship between IQ and social, practical, and conceptual abilities

I am pleased to see that, after a relatively long draught in published research, someone is again investigating the relations between general intelligence, and the primary domains of adaptive behavior, in models (that when examined closely) that are investigating aspects of Greenspan's' model of personal competence. The title, abstract, and key figure from this new research follow. The article can be read here. Kudos to these researchers

Click on images to enlarge





My primary criticism of this study is that it completely ignores the primary foundation research in this area that occurred between 1990 and 2000, some of which are the primary research studies cited in the AAIDD manuals to support the domains of practical, conceptual and social competence (Greenspan's model). I have provided a list of that research, and results from the most prominent article from that group of researchers, below.












Yes, my name is all over these MIA studies (in the current featured article) so some could see my comments as academic sour grapes for being overlooked. But I see their omission as a lack of scholarly rigor by the researchers and the journal who published the current article. All of the MIA studies can be found at the MindHub--scroll down until you see the list of studies shown above. Then click away and download and read. It would have been nice if the new study results would have been integrated with the extant personal competence research literature.

In the final analysis I am pleased that someone is conducting much needed research on these constructs given the pivotal role they play in the definition and assessment of MR/ID.


- Posted using BlogPress from my iPad

Friday, August 24, 2012

IQ Score Interpretations in Atkins MR/ID Death Penalty Cases: The Good, Bad and the Ugly

I just uploaded the following PPT presentation to my SlideShare account---IQ Score Interpretation in Atkins MR/ID Death Penalty Cases: The Good, Bad and the Ugly. It was presented this month (Sept, 2012) at the Habeas Assistance Training Seminar. Click here to view.




Posted using BlogPress from Kevin McGrew's iPad
www.themindhub.com

Wednesday, July 11, 2012

AP101 Brief #14: Inappropriate use of demographically-adjusted (Heaton) norms in MR/ID Dx

The following AP 101 brief was just posted at the ICDP blog.




Applied Psychometrics 101 Brief # 14:  Demographically adjusted neuropsychological (Heaton) norm-based scores are inappropriate for the diagnosis of MR/ID

Kevin S. McGrew, PhD.
Director

Dale G. Watson, PhD.
Berkeley, CA