Showing posts with label network analysis. Show all posts
Showing posts with label network analysis. Show all posts

Sunday, July 13, 2025

Research Byte: #Measurementinvariance of the #Woodcock-Johnson® V (#WJV) Achievement Battery: An Exploratory Graph Analysis (#EGA) Approach - #schoolpsychology #schoolpsychologists #sld #SPED #achievement

 

Journal of Psychoeducational Assessment

Hyeonjoo Oh and Tong Wu

Abstract

The Woodcock-Johnson V (WJ V) test evaluates general intelligence and cognitive abilities using the Cattell–Horn–Carroll (CHC) theory framework. While measurement invariance is often tested using structural equation modeling (SEM), few studies have applied exploratory graph analysis (EGA), particularly in intelligence assessments. This study addresses that gap by examining configural and metric invariance of the WJ V achievement battery across age, race, and gender using normative data and a novel EGA approach. Results show that the WJ V maintains a consistent structure across diverse groups, supporting its validity in measuring the same constructs. Stability analyses further supported these findings, with test-to-community assignments remaining highly consistent in bootstrapped samples. Minor variation was observed only in the Oral Language Sample, which showed slightly lower but acceptable stability above 0.70.

Conflict of interest disclosure.  I’m the senior non-royalty earning author of the WJ V, which means I’ve already received payment for my services and don’t make a penny on any sales.

Tuesday, December 03, 2024

Research Byte: The structure of adult thinking. A #network approach to #metacognitive processing —#cognition #executivefunction

Click here to access copy of article

Abstract

Complex cognitive processes have been broadly categorized into three general domains: first-order cognition (i.e., thinking directed to solve problems), metacognition (i.e., thinking about one's thinking during problem-solving), and epistemic cognition (i.e., thinking about the epistemic nature of problems and beliefs about criteria for knowledge justification). Few, if any studies, have empirically examined the conditional dependencies between a large inventory of components simultaneously. This paper aims to contribute the first set of preliminary explorations into the interrelationships between different thinking and reasoning components that represent key aspects of emerging adult cognitive processing using a psychological network approach. In two cross-sectional studies (combined N = 1496), data was collected from undergraduate students enrolled at a large public university. Scrutiny of the networks suggests that thinking dispositions and competency with probability are key bridges between metacognitive abilities and epistemic beliefs. Implications for instruction are discussed.

Educational relevance statement

It remains a perennial aim of all education systems to improve the thinking and reasoning of students. But which complex cognitive processes are worthwhile targets, and how do they fit among the plethora of metacognitive, self-regulatory, and epistemological belief aspects of students? The present set of studies is the first to apply a network approach to a broad array of cognitive components to uncover the central student-level variables that can be targeted with instruction. Based on the findings of the two studies presented, instruction aimed at epistemic dispositions could potentially assist in the development of complex cognition because of their centrality to networks of effective reasoning processes.
Click on images to enlarge for easier reading.



Monday, November 04, 2024

A Psychometric Network Analysis of CHC Intelligence Measures: Implications for Research, Theory, and Interpretation of Broad CHC Scores "Beyond g"

(Note.  I’ve made several similar posts with a similar message on several social media outlets over the last 1.5 years)

Yes.  This may be seen as a brag post (I plead the fifth). But, I really want (need?) to share this recent publication (January 2023).  Why? Because, after 40 years of scholarship, I consider this article (which is open access and can be downloaded and read freely) to be one of my 5 top peer-reviewed research publications. The article is part of a special issue (Assessment of Human Intelligence-State of the Art in the 2020s) of the Journal of Intelligence, edited by Alan Kaufman et al. Warning—it is a long article. The article is the result of collaboration with Joel Schneider, Scott Decker and Okan Bulut. 

The content of the article pushes the “edge of the envelop” regarding intelligence theories and testing via the use of exploratory psychometric network analysis (PNA) within the context of network non-g (i.e., psychometric g) models of intelligence. This approach represents an emerging paradigm shift for thinking about intelligence theories and testing. As stated by Savi et al. (2021) "factor analysis models dominated the 20th century of intelligence research, but network models will dominate the 21st."  I believe Savi et al. are more-or-less correct. I believe PNA and non-g network models can move intelligence theories and testing forward—as they have become stagnant via the repeated use of "common cause" descriptive and taxonomic-generating factor analysis methods.  Used in isolation, factor analysis-based intelligence test and theory models constrain school psychologists and other assessment professionals from moving forward (as described in the paper).  For far too long, especially in school psychology, we have been "stuck on g" factor analysis based models of test interpretation.

As stated in our article, "newer non-g emergent property theories of intelligence might lead to better intervention research for individuals who have been marginalized by society. Holden and Hart (2021) suggest that network-based non-g theories, particularly those that feature Gwm-AC mechanisms [the working memory-attentional control complex] (process overlap theory in particular) may hold promise as a vehicle for improving, and not harming, social justice and equity practices and valued outcomes for individuals in marginalized groups" (McGrew et al., 2023).  Read the original Holden and Hart article if you are interested in the social justice implications of a new way of thinking about intelligence grounded in modern network non-g conceptualizations of intelligence.


Even if the methodological material is not your cup of tea, much of the McGrew et al. (2023) introduction is relevant to assessment practitioners. Also, several sections in the discussion deal with practical implications for understanding new insights into intelligence theories, broad cluster test interpretation in general, and some strengths and weaknesses of the WJ IV CHC test and cluster scores. 


If you are not familiar with the Journal of Intelligence (JOI), I would suggest SPs take a look. It is not the Intelligence journal from ISIR. It is the "new kid on the block" and has quickly become a prestigious open access publication outlet with a top notch editorial board. Since it is open access, all articles can be downloaded, read, and shared freely—an awesome free source of emerging thinking in the field of intelligence. JOI is publishing interesting articles from a wide variety of perspectives by a diversity of scholars interested in intelligence, cognition, and related topics. It has become one of my favorite journals the past few years. 


Finally, exploratory hierarchical psychometric network analysis methods (along with traditional structural analysis methods) were applied to the WJ V norm data—these results will be in the WJ V Technical Manual (LaForte, Dailey, McGrew, 2025).


 My WJ IV conflict of interest (COI) is included in the linked PDF article.  My WJ V COI and additional COI information can be found at the MindHub web portal.


Friday, December 06, 2019

Psychometric Network Analysis of the Hungarian WAIS


Christopher J. Schmank, Sara Anne Goring, Kristof Kovacs and Andrew R. A. Conway

Received: 1 June 2019; Accepted: 24 August 2019; Published: 9 September 2019

Abstract: The positive manifold—the finding that cognitive ability measures demonstrate positive correlations with one another—has led to models of intelligence that include a general cognitive ability or general intelligence (g). This view has been reinforced using factor analysis and reflective, higher-order latent variable models. However, a new theory of intelligence, Process Overlap Theory (POT), posits that g is not a psychological attribute but an index of cognitive abilities that results from an interconnected network of cognitive processes. These competing theories of intelligence are compared using two different statistical modeling techniques: (a) latent variable modeling and (b) psychometric network analysis. Network models display partial correlations between pairs of observed variables that demonstrate direct relationships among observations. Secondary data analysis was conducted using the Hungarian Wechsler Adult Intelligence Scale Fourth Edition (H-WAIS-IV). The underlying structure of the H-WAIS-IV was first assessed using confirmatory factor analysis assuming a reflective, higher-order model and then reanalyzed using psychometric network analysis. The compatibility (or lack thereof) of these theoretical accounts of intelligence with the data are discussed.

Keywords: intelligence; Process Overlap Theory; psychometric network analysis; latent variable modeling; statistical modeling

Click on image to enlarge.