Showing posts with label Woodcock. Show all posts
Showing posts with label Woodcock. Show all posts

Friday, January 24, 2025

Thanks. The #CAI Richard W. Woodcock Award for Innovations in #Abilitytesting, #Research, and #Scholarship - #schoolpsychology #WJV #cognitive #intelligence #psychometrics

 Warning…a bit of self-promotion.  

I want to thank the CAI group for this awesome professional recognition.  This particular award has considerable meaning for me given that Dr. Woodcock was my friend, colleague and mentor for 40+ years.  He has been the most influential mentor in my career.  He saw something in me when I was a masters degree school psychologist practicing in the trenches.  I was able to learn from him in a mentor-apprentice model.  After I had learned much about the art+science Woodcock approach to applied psychological test development, I was motivated to return to school to earn my doctorate degree—to get the formal “book” learning behind much of what he had taught me, and more. 

Also, congratulations to my friend Dr. Nancy Mather who worked side-by-side with myself and Dr. Woodcock approximately 40 years on the revisions of the WJ-R through WJ V. Oh—the stories Nancy and I could tell.







Wednesday, November 11, 2009

MDS analysis of the WJ III: Implications for CHC theory refinement and extension




IAP AP101 # 3 report is now available (click here for all AP101 reports and briefs).  "IAP AP101 Report #3: MDS Analysis of the CHC-based WJ III Battery: Implications for possible refinements and extensions of the CHC model of human intelligence" can be viewed  or downloaded by clicking here.

The PPT files are also viewable and downloadable via SlideShare.

Abstract
The WJ III Battery is comprised of both cognitive (intelligence) and achievement components.  As reported in the technical manual, the Cattell-Horn-Carroll (CHC) theory of cognitive abilities organizational structure of the WJ III has been validated.  The current investigation analyzed the cognitive and achievement tests for all WJ III norm subjects from ages 6-18 years of age.  Multidimensional scaling (MDS—Guttman Radex model) of the 50 WJ III tests suggested new facets from which to interpret the WJ III.  The results suggested three to four higher-order intermediate CHC model stratum abilities that varied along the dimensions of (a) controlled vs automatic cognitive processing and (b) product- vs process-dominant abilities. The results, together with recent similar analysis of the WAIS-IV, support Woodcock’s Cognitive Performance Model (CPM).  Implications for possible minor changes in the CPM model are suggested.  More importantly, the WJ III and WAIS-IV results collectively suggest hypothesized refinements and extensions of the CHC intelligence framework.   Research focused on exploring the compatibility of a combined CHC and Berlin Model of Intelligence Structure (BIS) theory is recommended.
Technorati Tags: , , , , , , , , , , , , , , , , , , ,


Thursday, July 16, 2009

Cattell-Horn-Cattell (CHC) Intelligence Theory Timeline Project

I've been busy taking information from my Cattell-Horn-Carroll CHC (Gf-Gc) Theory:  Past, Present & Future book chapter (in Flanagan & Harrison, 2005 CIA book) and putting it together in a piece of professional timeline software (Timeline Maker).  The software is "way cool" as it allows me to embed hyperlinks to files, images, web pages, etc.  Then, I can use the software, when making presentations, and bring events in one-at-a-time.  AND, at each event there are icons that serve as menus to files, images, etc. that I can "bring up" for viewing and discussion.  I've been embedding the timeline with all kinds of historical images, original classic articles (e.g., Spearman, Thurstone, Cattell, etc.) as well as more recent CHC-related articles.  The idea is for a timeline-based working and breathing educational tool....a timeline-based book chapter if you please.

At this point in time the software allows me to output a web page....but the icon-based hyperlinks don't work (darn).  There is a possible "work around" I'm exploring (which would require a person to download a huge zip file and use the free Timeline Maker Preview program), which would allow people to have all the material on their HD for viewing--but I'm not ready to make that available just yet.

So....for now....you can view the completed Evolution of CHC Intelligence Theory and Assessment web page (sorry..it only is viewable when using Internet Explorer.  I use Mozilla as my browsser and it won't view.....%%$$#$$##).  You will see the various icons that are not active.

Also, I've exported the timeline and put it together with the "notes" from each event...a combined web image/table document.  This is a PDF file that can be downloaded by clicking here.  I added a small number of the embedded images that are available from the working clickable version to the end of the document....just the basics.

Feedback would be appreciated.  The long-term goal is to find a way to make this accessible on-line to others (free) for education and training purposes.  My intent is to add new material and update it on a regular basis.

Stay tuned to this blog for updates...or, subscribe to the CHC listserv for upates re: the projet.

EnjoyTechnorati Tags: , , , , , , , , , , , , , , , , , ,

Wednesday, July 08, 2009

Applied Psych Test Design Part G: Psychometric/technical statistical analysis: External

The seventh  in the series Art and Science of Applied Test Development is now available.

The seventh module (Part G:  Psychometric/technical statistical analysis:  External) is now posted and is accessible via SlideShare.

In addition, I've made some new edits and additions  to prior presentations (Part A-F)....so if you've viewed the prior modules you may want to revisit them again.

This is the seventh in a series of PPT modules explicating the development of psychological tests in the domain of cognitive ability using contemporary methods (e.g., theory-driven test specification; IRT-Rasch scaling; etc.). The presentations are intended to be conceptual and not statistical in nature. Feedback is appreciated.

This project can be tracked on the left-side pane of the blog under the heading of Applied Test Development Test Development Series.

The first module (Part A: Planning, development frameworks & domain/test specification blueprints) was posted previously and is accessible via SlideShare.

The second module (Part B: Test and item development) was posted previously and is accessible via SlideShare.

The third module (Part C--Use of Rasch scaling technology) was posted previously and is accessible via Slideshare.

The fourth module (Part D--Develop norm [standardization] plan) was posted previously and is accessible via Slideshare.

The fifth module (Part E--Calcuate norms and derived scores) was posted previously and is accessible via Slideshare.

The sixth module (Part F--Psychometric/technical statistical analysis: Internal) was posted previously and is accessible via Slideshare.

You are STRONGLY encouraged to view them in order as concepts, graphic representation of concepts and ideas, etc., build on each other from start to finish.

That's it for now.  I will likely be revising and adding more material in the future---but this is the "basic" set of materials for now.

Technorati Tags: , , , , , , , , , , , , , , , , ,



Tuesday, July 07, 2009

Applied Psych Test Development Series: Parts F--Psychometric/technical statistical analysis: Internal

The sixth in the series Art and Science of Applied Test Development is now available.

The sixth module (Part F--Psychometric/technical statistical analysis:  Internal) is now available.

In addition, I've made some edits and additions (esp. summary "Tools, Tips, and Troubles" and "Advanced Topics" slides) to prior presentations (Part A-E).

This is the sixth in a series of PPT modules explicating the development of psychological tests in the domain of cognitive ability using contemporary methods (e.g., theory-driven test specification; IRT-Rasch scaling; etc.). The presentations are intended to be conceptual and not statistical in nature. Feedback is appreciated.

This project can be tracked on the left-side pane of the blog under the heading of Applied Test Development Test Development Series.

The first module (Part A: Planning, development frameworks & domain/test specification blueprints) was posted previously and is accessible via SlideShare.

The second module (Part B: Test and item development) was posted previously and is accessible via SlideShare.

The third module (Part C--Use of Rasch scaling technology) was posted previously and is accessible via Slideshare.

The fourth module (Part D--Develop norm [standardization] plan) was posted previously and is accessible via Slideshare.

The fifth module (Part E--Calcuate norms and derived scores) was posted previously and is accessible via Slideshare.

You are STRONGLY encouraged to view them in order as concepts, graphic representation of concepts and ideas, etc., build on each other from start to finish.

Enjoy...more to come.

Technorati Tags: , , , , , , , , , , , , , , , , ,



WJ III CHC cluster g an specificity characteristics: Floyd et al. (2009) published

The following article, which was previously previewed in an earlier post, has now been published. Check the prior post for links to supplementary tables mentioned in the article. [Conflict of interest disclosure - I am a co-author of the WJ III, which was the focus of this publication]
  • Floyd, R., McGrew, K., Barry, A., Rafael, F & Rogers, J. (2009) General and Specific Effects on Cattell–Horn–Carroll Broad Ability Composites: Analysis of the Woodcock–Johnson III Normative Update CHC Factor Clusters Across Development. School Psychology Review, 38(2), 249-265
Abstract
Many school psychologists focus their interpretation on composite scores from intelligence test batteries designed to measure the broad abilities from the Cattell-Hom-Carroll theory. The purpose of this study was to investigate the general factor loadings and specificity of the broad ability composite scores from one such intelligence test battery, the Woodcock-Johnson Hm Tests of Cognitive Abilities Normative Update (Woodcock, McGrew, Schrank, & Mather, 2007). Results from samples beginning at age 4 and continuing through age 60 indicate that Comprehension-Knowledge, Long-Term Retrieval, and Fluid Reasoning appear to be primarily measures of the general factor at many ages. In contrast, Visual-Spatial Thinking, Auditory Processing, and Processing Speed appear to be primarily measures of specific abilities at most ages. We offer suggestions for considering both the general factor and specific abilities when interpreting Cattell- Horn-Carroll broad ability composite scores.
Technorati Tags: , , , , , , , , , , ,

Wednesday, July 01, 2009

Differentiation of cognitive abilites across the lifespan: WJ III norm analysis "in press"

The following manuscript, which analyzed the WJ III norm data [conflict of interest--I'm a coauthor of the WJ III), has been accepted for publication in the journal Developmental Psychology

Differentiation of Cognitive Abilities across the Lifespan. Elliot M. Tucker-Drob, Department of Psychology University of Virginia Charlottesville, V.A.

Abstract
Existing representations of cognitive ability structure are exclusively based on linear patterns of interrelations. However, a number of developmental and cognitive theories predict that abilities are differentially related across ages (age differentiation-dedifferentiation) and across levels of functioning (ability differentiation). Nonlinear factor analytic models were applied to multivariate cognitive ability data from 6,273 individuals, ages 4 to 101 years, who were selected to be nationally representative of the United States population. Results consistently supported ability differentiation, but were less clear with respect to age differentiation-dedifferentiation. Little evidence for age modification of ability differentiation was found. These findings are particularly informative about the nature of individual differences in cognition, and the developmental course of cognitive ability level and structure.

Author Summary
In summary, nonlinear factor analytic models were applied to carefully scaled data on seven well-established cognitive abilities measured in a large nationally representative lifespan sample of individuals. Consistent with the ability differentiation hypothesis, results indicated that a general factor accounted for a decreasing amount of (and proportion of) individual differences in the abilities at higher ability levels, suggesting that at higher ability levels more specific cognitive mechanisms may be less constrained and more prominently expressed. However, results were inconsistent with the age differentiation-dedifferentiation hypotheses that the magnitudes of ability relations decrease with childhood age and increase with adult age. There was rather some evidence to suggest that abilities become more related with childhood age, and less related with adult age. It is proposed that future examinations of age differentiation dedifferentiation focus on the multivariate relations among individual differences in rates of longitudinal changes.

Technorati Tags: , , , , , , , , ,

Applied Psych Test Development Series: Parts C/D--Develop norm plan and calculating norms

The fourth and fifth in the series Art and Science of Applied Test Development is now available.

The fourth module (Part D--Develop norm [standardization] plan) is now available.

The fifth module (Part E--Calcuate norms and derived scores) is also now available.


These are the fourth and fifth in a series of PPT modules explicating the development of psychological tests in the domain of cognitive ability using contemporary methods (e.g., theory-driven test specification; IRT-Rasch scaling; etc.). The presentations are intended to be conceptual and not statistical in nature. Feedback is appreciated.

This project can be tracked on the left-side pane of the blog under the heading of Applied Test Development Test Development Series.

The first module (Part A: Planning, development frameworks & domain/test specification blueprints) was posted previously and is accessible via SlideShare.

The second module (Part B: Test and item development) was posted previously and is accessible via SlideShare.

The third module (Part C--Use of Rasch scaling technology) was posted previously and is accessible via Slideshare.

You are STRONGLY encouraged to view them in order as concepts, graphic representation of concepts and ideas, build on each other from start to finish.

Enjoy...more to come.

Technorati Tags: , , , , , , , , , , , , , , , , ,

Monday, June 29, 2009

Applied Psych Test Development Series: Part C--Use of Rasch scaling technology

The third in the series Art and Science of Applied Test Development is now available. The third module (Part C: Test and Item Development--Use of Rasch Scaling Technology) is now available.

This is the third in a series of PPT modules explicating the development of psychological tests in the domain of cognitive ability using contemporary methods (e.g., theory-driven test specification; IRT-Rasch scaling; etc.). The presentations are intended to be conceptual and not statistical in nature. Feedback is appreciated.

This project can be tracked on the left-side pane of the blog under the heading of Applied Test Development Test Development Series.

The first module (Part A: Planning, development frameworks & domain/test specification blueprints) was posted previously and is accessible via SlideShare.

The second module (Part B: Test and item development) was posted previously and is accessible via SlideShare.

You are STRONGLY encouraged to view them in order as concepts, graphic representation of concepts and ideas, build on each other from start to finish.

Enjoy...more to come.

Technorati Tags: , , , , , , , , , , , , , , , ,

Wednesday, June 17, 2009

WMF Press: Dean-Woodcock Neuropsych Report Software


The Woodcock-Munoz Foundation (WMF) Press has just made its first publication--- a piece of neuropsychological assessment report software.

The Dean-Woodcock Neuropsychological Report is a scoring and interpretive program that assists qualified evaluators and service providers in creating neuropsychological reports based on test results from the Dean-Woodcock™ Neuropsychological Battery™, the Woodcock-Johnson® III, and the Batería III NU Woodcock-Muñoz®. Click here to be taken to the page, which also lists requirements necessary to download the software for free.

[Conflict of interest - I'm the Research Director for WMF and am also a coauthor of the Woodcock-Johnson III.

Technorati Tags: , , , , , , , , , , , , , , ,

Wednesday, June 10, 2009

Art and science of test development: ETS Kit

I'm in the process of developing a four-hour course presentation on the "Art and Science of Test Development:  Theories, tools, tips and troubles" that I will unveil late July at a Brazil psychological assessment conference.  I'm very excited about putting this together.  There are many books on different aspects of test development and psychometrics, but nothing that is really "applied" test development or psychometrics.  I'm excited, but also am finding it a challenge to do within a four-hour time constraint.  When done, it may serve as the outline for a manuscript and PPT slides that may be available via the WMF.  Much of it is based on Dr. Woodock's approach to test development and he has graciously provided me access to many of his notes and documents.  If we do ever get this to a manuscript, he would likely be the first author.

I may make intermediate PPT modules available for review via Slideshare as they emerge...in hopes of eliciting feedback, comments, etc.

In the process of working on this presentation I refer to the ETS Kit of Factor-Referenced Cognitive Tests (1976 Edition) as a source I often review when trying to understand some old measures mentioned in studies and, more importantly, for ideas for possible new tests of narrow CHC abilities. The publication is a steal for the price....but you must be aware that the copies of the tests you will receive are very crude black-white copies of prototypes, often with free-hand drawings. 

It is a classic....and one that I think most instructors of cognitive/intellectual testing courses might consider purchasing for their library...as a teaching aid.  The tests use the CHC code system that is currently being using today in discussions of CHC abilities.  Thus, the tests, although not of high quality, might be good as illustrations of how to measure 23 different narrow CHC abilities.

Technorati Tags: , , , , , , , , ,

Tuesday, November 04, 2008

Woodcock-Munoz Foundation (WMF) Update

The Woodcock-Munoz Foundation (WMF) is pleased to announce a significant revision of its website. A number of new projects are listed under the various programs (e.g., Dissertation Abstracts Project; direct link to Human Cognitive Abilities project; to name but a few). Under the Instructional Materials Grants program you can view assessment course syllabi from universities that have been awarded instructional materials grants. And, stay tuned for future publications and materials from WMF Press.

Kudos to Beth Stanford for making this all possible.

Briefly, the mission of the "The Woodcock-Muñoz Foundation (WMF) is a private, non-profit operating foundation that supports the advancement of contemporary cognitive assessment. The WMF engages in programs of instructional support to professional preparation programs, research concerning the abilities of individuals with diagnosed exceptionalities, and closely-related educational and research projects."

Conflict of interest note - I, Kevin McGrew, am the WMF Research Director

Tuesday, July 15, 2008

Dr. Richard Woodcock Neuropsych Keynote slide show: Evolution of Cognitive Assessments

A copy of Dr. Richard Woodcock's Keynote address (The Evolution of Cognitive Assessments) at the Third National School Psychology Neuropsychology conference (Dallas, July 10, 2008) is now available for viewing as an on-line PPT show (that can also be downloaded). Click here to go to my SlideShare site where this is now available. The slides do not contain everything Dr. Woodcock presented as certain copy-protected information was removed prior to posting. Also, his personal comments/stories about the serendipitous events that brought him to the field of psychoeducational test development are not included in the slides.


Thursday, June 05, 2008

WJ III discrepancy base rate information

Recently a question was asked on the NASP listserv on how to find "base rate" information regarding WJ III discrepancy scores. Barb Wendling, a colleague and friend, posted a very thorough response+. I decided to make her well-written explanation below...so it can be readily available for future reference. Kudos to Barb [Conflict of interest statement- I'm a coauthor of the WJ III].

Discrepancy Norms

  • The conorming of the WJ III ACH and the WJ III COG made it possible to compute discrepancy scores for each individual in the norming sample and then to prepare discrepancy norms using that information. For both the variation and discrepancy procedures, "ACTUAL" discrepancy norms in contrast to "PSEUDO" discrepancy norms are used to determine the significance and frequency of any variations or discrepancies (see report at following link for additional explanation:). These discrepancy norms offer several advantages to practitioners. First, both the cognitive and achievement batteries were normed on the same large, nationally representative sample, eliminating errors from unknown differences that exist when using tests based on different norm samples. Second, the correlation coefficients are known between ability and achievement at all ages so it is not necessary to estimate and make a correction for the amount of regression based on a few correlations and a limited sample. Third, practitioners can evaluate the significance of a discrepancy by using either the percentile rank of the discrepancy (Discrepancy PR) or the difference between the achievement score and the predicted achievement score in standard error of estimate units (Discrepancy SD).
  • Discrepancy percentile rank. This score defines the percent of the population that has a particular size discrepancy between the actual and predicted scores. The Discrepancy PR is a norm-based estimate of the BASE RATE of a particular discrepancy in the population. Unlike base rates offered by other tests which are typically based on cross-sectional data, the WJ III provides more precision by reporting the information by subgroups (same age or grade) within the norm sample.
  • Discrepancy standard deviation. This score reflects the distance that the examinee’s score is above or below the average score for age or grade mates. The Discrepancy SD allows the criterion of significance to be defined in terms of the standard error of the estimate. Commonly, a Discrepancy SD of +/-1.5 or greater is selected as being significant. A discrepancy of this magnitude would occur approximately 6 out of 100 times. Practitioners may, however, select a different level of significance ranging from +/- 1.0 to +/-2.3 when using the various WJ III software scoring programs.

Thursday, January 03, 2008

WJ III NU (Normative Update) Assessment Service Bulletin #9 available



I'm pleased to announce that the Woodcock-Johnson III Assessment Service Bulletin 9: Woodcock-Johnson III®/Woodcock-Johnson III Normative Update Score Differences: What the User Can Expect and Why (click here to view/download) is now available. I want to thank all users for their patience during the delay in this publication. Below is the introduction to the document.

I want to thank Riverside Publishing for allowing me to post this publication today. In a few weeks it will be available for their web page. At that time I'll make a new post with the official link to the publication then being their web page.

[Conflict of interest disclosure - I'm a coauthor of the WJ III]

  • The Woodcock-Johnson III Normative Update (WJ III® NU) (Woodcock, McGrew, Schrank, & Mather, 2001, 2007) is a recalculation of the normative data for the Woodcock-Johnson III (WJ III) (Woodcock, McGrew, & Mather, 2001), based on the final 2000 U.S. census statistics (U.S. Census Bureau, 2005). The final 2000 census data are reflected in the norms provided by the WJ III Normative Update Compuscore® and Profiles Program (Compuscore) (Schrank & Woodcock, 2007) and in the documentation provided in the WJ III Normative Update Technical Manual (McGrew, Schrank, & Woodcock, 2007). The WJ III NU norms replace the original WJ III norms, which were based on the U.S. Census Bureau’s 2000 census projections issued in 1996 (Day, 1996).
  • The U.S. Census Bureau’s Population Projections Program issues projections of the United States resident population based on assumptions about future births, deaths, and international migration. Census projections are estimates of the population for future dates and are subsequently replaced by census statistics. The 2000 census statistics produced a somewhat different description of the U.S. population than was assumed from the last projections issued in 1996. For example, according to the bureau’s Greg Spencer, “When we took the 2000 census, we found about 6.8 million more people than we were expecting. When we went in and looked at the sources of that growth, we found that during the late 1990s, there was more migration than we had been measuring” (Landphair, 2004, p. 1). Other unanticipated changes in the population were documented (U.S. Census Bureau, 2005), including shifts in age, sex, race, Hispanic origin, and residence. Some states grew at three times the national rate, and people tended to cluster in locations where jobs were available and climate was preferred. For users of the WJ III, the normative update (WJ III NU) provides the most current comparisons to the U.S. population.
  • In addition, the WJ III NU used innovative statistical advancements to calculate the new norms. The use of bootstrap resampling procedures (Efron & Tibshirani, 1993) allowed for estimates of uncertainty and potential bias (in the sample data) to be incorporated into the calculation of the WJ III NU norms. The bootstrap-based norm development procedures used to recalculate WJ III NU norms result in more precise estimates of an individual’s tested performance. Collectively, the refinement of the demographic characteristics in the WJ III NU norm data, based on updated U.S. census statistics, and the use of state-of-the-art statistical methods for estimating the sample statistics used to calculate norms allow users of the WJ III to have greater confidence in the accuracy of the WJ III NU-based scores.


Technorati Tags: , , , , , , , , , , , , , , , ,

Powered by ScribeFire.

Friday, October 19, 2007

CHC intelligence theory tipping point: It has come

[Double click on image to enlarge]

In April 2005, upon returning from the annual NASP (National Association of School Psychologists) convention, I concluded (in a blog post) that sometime during the past 5 years the CHC intelligence theory "tipping point" had occurred, and the CHC intelligence test bandwagon had gathered full steam. Before reading further, I would recommend reading that original post for background information and important links (esp. the link to the historical information I've written about the evolution of CHC theory).

To satisfy my curiosity I decided to gather some informal data...namely, the tracking of select terms in the body of messages on the NASP listserv. I wanted to see if there was any change in the usage of CHC-related terms over time. So...what did I do?

I went to the NASP listserv and used a Yahoo Groups feature that allowed me to search the body of all archived messages for key terms. I did this for different years. The terms I searched where Gf-Gc (what CHC theory originally was referred to prior to the publication of the WJ III; see prior original post for important link to historical background information), CHC, and WJ (Woodcock-Johnson). At the top of this post is a graph of the results.

From the figure I've concluded that the CHC tipping point, at least within the NASP community, occurred sometime between 2001 and 2003. The publication of the WJ III in 2001 is important as it was the first intelligence battery organized as per CHC theory (note - the1989 WJ-R was organized as per Cattell-Horn Gf-Gc theory). [Read the previously referenced historical background information regarding the role of the WJ-R and WJ III in the infusion of Gf-Gc and CHC theory into applied intellectual assessment - click on my original post to find this info]. As one can see, their was a huge amount of discussion of the WJ III went it hit the streets....volume that has continued for a number of years.

What I find particularly interesting is the replacement of references to Gf-Gc by CHC starting in the same year....2001. Notice the increase in CHC references from 2001 thru 2003 with a concurrent decrease in the use of the terms Gf-Gc. I would conclude, largely based on my personal knowledge of the history of the origin of the term "CHC" [again, read the historical information I've provided], that the publication of the WJ III was the primary event(as well as the increasing interest in CHC-organized cross-battery assessments) that resulted in the infusion of CHC theory into school psychology, as evidenced by a change in the language used by school psychologists on their general purpose listserv.

Since 2003 there has been a general decrease in the use of the CHC in NASP listserv messages. Does this mean that the interest in the theory has peaked? I think not. I've data to support this conclusion.

The NASP listserv is a general purpose topic listserv. Intellectual assessment/theory topics are only a small part of the collective message threads. I would advance the hypothesis that CHC theory continues to increase in the communications of psychologists. Upon what do I base this observation? I base this conclusion on the membership figures for the special-purpose CHC listserv that I started.

If you click here you will see a graph of the cumulative membership of the CHC list, a list that I started in order to give folks interested in CHC theory/assessment issues a place to talk about them in-depth.....and to also save the NASP listserv from such focused discussions (as all members may not be interested). As you can see from the membership numbers of the CHC list, membership is growing at a nearly constant linear rate from 2003 to 2006 [note - current membership is at 956 and should reach 1000 relatively soon].

I conclude that the infusion of CHC theory into school psychology, which reached a tipping point sometime between 2001 and 2003, continues at a very steady rate, as evidenced by the increasing membership of the CHC list, as well as other objective indicators (namely, revision of other intelligence batteries to provide CHC interpretive frameworks....SB5, KABC-II, DAS-II...as well as continued interest in CHC-organized cross-battery assesment).

Comments, thoughts, disagreements, etc. are welcome. Either post them here via the "comment" feature or share at the CHC listserv.


Technorati Tags: , , , , , , , , , , , , , , ,

Powered by ScribeFire.

Monday, June 18, 2007

WJ III NU (normative update) special pub

Last week a number of questions were asked on the NASP listserv about the WJ III Normative Update (WJ III NU). A number of members provided good responses.

At this time I'd like to announce that a special WJ III NU Assessment Service Bulletin (ASB) will be available (from the Riverside web page) in approximately two weeks. The ASB will provide more in-depth information that addresses the major questions users may have about the WJ III NU. Below is the title of the ASB and the submitted draft (note - the text in the final publication will likely have some minor edits, changes, etc.) of the introduction, inclusive of a list of major questions that are answered in the document.

Once the final ASB is available for download, I will make a post at this blog and on a couple of listservs.

[Conflict of interest disclosure - I'm a coauthor of the WJ III]


WJ III/NU score differences: What the user can expect and why

The Woodcock-Johnson® III Normative Update (WJ III NU®) (Woodcock, McGrew, Schrank, & Mather, 2001, 2007) is a recalculation of the normative data for the Woodcock-Johnson III (WJ III ®) (Woodcock, McGrew, & Mather, 2001), based on the final 2000 U.S.census statistics (U.S.Census Bureau, 2005). The final 2000 census data are reflected in the norms provided by the WJ III NU Compuscore and Profiles Program (Compuscore®) (Schrank & Woodcock, 2007) and in the documentation provided in the WJ III NU Technical Manual (McGrew, Schrank, & Woodcock, 2007).The WJ III NU norms replace the original WJ III norms that were based on the U.S.Census Bureau’s 2000 census projections, which were issued in 1996 (Day, 1996).

The census bureau’s Population Projections Program issues projections of the United States resident population based on assumptions about future births, deaths, and international migration. Census projections are estimates of the population for future dates, and are subsequently replaced by census statistics. The 2000 census statistics produced a somewhat different description of the U.S. population than was assumed from the last projections (issued in 1996). For example, according to the bureau’s Greg Spencer, “when we took the 2000 census, we found about 6.8 million more people than we were expecting. When we went in and looked at the sources of that growth, we found that during the late 1990s, there was more migration than we had been measuring.” (Landphair, 2004, p. 1). Other unanticipated changes in the population were documented (U.S. Census Bureau, 2005), including shifts in age, sex, race, Hispanic origin, and residence. Some states grew at three times the national rate, and people had tended to cluster in locations were jobs were available and climate was preferred. For users of the WJ III, the normative update (NU) provides the most current comparisons to the U.S. population.

In addition, the WJ III NU utilized innovative statistical advancements to calculate the new norms. The use of bootstrap resampling procedures (Efron & Tibshirani, 1993) allowed for estimates of uncertainty and potential bias (in the sample data) to be incorporated into the calculation of the WJ III NU norms. The bootstrap-based norm development procedures used to recalculate WJ III NU norms results in more precise estimates of an individual’s tested performance.

Collectively, the refinement of the demographic characteristics in the WJ III NU norm data, based on updated U.S.Census statistics, and the utilization of “state-of-the-art” statistical methods for estimating the sample statistics used to calculate norms, allows users of the WJ III to have greater confidence in the accuracy of the WJ III NU-based scores.

Purposes

The following four general categories of questions are presented and discussed:
  • What score differences can I expect between test scores based on the original WJ III and WJ III NU norms? If there are differences, are the differences more noticeable with certain age groups?
  • Did the year 2000 U.S.Census population demographic final statistics change enough (since the year 2000 census projections) to make a real difference in the scores subjects will receive on the WJ III? That is, are the NU norms needed to provide better estimates of scores for comparison to the current U.S. population?
  • What is “bootstrap sampling” and, more importantly, how does this innovative statistical method provide more accurate norms than those published with the WJ III data in 2000?
  • What WJ III/NU scores should be used to track and compare test performance for individuals across time. What is the suggested best practice for tracking student growth from the WJ III to WJ III NU?

Technorati Tags: , , , , , , , , , , , , ,

Powered by ScribeFire.

Tuesday, April 03, 2007

New Charles Murray black-white IQ difference research article

As noted in prior posts, research on black-white intelligence differences has been one of the most hot button topics in individual differences research. Recently there has been a flurry of new articles based on new data sets.

Charles "Bell Curve" Murray has recently completed an analysis of BW differences across all three standardization samples of the Woodcock-Johnson intelligence battery (WJ, WJ-R, WJ III). His article (the title and abstract which are reproduced below) is currently "in press" in the journal Intelligence.

Given my conflict of interest (coauthor of the WJ III) I'm not going to make any comments. Readers can read and form their own judgments and interpretations. URL link is provided below


Murray, C. (2007,in press). The magnitude and components of change in the black–white IQ difference from 1920 to 1991: A birth cohort analysis of the Woodcock–Johnson standardizations. Intelligence. (click here to view)

Abstract
  • The black–white difference in test scores for the three standardizations of the Woodcock–Johnson battery of cognitive tests is analyzed in terms of birth cohorts covering the years from 1920 through 1991. Among persons tested at ages 6–65, a narrowing of the difference occurred in overall IQ and in the two most highly g-loaded clusters in the Woodcock–Johnson, Gc and Gf. After controlling for standardization and interaction effects, the magnitude of these reductions is on the order of half a standard deviation from the high point among those born in the 1920s to the low point among those born in the last half of the 1960s and early 1970s. These reductions do not appear for IQ or Gc if the results are restricted to persons born from the mid-1940s onward. The results consistently point to a B–W difference that has increased slightly on all three measures for persons born after the 1960s. The evidence for a high B–W IQ difference among those born in the early part of the 20th century and a subsequent reduction is at odds with other evidence that the B–W IQ difference has remained unchanged. The end to the narrowing of the B–W IQ difference for persons born after the 1960s is consistent with almost all other data that have been analyzed by birth cohort.
Technorati Tags: , , , , , , , , , , , , , , , , , ,

powered by performancing firefox

Tuesday, January 30, 2007

WJ III EWOK (Evolving Web of Knowledge) revised

I'm pleased to announce an update/revision of the WJ III Evolving Web of Knowledge (EWOK), which was first announced in March of 2006. Click here to visit the original description and post. Click on the other link to go directly to the new WJ III EWOK.

Feedback is always welcome.

Technorati Tags: , , , , , , , , , , , , , , , ,

powered by performancing firefox