Showing posts with label test development. Show all posts
Showing posts with label test development. Show all posts

Friday, April 18, 2025

Tuesday, November 15, 2011

Thinking..fast and slow: Dual process models of cognition/intelligence--hot topic

Dual cognitive process (sometimes called Type I/II processing) have increased in prominence the past five years.  Within the past few weeks the long anticipated book "Thinking, Fast and Slow" by Daniel Kaneham was released, and it is already near the top of most non-fiction best selling books.  I can't wait to get my copy, as it will put Malcom Gladwell's "Blink" in it's proper place.  This will give the layperson, and many professionals, a better understanding of these two general classes of cognitive processes.

My thinking about applied intelligence test development and interpretation has been incorporated this general dichotomy in the form of a working (evolving) test development/interpretation framework (see summary figure below).
[Double click on images to enlarge]

The most recent journal to devote a special issue to dual process models is Developmental Review.  Below are the key articles and a few intriguing model figures.















Generated by: Tag Generator

Monday, August 03, 2009

Presenting on test development at Brazil Psych. Assessment conference



This is a photo of me during my presentation on the "Art and Science of Test Development" at the Brazil Psych. Assessment conference last week in Campinas, Brazil. It was taken by Dr. Ricardo Primi.....a new friend and academic doing some exciting research in intellectual assessment and psychometrics.

Thanks Ricardo.Technorati Tags: , , , , , , , ,

Wednesday, July 08, 2009

Applied Psych Test Design Part G: Psychometric/technical statistical analysis: External

The seventh  in the series Art and Science of Applied Test Development is now available.

The seventh module (Part G:  Psychometric/technical statistical analysis:  External) is now posted and is accessible via SlideShare.

In addition, I've made some new edits and additions  to prior presentations (Part A-F)....so if you've viewed the prior modules you may want to revisit them again.

This is the seventh in a series of PPT modules explicating the development of psychological tests in the domain of cognitive ability using contemporary methods (e.g., theory-driven test specification; IRT-Rasch scaling; etc.). The presentations are intended to be conceptual and not statistical in nature. Feedback is appreciated.

This project can be tracked on the left-side pane of the blog under the heading of Applied Test Development Test Development Series.

The first module (Part A: Planning, development frameworks & domain/test specification blueprints) was posted previously and is accessible via SlideShare.

The second module (Part B: Test and item development) was posted previously and is accessible via SlideShare.

The third module (Part C--Use of Rasch scaling technology) was posted previously and is accessible via Slideshare.

The fourth module (Part D--Develop norm [standardization] plan) was posted previously and is accessible via Slideshare.

The fifth module (Part E--Calcuate norms and derived scores) was posted previously and is accessible via Slideshare.

The sixth module (Part F--Psychometric/technical statistical analysis: Internal) was posted previously and is accessible via Slideshare.

You are STRONGLY encouraged to view them in order as concepts, graphic representation of concepts and ideas, etc., build on each other from start to finish.

That's it for now.  I will likely be revising and adding more material in the future---but this is the "basic" set of materials for now.

Technorati Tags: , , , , , , , , , , , , , , , , ,



Tuesday, July 07, 2009

Applied Psych Test Development Series: Parts F--Psychometric/technical statistical analysis: Internal

The sixth in the series Art and Science of Applied Test Development is now available.

The sixth module (Part F--Psychometric/technical statistical analysis:  Internal) is now available.

In addition, I've made some edits and additions (esp. summary "Tools, Tips, and Troubles" and "Advanced Topics" slides) to prior presentations (Part A-E).

This is the sixth in a series of PPT modules explicating the development of psychological tests in the domain of cognitive ability using contemporary methods (e.g., theory-driven test specification; IRT-Rasch scaling; etc.). The presentations are intended to be conceptual and not statistical in nature. Feedback is appreciated.

This project can be tracked on the left-side pane of the blog under the heading of Applied Test Development Test Development Series.

The first module (Part A: Planning, development frameworks & domain/test specification blueprints) was posted previously and is accessible via SlideShare.

The second module (Part B: Test and item development) was posted previously and is accessible via SlideShare.

The third module (Part C--Use of Rasch scaling technology) was posted previously and is accessible via Slideshare.

The fourth module (Part D--Develop norm [standardization] plan) was posted previously and is accessible via Slideshare.

The fifth module (Part E--Calcuate norms and derived scores) was posted previously and is accessible via Slideshare.

You are STRONGLY encouraged to view them in order as concepts, graphic representation of concepts and ideas, etc., build on each other from start to finish.

Enjoy...more to come.

Technorati Tags: , , , , , , , , , , , , , , , , ,



Wednesday, July 01, 2009

Applied Psych Test Development Series: Parts C/D--Develop norm plan and calculating norms

The fourth and fifth in the series Art and Science of Applied Test Development is now available.

The fourth module (Part D--Develop norm [standardization] plan) is now available.

The fifth module (Part E--Calcuate norms and derived scores) is also now available.


These are the fourth and fifth in a series of PPT modules explicating the development of psychological tests in the domain of cognitive ability using contemporary methods (e.g., theory-driven test specification; IRT-Rasch scaling; etc.). The presentations are intended to be conceptual and not statistical in nature. Feedback is appreciated.

This project can be tracked on the left-side pane of the blog under the heading of Applied Test Development Test Development Series.

The first module (Part A: Planning, development frameworks & domain/test specification blueprints) was posted previously and is accessible via SlideShare.

The second module (Part B: Test and item development) was posted previously and is accessible via SlideShare.

The third module (Part C--Use of Rasch scaling technology) was posted previously and is accessible via Slideshare.

You are STRONGLY encouraged to view them in order as concepts, graphic representation of concepts and ideas, build on each other from start to finish.

Enjoy...more to come.

Technorati Tags: , , , , , , , , , , , , , , , , ,

Monday, June 29, 2009

Applied Psych Test Development Series: Part C--Use of Rasch scaling technology

The third in the series Art and Science of Applied Test Development is now available. The third module (Part C: Test and Item Development--Use of Rasch Scaling Technology) is now available.

This is the third in a series of PPT modules explicating the development of psychological tests in the domain of cognitive ability using contemporary methods (e.g., theory-driven test specification; IRT-Rasch scaling; etc.). The presentations are intended to be conceptual and not statistical in nature. Feedback is appreciated.

This project can be tracked on the left-side pane of the blog under the heading of Applied Test Development Test Development Series.

The first module (Part A: Planning, development frameworks & domain/test specification blueprints) was posted previously and is accessible via SlideShare.

The second module (Part B: Test and item development) was posted previously and is accessible via SlideShare.

You are STRONGLY encouraged to view them in order as concepts, graphic representation of concepts and ideas, build on each other from start to finish.

Enjoy...more to come.

Technorati Tags: , , , , , , , , , , , , , , , ,

Friday, June 26, 2009

Applied Psych Test Development Series: Part B-Test and Item Development

The second in the series Art and Science of Applied Test Development is now available. The second module (Part B: Test and Item Development) is now available.

This is the second in a series of PPT modules explicating the development of psychological tests in the domain of cognitive ability using contemporary methods (e.g., theory-driven test specification; IRT-Rasch scaling; etc.). The presentations are intended to be conceptual and not statistical in nature. Feedback is appreciated.

This project can be tracked on the left-side pane of the blog under the heading of Applied Test Development Test Development Series.

The first module (Part A: Planning, development frameworks & domain/test specification blueprints) was posted previously and is accessible via SlideShare.

Enjoy...more to come.


Applied Psych Test Development Series: Part A-Planning, development frameworks & domain/test specification blueprints

Announcement--the Art and Science of Applied Test Development. Let the games begin.

This is the first in a series of PPT modules explicating the development of psychological tests in the domain of cognitive ability using contemporary methods (e.g., theory-driven test specification; IRT-Rasch scaling; etc.). The presentations are intended to be conceptual and not statistical in nature. Feedback is appreciated.

This project can be tracked on the left-side pane of the blog under the heading of Applied Test Development Test Development Series.

The first module (Part A: Planning, development frameworks & domain/test specification blueprints) is now available for viewing via SlideShare.

Stay tuned.


Thursday, June 11, 2009

Art and Science of Test Development: Encyclopedia of Gv (visual-spatial) tests



Yesterday I blogged about my "Art and Science of Test Development" project.  Today I continue with another tidbit.

When trying to develop new tests to measure cognitive abilities, a test developer often looks at existing tests (whats been done before).  Many years ago I was given a Xeroxed copy of the large and out-of-print  International Directory of Spatial Tests", which is a godsend if you are thinking of developing a new measure in the domain of Gv (visual processing).  It includes images and brief descriptions of over 390 different visual-spatial tests grouped into 13 categories.  We (authors of the WJ III) used it to decide on what new Gv test we might add to the WJ III.  We ended up with WJ III Block Rotation test (in the WJ III Diagnostic Supplement).  Although dated, and thus not inclusive of Gv test innovations since 1983, it is tremndous resource.

If you are not looking to develop new Gv tests, reviewing at all the various tests (and permutations of common formats) is very interesting and you can often see the historical roots of individual tests in many contemporary intelligence batteries.

While searching the net yesterday I discovered that this publication is now available via download as a PDF file.  You can find it at the link above.  Be forwarned...it is a huge file (35 MB)...don't download from wifi connection is my advice.

Technorati Tags: , , , , , , , , , , ,

Wednesday, June 10, 2009

Art and science of test development: ETS Kit

I'm in the process of developing a four-hour course presentation on the "Art and Science of Test Development:  Theories, tools, tips and troubles" that I will unveil late July at a Brazil psychological assessment conference.  I'm very excited about putting this together.  There are many books on different aspects of test development and psychometrics, but nothing that is really "applied" test development or psychometrics.  I'm excited, but also am finding it a challenge to do within a four-hour time constraint.  When done, it may serve as the outline for a manuscript and PPT slides that may be available via the WMF.  Much of it is based on Dr. Woodock's approach to test development and he has graciously provided me access to many of his notes and documents.  If we do ever get this to a manuscript, he would likely be the first author.

I may make intermediate PPT modules available for review via Slideshare as they emerge...in hopes of eliciting feedback, comments, etc.

In the process of working on this presentation I refer to the ETS Kit of Factor-Referenced Cognitive Tests (1976 Edition) as a source I often review when trying to understand some old measures mentioned in studies and, more importantly, for ideas for possible new tests of narrow CHC abilities. The publication is a steal for the price....but you must be aware that the copies of the tests you will receive are very crude black-white copies of prototypes, often with free-hand drawings. 

It is a classic....and one that I think most instructors of cognitive/intellectual testing courses might consider purchasing for their library...as a teaching aid.  The tests use the CHC code system that is currently being using today in discussions of CHC abilities.  Thus, the tests, although not of high quality, might be good as illustrations of how to measure 23 different narrow CHC abilities.

Technorati Tags: , , , , , , , , ,