IRT-based clinical psychological assessment and test development

IRT based test development has been one of the most important psychometric developments during the past few decades.

This is a followup to a prior brief FYI post about an excellent review article regarding the benefits of IRT methods for psychological test development and interpretation. I have now read the article in depth and have provided additional comments and links via the IQs Reading blog feature.

Enjoy.


- iPost using BlogPress from Kevin McGrew's iPad

Research byte: Another good overview article on IRT test development methods--relevance to clinical assessment

Double click on image to enlarge


- iPost using BlogPress from Kevin McGrew's iPad

intelligence IQ tests IQ testing IQ scores CHC intelligence theory CHC theory Cattell-Horn-Carroll human cognitive abilities psychology school psychology individual differences cognitive psychology neuropsychology neuroscience psychology special education educational psychology psychometrics psychological assessment psychological measurement IQs Corner general intelligence intelligent IQ testing validity intellectual assessment IRT Rasch

Generated by: Tag Generator

Research byte: Nice intro/overview of Rasch measurement basics

Double click images to enlarge











- iPost using BlogPress from Kevin McGrew's iPad

Applied Psych Test Design Part G: Psychometric/technical statistical analysis: External

The seventh  in the series Art and Science of Applied Test Development is now available.

The seventh module (Part G:  Psychometric/technical statistical analysis:  External) is now posted and is accessible via SlideShare.

In addition, I've made some new edits and additions  to prior presentations (Part A-F)....so if you've viewed the prior modules you may want to revisit them again.

This is the seventh in a series of PPT modules explicating the development of psychological tests in the domain of cognitive ability using contemporary methods (e.g., theory-driven test specification; IRT-Rasch scaling; etc.). The presentations are intended to be conceptual and not statistical in nature. Feedback is appreciated.

This project can be tracked on the left-side pane of the blog under the heading of Applied Test Development Test Development Series.

The first module (Part A: Planning, development frameworks & domain/test specification blueprints) was posted previously and is accessible via SlideShare.

The second module (Part B: Test and item development) was posted previously and is accessible via SlideShare.

The third module (Part C--Use of Rasch scaling technology) was posted previously and is accessible via Slideshare.

The fourth module (Part D--Develop norm [standardization] plan) was posted previously and is accessible via Slideshare.

The fifth module (Part E--Calcuate norms and derived scores) was posted previously and is accessible via Slideshare.

The sixth module (Part F--Psychometric/technical statistical analysis: Internal) was posted previously and is accessible via Slideshare.

You are STRONGLY encouraged to view them in order as concepts, graphic representation of concepts and ideas, etc., build on each other from start to finish.

That's it for now.  I will likely be revising and adding more material in the future---but this is the "basic" set of materials for now.

Technorati Tags: psychology, education, educational psychology, school psychology, neuropsychology, cognition, intelligence, ISIR, IQ, IQ tests, test development, IRT, Rasch, norms, standardiation, psychometrics, measurement, scaling

Applied Psych Test Development Series: Parts F--Psychometric/technical statistical analysis: Internal

The sixth in the series Art and Science of Applied Test Development is now available.

The sixth module (Part F--Psychometric/technical statistical analysis:  Internal) is now available.

In addition, I've made some edits and additions (esp. summary "Tools, Tips, and Troubles" and "Advanced Topics" slides) to prior presentations (Part A-E).

This is the sixth in a series of PPT modules explicating the development of psychological tests in the domain of cognitive ability using contemporary methods (e.g., theory-driven test specification; IRT-Rasch scaling; etc.). The presentations are intended to be conceptual and not statistical in nature. Feedback is appreciated.

This project can be tracked on the left-side pane of the blog under the heading of Applied Test Development Test Development Series.

The first module (Part A: Planning, development frameworks & domain/test specification blueprints) was posted previously and is accessible via SlideShare.

The second module (Part B: Test and item development) was posted previously and is accessible via SlideShare.

The third module (Part C--Use of Rasch scaling technology) was posted previously and is accessible via Slideshare.

The fourth module (Part D--Develop norm [standardization] plan) was posted previously and is accessible via Slideshare.

The fifth module (Part E--Calcuate norms and derived scores) was posted previously and is accessible via Slideshare.

You are STRONGLY encouraged to view them in order as concepts, graphic representation of concepts and ideas, etc., build on each other from start to finish.

Enjoy...more to come.

Technorati Tags: psychology, education, educational psychology, school psychology, neuropsychology, cognition, intelligence, ISIR, IQ, IQ tests, test development, IRT, Rasch, norms, standardiation, psychometrics, measurement, scaling

Applied Psych Test Development Series: Part C--Use of Rasch scaling technology

The third in the series Art and Science of Applied Test Development is now available. The third module (Part C: Test and Item Development--Use of Rasch Scaling Technology) is now available.

This is the third in a series of PPT modules explicating the development of psychological tests in the domain of cognitive ability using contemporary methods (e.g., theory-driven test specification; IRT-Rasch scaling; etc.). The presentations are intended to be conceptual and not statistical in nature. Feedback is appreciated.

This project can be tracked on the left-side pane of the blog under the heading of Applied Test Development Test Development Series.

The first module (Part A: Planning, development frameworks & domain/test specification blueprints) was posted previously and is accessible via SlideShare.

The second module (Part B: Test and item development) was posted previously and is accessible via SlideShare.

You are STRONGLY encouraged to view them in order as concepts, graphic representation of concepts and ideas, build on each other from start to finish.

Enjoy...more to come.

Technorati Tags: psychology, education, educational psychologyk, school psychology, neuropsychology, cognition, intelligence, intelligence testing, IQ, IQ tests, Gv, visual-spatial, visualization, IRT, Rasch, psychometrics, measurement

Applied Psych Test Development Series: Part B-Test and Item Development

The second in the series Art and Science of Applied Test Development is now available. The second module (Part B: Test and Item Development) is now available.

This is the second in a series of PPT modules explicating the development of psychological tests in the domain of cognitive ability using contemporary methods (e.g., theory-driven test specification; IRT-Rasch scaling; etc.). The presentations are intended to be conceptual and not statistical in nature. Feedback is appreciated.

This project can be tracked on the left-side pane of the blog under the heading of Applied Test Development Test Development Series.

The first module (Part A: Planning, development frameworks & domain/test specification blueprints) was posted previously and is accessible via SlideShare.

Enjoy...more to come.

The attack of the psychometricians: Psychological measurement

I'm just in the processing of reading Borsboom's (2006; Psychometrika) provocative article "The attack of the psychometricians."  The article abstract is below.  As I'm reading, I'm loving a number of statements meant to get the attention of psychologists.  Here is the most recent favorite. 

"psychologists have a tendency to endow obsolete techniques with obscure interpretations"

Abstract:  This paper analyzes the theoretical, pragmatic, and substantive factors that have hampered the integration between psychology and psychometrics. Theoretical factors include the operationalist mode of thinking which is common throughout psychology, the dominance of classical test theory, and the use of “construct validity” as a catch-all category for a range of challenging psychometric problems. Pragmatic factors include the lack of interest in mathematically precise thinking in psychology, inadequate representation of psychometric modeling in major statistics programs, and insufficient mathematical training in the psychological curriculum. Substantive factors relate to the absence of psychological theories that are sufficiently strong to motivate the structure of psychometric models. Following the identification of these problems, a number of promising recent developments are discussed, and suggestions are made to further the integration of psychology and psychometrics.

Technorati Tags: psychology, school psychology, educational psychology, psychometrics, measurement, Psychometrika, neuropsychology

Quantoids corner: Rasch psychological measurement (IRT) references

Someone just asked me a question about Rasch (item response theory) measurement. I ran a search of the IAP Reference Database and flagged any reference that had "Rasch" as a keyword (in Procite). I've posted a copy in case anyone is looking for a relatively list of contemporary Rasch psychometric references.