Research Framework - Statistical Analysis
Validity
There are a wide variety of validity analyses, such as construct, criterion-related, content, consequential, predictive, concurrent, and convergent. One broad way of categorizing them is as either internal or external.
Internal Validity
This research concerns investigating relationships among variables within the test itself (such as DIF, item drift, dimensionality analyses, factor analyses, the relationship between order of presentation and item difficulty, the relationship between estimated parameters for a model fitted to the observed data and the observed data themselves, or the relationship between field-test and common items) to see the degree to which the relationships match our expectations.
External Validity
This research investigates relationships between a test and variables external to the test (such as the relationship between an estimated examinee parameter and an external examinee performance criterion, or the relationship between two different tests) to see the degree to which these relationships match our expectations.
Research
The Effect of Including Pretest Items in an Operational Computerized Adaptive Test: Do Different Ability Examinees Spend Different Amounts of Time on Embedded Pretest Items?, by Abdullah A. Ferdous, Barbara S. Plake, and Shu-Ren Chang (2007), from Educational Assessment, Vol. 12, No. 2: pages 161-173.
Formulation of an Effect Size Measure for DIMTEST, by Minhee Seo and Louis Roussos (2007), Paper presented at the American Education Research Association Annual Meeting, Chicago, IL
Evaluation of the Effect of the Proportion of Examinees Used for Nonparametric Dimensionality Assessment (DIMTEST), by EunYoung Lim and Louis Roussos (2007), Paper presented at the American Education Research Association Annual Meeting, Chicago, IL
Conditional Item Exposure in Multidimensional Adaptive Testing, by Matt Finkelman, Michael Nering, and Louis Roussos (2007), Paper presented at the American Education Research Association Annual Meeting, Chicago, IL
NIRT-based Approach for Validating Cutscore, by Abdullah Ferdous (2007), Paper presented at the American Education Research Association Annual Meeting, Chicago, IL
Evaluation of Equating Items Using DFIT by Michael Nering and Wonsuk Kim. Paper presented at the American Education Research Association Annual Meeting,
Chicago, IL
Assessing the Relative Performance of Local Item Dependence Indices, by Doyoung Kim, Ralph DeAyala, Abdullah Ferdous, and Michael Nering (2007), Paper presented at the American Education Research Association Annual Meeting, Chicago, IL
Exposed Items Detection in Personnel Selection Assessment: An Exploration of New Item Statistic, by Yongwei Yang, Abdullah Ferdous, and Katherine Chin (2007), Paper presented at the American Education Research Association Annual Meeting, Chicago, IL
Using Person Fit in a Body of Work Standard Setting, by Matt Finkelman and Wonsuk Kim (2007), Paper presented at the American Education Research Association Annual Meeting, Chicago, IL
Detection of Item Degradation, by Yongwei Yang, Abdullah Ferdous, and Katherine Chin, Presentation at the 2007 Society for Industrial and Organizational Psychology,
New York, NY
Formulation of the DETECT Population Parameter and Evaluation of DETECT Estimator Bias, by Louis Roussos and Ozlem Ozbek (2006), from Journal of Educational Measurement
