Research Framework - Scoring and Reporting
Standard Setting
One common use of educational assessments is to assess the proficiency of individuals relative to a set of pre-set standards, usually defined at several levels of proficiency. Research in this area may be either substantive, statistical, or both, since both components play an equally valuable role in the standard-setting process. A variety of methods have been developed and used for both components. There is a close relationship between this research and scaling research.
Research
Level of Complexity: A Study on Composite Scores in a Portfolio Type Alternate Assessment by Luz Bay, Keven Haley, and Kelly Ickes (2009), Paper presented at the Annual Meeting of the National Council on Measurement in Education, San Diego, CA
Variations of the "Body of Work" Standard Setting Method, by Kevin Sweeney and Abdullah Ferdous (2007), Paper presented at the American Education Research Association Annual Meeting, Chicago, IL
Interjudge Inconsistency Index for Body of Work, Yes/No, and Bookmark Standard Setting Procedures, by Abdullah Ferdous and Barbara Plake (2007), Paper presented at the American Education Research Association Annual Meeting, Chicago, IL
The Use of Subsets of Test Items in a Bookmark Standard Setting Method, by Abdullah Ferdous (2007), Paper presented at the American Education Research Association Annual Meeting, Chicago, IL
NIRT-based Approach for Validating Cutscore, by Abdullah Ferdous (2007), Paper presented at the American Education Research Association Annual Meeting, Chicago, IL
Using a Subset of Items for a Modified Angoff Standard Setting Study—An Item Selection Procedure, by Russ Smith and Abdullah Ferdous (2007), Paper presented at the American Education Research Association Annual Meeting, Chicago, IL
What Breaks the Equating? A Preliminary Investigation Into Threat to a Five-year Equating Chain, by Robert R. Keller, Wonsuk Kim, Michael Nering and Lisa A. Keller (2007), Paper presented at the American Education Research Association Annual Meeting,
Chicago, IL
Using Person Fit in a Body of Work Standard Setting, by Matt Finkelman and Wonsuk Kim (2007), Paper presented at the American Education Research Association Annual Meeting, Chicago, IL
Factors That Influence Judges' Decisions in an Angoff Standard Setting Study, by Abdullah A. Ferdous, Michael Nering, and Barbara S. Plake (2006), Paper presented at the 2006 American Education Research Association Annual Meeting, San Franciso, CA
Understanding the Factors that Influence Decisions of Panelists in a Standard Setting Study, by Abdullah Ferdous and Barbara Plake (2005), from Applied Measurement in Education, 18(3), 2005: 257–267; order the publication at www.erlbaum.com
1998 NAEP Writing Achievement Levels-Setting Process Performance Profiles Study by Luz Bay (2000), Paper presented at the Annual Meeting of the National Council on Measurement in Education, New Orleans, LA
Comparing Two Methods for Collecting Test-Base Judgements by Luz Bay and Mike Reckase (1999), Paper presented at the Annual Meeting of the National Council on Measurement in Education, Montreal, Canada
