Trusted Hand-Scoring Services
Measured Progress hand-scores up to 35 million student responses every year. General and alternate assessment items include constructed- and extended-response questions, portfolios, and performance tasks. Over the years we’ve figured out how to score experiments, art projects, group activities, and more. We pioneered a process for digitization and scoring of alternate assessment student portfolios.
Clients have no doubt about the rigor and consistency of our scoring activities. Many department of education staff members have participated in person, learning from our expert scoring leadership and witnessing the effectiveness of our training and monitoring processes. We’re proud of our open-door policy—our clients can visit our scoring operations at any time.
Multiple Layers of Training for Accuracy
We employ a multi-layer training, evaluation, and retraining model—not just for every person hired to hand-score, but for each person, on each individual item. Our process continually monitors every scorer’s ratings of responses to prevent scorer “drift,” using
- “read-behinds,” in which an experienced scorer performs a follow-up reading,
- “double-blind” scoring, providing a controlled second independent reading with original score hidden,
- embedded check-sets, which seed pre-scored sets throughout the current response set, to flag discrepancies
If an individual scorer’s accuracy dips below the prescribed consistency rate, that person is retrained and retested for the item, or is or moved to a new item, with new training and testing for that item.
Using our own iScore image-based scoring system, we deliver the same quality and consistency whether scoring is conducted at one of our 3 scoring centers or via an individual, distributed scoring model.
What sets our implementation of these processes apart? Transparency. Whether visiting a scoring site or working in their own offices, clients have access to multiple real-time reports that show the progress of their project and the ongoing accuracy rates.
Scoring Training Process
State and district testing staff may have opportunities to participate in the scoring process or expand their capacity to score their students’ work on local assessments.
- As part of many of our states’ programs, educators take part in benchmarking activities, working with scoring rubrics and creating exemplar sets of scored responses.
- Some states and districts choose to provide local Scoring Institutes. Our scoring professionals have helped thousands of teachers affect meaningful improvements in classroom instruction and student performance, often receiving rave reviews.
We frequently support assessment programs with supplemental scoring services. Contact us for further information.