Assigning Adaptive NAEP Booklets Based On State Assessment Scores: A Simulation Study Of The Impact On Standard Errors

Introduction

The purpose of this simulation was to assess the improvements in estimates of standard errors that could be expected if students participating in NAEP were pre-assigned to test booklets that were adapted to their level of performance based on their state assessment scores. Students in extreme quartiles would receive one regular NAEP block and one block adapted to their performance quartile. For their adapted block, students in the lowest quartile would receive an easier block, students in the highest quartile would receive a more difficult block, and students in the middle two quartiles would receive a second “regular” NAEP block. We also considered the impact of assigning adapted blocks only to the top and bottom deciles of students, rather than to full quartiles.