• Skip to primary navigation
  • Skip to main content
SRI logo
  • About
    • Press room
    • Our history
  • Expertise
    • Advanced imaging systems
    • Artificial intelligence
    • Biomedical R&D services
    • Biomedical sciences
    • Computer vision
    • Cyber & formal methods
    • Education and learning
    • Innovation strategy and policy
    • National security
    • Ocean & space
    • Quantum
    • Robotics, sensors & devices
    • Speech & natural language
    • Video test & measurement
  • Ventures
  • NSIC
  • Careers
  • Contact
  • 日本支社
Search
Close
Education & learning publications May 1, 2004

Evaluation Of Bias Correction Methods For ‘Worst-Case’ Selective Non-Participation In NAEP

Citation

Copy to clipboard


McLaughlin, D., Gallagher, L. P. & Stancavage, F. (2004). Evaluation of bias correction methods for ‘worst-case’ selective non-participation in NAEP (Technical Report for the NAEP Validity Studies Panel). Washington, DC: American Institutes for Research.

Introduction

With the advent of No Child Left Behind (NCLB), the context for NAEP participation is changing. Whereas in the past participation in NAEP has always been voluntary, participation is now mandatory for some grade and subjects among schools receiving Title I funds. While this will certainly raise school-level participation rates in the mandated grades and subjects, it could have the opposite effect on non-mandated grades and subjects, particularly in light of the increased burden of state testing also required by NCLB. At the student level, participation remains voluntary in all subject areas as it has been in the past. However, participation rates could be influenced negatively by the NCLB requirement for more aggressive notification of students and parents regarding their rights to opt out of NAEP testing.

Random non-participation introduces random error into NAEP estimates. More worrisome is the possibility of selective non-participation at the top or bottom of the ability distribution, which would introduce a bias into statewide mean scores. Although NAEP has not, as had once been proposed, been given an official confirmatory role under NCLB, one can expect greater scrutiny of the relationship between state scores and state NAEP scores in the coming years. This could lead to subtle pressures that depress participation among schools or students near the bottom of the distribution. Conversely, if non-Title I schools decide to take advantage of their exemption from mandatory participation, this could remove a disproportionate number of high performing schools from the sample, given that Title I funds are targeted at schools serving disadvantaged students. Furthermore, participation rates among high performing students could be differentially affected by a variety of factors. These could include a greater reluctance to lose instructional time for testing, or simply a greater willingness among affluent students and parents to assert their rights under the law. It may take several years for these countervailing forces to play themselves out and for any serious problems in NAEP participation rates to manifest. In the meantime, the purpose of this study is to estimate the potential bias from “worst-case” scenarios of selective non-participation, and to examine the extent to which statistical methods can correct for that bias.

↓ Download

Share this
Career call to action image

Work with us

Search jobs

How can we help?

Once you hit send…

We’ll match your inquiry to the person who can best help you.

Expect a response within 48 hours.

Our work

Case studies

Publications

Timeline of innovation

Areas of expertise

Institute

Leadership

Press room

Media inquiries

Compliance

Careers

Job listings

Contact

SRI Ventures

Our locations

Headquarters

333 Ravenswood Ave
Menlo Park, CA 94025 USA

+1 (650) 859-2000

Subscribe to our newsletter


日本支社
SRI International
  • Contact us
  • Privacy Policy
  • Cookies
  • DMCA
  • Copyright © 2023 SRI International
Manage Cookie Consent
To provide the best experiences, we use technologies like cookies to store and/or access device information. Consenting to these technologies will allow us to process data such as browsing behavior or unique IDs on this site. Not consenting or withdrawing consent, may adversely affect certain features and functions.
Functional Always active
The technical storage or access is strictly necessary for the legitimate purpose of enabling the use of a specific service explicitly requested by the subscriber or user, or for the sole purpose of carrying out the transmission of a communication over an electronic communications network.
Preferences
The technical storage or access is necessary for the legitimate purpose of storing preferences that are not requested by the subscriber or user.
Statistics
The technical storage or access that is used exclusively for statistical purposes. The technical storage or access that is used exclusively for anonymous statistical purposes. Without a subpoena, voluntary compliance on the part of your Internet Service Provider, or additional records from a third party, information stored or retrieved for this purpose alone cannot usually be used to identify you.
Marketing
The technical storage or access is required to create user profiles to send advertising, or to track the user on a website or across several websites for similar marketing purposes.
Manage options Manage services Manage {vendor_count} vendors Read more about these purposes
View preferences
{title} {title} {title}