• Skip to primary navigation
  • Skip to main content
SRI logo
  • About
    • Press room
    • Our history
  • Expertise
    • Advanced imaging systems
    • Artificial intelligence
    • Biomedical R&D services
    • Biomedical sciences
    • Computer vision
    • Cyber & formal methods
    • Education and learning
    • Innovation strategy and policy
    • National security
    • Ocean & space
    • Quantum
    • Robotics, sensors & devices
    • Speech & natural language
    • Video test & measurement
  • Ventures
  • NSIC
  • Careers
  • Contact
  • 日本支社
Search
Close
Project June 7, 2021

Analysis of NAEP Mathematics Process, Outcome, and Survey Data to Understand Test-Taking Behavior and Mathematics Performance of Learners with Disabilities


This project uses innovative statistical and machine learning techniques to understand the differences in test-taking processes of students with and without disabilities.


Researchers from SRI, in partnership with colleagues from the University of Illinois, Urbana-Champaign, received funding from the Institute of Education Sciences to examine National Assessment of Education Progress (NAEP) process, outcome, and survey data to understand the test-taking behavior and mathematics performance of learners with and without disabilities.

The NAEP process data record the series of clicks, entries, and timestamps during test takers’ interactions with the test items. By analyzing process data, the SRI research team can examine the key components of test-taking behavior of learners with disabilities and uncover patterns that would not be apparent if using outcome or survey data alone. We will use innovative machine learning approaches coupled with expert review to:

  • Extract meaningful patterns from process data to reflect key components of students’ mathematics test-taking behavior (i.e., math cognitive process, time on task, level of engagement, and accommodation usage).
  • Examine how test-taking behavior differs by students’ disability status.
  • Identify patterns of test-taking behavior that lead to successful performance on the NAEP mathematics grade 8 assessment.
  • Investigate the association between test-taking behaviors and test performance for students with disabilities and students without disabilities.

In addition, the SRI research team will use structural equation modeling (SEM) to understand the degree to which the interrelationships among math instruction, performance, and key components of testing behavior (i.e., math cognitive process, time on task, level of engagement, and accommodation usage) differ by students’ disability status.

The findings of this study will provide important insights about the test taking behavior of students with disabilities and their cognitive processes, time on task, level of engagement, and accommodation usage during their interactions with a digital assessment. Results may also reveal helpful strategies that students with disabilities can use to solve math problems, and features of digital assessments that increase engagement and accessibility and provide more equitable and accurate measures of the performance of students with different abilities.

The research reported here was supported by the Institute of Education Sciences, U.S. Department of Education, through Grant R324P210005 to SRI International. The opinions expressed are those of the authors and do not represent views of the Institute or the U.S. Department of Education.

Share this
Career call to action image

Work with us

Search jobs

How can we help?

Once you hit send…

We’ll match your inquiry to the person who can best help you.

Expect a response within 48 hours.

Our work

Case studies

Publications

Timeline of innovation

Areas of expertise

Institute

Leadership

Press room

Media inquiries

Compliance

Careers

Job listings

Contact

SRI Ventures

Our locations

Headquarters

333 Ravenswood Ave
Menlo Park, CA 94025 USA

+1 (650) 859-2000

Subscribe to our newsletter


日本支社
SRI International
  • Contact us
  • Privacy Policy
  • Cookies
  • DMCA
  • Copyright © 2023 SRI International
Manage Cookie Consent
To provide the best experiences, we use technologies like cookies to store and/or access device information. Consenting to these technologies will allow us to process data such as browsing behavior or unique IDs on this site. Not consenting or withdrawing consent, may adversely affect certain features and functions.
Functional Always active
The technical storage or access is strictly necessary for the legitimate purpose of enabling the use of a specific service explicitly requested by the subscriber or user, or for the sole purpose of carrying out the transmission of a communication over an electronic communications network.
Preferences
The technical storage or access is necessary for the legitimate purpose of storing preferences that are not requested by the subscriber or user.
Statistics
The technical storage or access that is used exclusively for statistical purposes. The technical storage or access that is used exclusively for anonymous statistical purposes. Without a subpoena, voluntary compliance on the part of your Internet Service Provider, or additional records from a third party, information stored or retrieved for this purpose alone cannot usually be used to identify you.
Marketing
The technical storage or access is required to create user profiles to send advertising, or to track the user on a website or across several websites for similar marketing purposes.
Manage options Manage services Manage {vendor_count} vendors Read more about these purposes
View preferences
{title} {title} {title}