ASSISTments Efficacy & Replication Studies

ASSISTments Efficacy & Replication Studies

SRI conducted an efficacy study of more than 2,500 students on the benefits of online homework support for students’ mathematics learning


Homework is important, but traditional ways of doing homework in isolation do not support students who need more help. Technology has the potential to change homework into a better learning experience. Students can receive instant feedback, online tutorials, and specially organized “practice makes perfect” sessions. In addition, teachers can receive useful reports on their students’ homework completion status and indications of their problem areas. Through professional development, teachers can learn how to use online homework and these reports to differentiate instruction to meet students’ individual needs.

Funded by the Institute of Education Sciences (IES) of the U.S. Department of Education, SRI Education conducted an efficacy study on the benefits of online homework support for students’ mathematics learning. The 4-year study was conducted in collaboration with Worcester Polytechnic Institute (WPI) and the University of Maine at Orono. Launched in April 2012, the study involved approximately 2,500 seventh grade students from 52 schools in the state of Maine. The goal was to understand the impact of the ASSISTments online homework support on student achievement, classroom implementation, and teacher practice.

This study was the first gold standard-quality study in the United States on the use of online homework in middle school mathematics learning. Maine was selected because of its exceptional laptop program and its focus on improving mathematics achievement. SRI measured the benefit to students’ mathematics achievement from online homework, looking at improvement both on required state tests and against national benchmarks. We sought to understand if all students benefitted from online learning, or if online learning worked best for a specific set of students. We also wanted to understand what were the best ways that teachers could use homework to benefit students the most.

This study found a statistically significant, positive impact of ASSISTments on students’ mathematics achievement, and the impact is stronger for lower-performing students versus higher-performing students, thus narrowing the achievement gap. Although evidence showed that teachers used the intervention to target instruction to students’ needs, the mediating role of this practice was unclear.

SRI is currently a subcontractor to WestED on a 4-year replication of the ASSISTments efficacy study in the North Carolina public schools to generate additional evidence, funded by IES and in collaboration with Worcester Polytechnic Institute (WPI) and the North Carolina State University. This new study involved 63 public schools in North Carolina with approximately 4,000 students enrolled in seventh grade mathematics. North Carolina was chosen because its diverse demographics closely match national demographics and could be examined for its different impacts of traditional achievement gaps among students. This study was conducted with a typical professional development approach (with training of local coaches) rather than the centralized approach used in Maine (professional development by one expert coach). Implementation was completed at the end of spring 2020, and the researchers are analyzing the impact of ASSISTments on students’ mathematics achievement.

Associated fields of research

Clients & partners

Our work

  • Assisting Parents to Review Online Videos for Education (APPROVE)

    Assisting Parents to Review Online Videos for Education (APPROVE)

    Researchers at SRI International developed an AI-powered YouTube filter that finds educational videos for kindergarten and prekindergarten children, including math videos and reading videos.

  • ASSISTments Efficacy & Replication Studies

    ASSISTments Efficacy & Replication Studies

    SRI conducted an efficacy study of more than 2,500 students on the benefits of online homework support for students’ mathematics learning Homework is important, but traditional ways of doing homework in isolation do not support students who need more help. Technology has the potential to change homework into a better learning experience. Students can receive…

  • Evaluation of the Apple and ConnectED Initiative

    Evaluation of the Apple and ConnectED Initiative

    The six-year independent research study conducted by SRI International across 101 schools aimed to combine rigorous measurement of ConnectED’s outcomes and accomplishments with an in-depth look at what it has meant for participating teachers, students, principals and parents.

Associated SRI team members

haiwen-wang-bio-pic

Haiwen Wang

Senior Principal Education Researcher and Evaluation Methods Lead


Read more from SRI