SRI author: Kathryn Morrison Abstract The DEC Position Statement on low birth weight (LBW) and prematurity summarized developmental outcomes of these infants and provided evidence of the positive impact of early intervention and family engagement. This session will discuss current Part C state eligibility definitions related to LBW and prematurity and their alignment with DEC […]
Education & learning publications
Evaluation of Los Angeles City College’s STEM Pathways Program: Impacts of STEM Pathways Program Participation on Student Outcomes
Los Angeles City College launched the STEM Pathways program in 2016 with funding from the U.S. Department of Education. The intent of the STEM Pathways program was to improve STEM degree completion and transfer to 4-year colleges, particularly for low-income and Latinx students. The program offered a variety of supports including Supplemental Instruction (SI), peer tutoring in STEM, a book and technology loan program, specialized counseling, a math boot camp, and an undergraduate research experience. This report presents findings from a quasi-experimental study estimating the impact of STEM Pathways program participation on STEM course success and continuation in STEM, as well as degree attainment. SRI found positive and statistically significant results for continuation in STEM and STEM credits earned.
Evaluation of Los Angeles City College’s STEM Pathways Program: Impacts of the Supplemental Instruction Program on Student Outcomes
Los Angeles City College launched the STEM Pathways program in 2016 with funding from the U.S. Department of Education. The intent of the STEM Pathways program was to improve students’ STEM degree completion and transfer to 4-year colleges, particularly for low-income and Latinx students. The program provided a variety of supports including Supplemental Instruction (SI) for key STEM courses. This report presents findings from a quasi-experimental study estimating the impact of SI participation on STEM course success and continuation in STEM. SRI found positive and statistically significant results for focal course passing, focal course grade, and continuation in STEM.
Designing Virtual Internships in STEM Fields: Innovations and Lessons Learned from Summer 2020
In spring 2020, at the outset of the pandemic, some intrepid employers quickly converted internships to virtual experiences rather than canceling them. SRI’s STEM Core Expansion Alliance evaluation team took advantage of this unprecedented growth in remote internships in STEM fields to capture innovations and lessons learned from these improvised programs.
SRI investigated employers’ strategies for recruiting, mentoring, and supporting remote interns. The team examined whether and how students used employer supports and what they gained from networking and professional learning opportunities in the virtual context. SRI paid particular attention to strategies for making virtual internships more accessible and equitable for all students and for diversifying intern cohorts.
The team used results from surveys of and interviews with employers and interns to develop guidance for employers. The resulting report offers a rich, cross-sector look at what STEM employers learned from their experiences and clearly conveys how they can improve their virtual internship programs in the future.
Evaluation During Disruptions: Course Corrections and Other Considerations
SRI Authors: Margaret Gillis Abstract What should you do when a large-scale disruption makes your evaluation impossible to implement as planned? Evaluators across the nation are facing this problem as a result of the extraordinary circumstances associated with the COVID-19 pandemic. However, disruptions can also occur due to hurricanes, earthquakes, wildfires, floods, as well as […]
The Apple and ConnectED Initiative: Three Case Stories
These case stories intend to give an in-depth look at each school’s setting and the details of how ConnectED unfolded in each of the following places: Compton, California; Tuskegee, Alabama; and Orondo, Washington.
How a Researcher Learns from Practice
SRI Authors: Michelle W. Woodbridge
Evaluation of the College, Career, and Community Writers Program: Findings from the i3 Scale-up Grant
The National Writing Project’s (NWP) College, Career, and Community Writers Program (C3WP) is designed to improve students’ argument writing through intensive teacher professional development, instructional resources, and formative assessment. In 2016, based on evidence of C3WP’s prior success in improving student achievement, NWP received a federal Investing in Innovation (i3) Scaleup grant to test C3WP in new contexts.
From Research to Market: Development of a Transition Process to Integrate Sustainable Scaling Methodologies into Education Innovation Research Design and Development
Even when innovations have rigorous evidence of impact, they often are not widely adopted by the field, or their use is not sustained. To support more successful transitions of educational research to the field, SRI researchers modified its Invent-Apply-Transition (I-A-T) framework, that has been successfully used to scale research to practice in healthcare, enterprise software, and robotics, to educational contexts based on the experiences of an Advisory Council and Expert Panel Members, all with direct experience successfully scaling educational innovations. SRI began this project by conducting a brief literature scan to identify common themes that education researchers employed in effective scale-up strategies. SRI researchers conducted semi-structured interviews with the four Advisory Council and nine Expert Panel members to gather feedback from experts in the field who have successfully scaled educational innovations on the I-A-T framework, and then used their feedback to make relevant modifications. This report introduces the I-A-T framework and how it has been modified to educational contexts. The report also describes an Embedded Entrepreneur Program model that could be used to support Institute of Education Sciences (IES) grantees to increase their probability of scaling and transitioning their innovations to the educational market by helping them analyze their needs hypotheses, product-user fit, stakeholder mapping, market differentiation, product market fit, and scaling pathway hypotheses. Our initial findings suggest that education researchers and innovators could especially benefit from attending more to three factors: (1) the feasibility/usability of the innovation (the “Convenience” component of the Performance, Reliability, Convenience, Cost [PRCC] approach), and how it would be incorporated into the operating environment of the school and district; (2) an understanding of the scope of the innovation (i.e., whether it is a product or a feature); and (3) early identification of a commercialization strategy that is aligned with the scope of the innovation. The report explains how educational researchers can benefit from following the steps outlined in the modified I-A-T framework and collaborating with entrepreneurs with demonstrated skills and dedicated time for scaling innovations. The following appendices are included: a detailed description of the I-A-T framework, a description of the Embedded Entrepreneur Pilot Program, and a literature scan.
Evaluation of Los Angeles City College’s STEM Pathways Program: Impacts of the STEM Learning Center on Student Outcomes
Los Angeles City College launched the STEM Pathways program in 2016 with funding from the U.S. Department of Education. The intent of the STEM Pathways program was to improve students’ STEM degree completion and transfer to 4-year colleges, particularly for low-income and Latinx students, through a variety of supports. The STEM Learning Center, a drop-in peer tutoring program offering students assistance in STEM courses, was one of the grant’s most-used supports. This report presents findings from a quasi-experimental study to estimate the impact of the STEM Learning Center on STEM course success and continuation in STEM. SRI found positive effects of STEM Learning Center participation on students’ STEM outcomes, in terms of increased STEM credits and STEM continuation.
Measuring the Impact of Trauma-Focused, Cognitive Behavioral Group Therapy with Middle School Students
This study examines differential effects of the Cognitive Behavioral Intervention for Trauma in Schools (CBITS) program on behavioral and academic outcomes of middle school students. Researchers administered screenings to grade 6 students to assess traumatic stress and then randomized those with elevated levels to the CBITS treatment ( n = 150) or comparison group ( n = 143). Analyses examined the overall impact of CBITS and differential effects among subpopulations of students who reported clinically significant externalizing ( n = 73) or internalizing behavior ( n = 181) at baseline. Results demonstrated that relative to counterparts in the comparison group, externalizers in CBITS reported significantly reduced post-traumatic stress, anxiety, anger, internalizing and externalizing problems, and total behavior problems, and they also significantly improved scores on a standardized literacy assessment at posttest. Students with internalizing behavior problems showed differential academic effects at 1-year follow-up; those in CBITS did significantly better on standardized math tests but significantly worse on a reading subtest than their counterparts.
Early Childhood Throughout the COVID-19 Pandemic: The Experiences of Arkansas Educators
The COVID-19 pandemic has transformed the experiences of young children and their caregivers over the past year. SRI Education and the National Center on Children in Poverty partnered with the Arkansas Division of Child Care and Early Childhood Education (DCCECE) to examine early care and education programs throughout the COVID-19 pandemic. This brief, which represents the second of two reports, highlights findings from a second sample of Arkansas (AR) educators who completed surveys and focus groups in spring 2021. It includes information similar to the first report and provides additional information related to vaccination, supports for students with disabilities, and educators’ plans for moving forward.
Our representative survey of Arkansas early educators found that:
The AR early educators who participated in the fall 2020 and spring 2021 studies were consistent in reporting high compliance and agreement with COVID-19 pandemic procedures.
Nearly all AR early childhood educators reported that they changed practices in response to COVID & will continue to implement one or more of these changes even after restrictions are lifted.
Some ECE teachers reported concerns related to children’s ability to focus their attention during group activities and engage in cooperative play.
ECE program directors reported the greatest interest in receiving additional information about vaccines to share with children’s families; ECE teachers reported the greatest interest in whether ECE staff will be required to get the COVID-19 vaccine.
Both ECE directors and teachers also indicated that having someone with expert knowledge to discuss their individual concerns would motivate early educators to become vaccinated.
Scaling Up Coolthink@JC Implementation Study Baseline Report
CoolThink@JC aims to nurture students’ proactive use of technologies for social good from a young age, preparing them for a fast-changing digital future through hands-on, minds-on, and joyful learning experiences. After a successful pilot in 32 schools, CoolThink’s co-creators, led by the Hong Kong Jockey Club Charities Trust (HKJC), have undertaken an ambitious initiative to take CoolThink to scale within Hong Kong, supporting high-quality adoption in 200 primary schools and laying a foundation throughout the system for more widespread adoption. By demonstrating success at scale, CoolThink partners hope to create a new paradigm for CTE at the upper primary level that will serve as an international model for other cities and states.
To capture the lessons learned from this effort, HKJC has engaged SRI International to study the implementation of CoolThink at scale. This implementation study will:
Assess the extent to which schools’ adoption of CoolThink is consistent with the initiative’s design principles and sustained over time,
Identify the conditions that support or impede successful adoption at the classroom and school levels, and
Validate an implementation model that will help interested stakeholders to learn from CoolThink’s scaling experience.
CoolThink partners began scaling CoolThink in summer 2020, when a third cohort of 47 schools joined the first two pilot cohorts in teaching CoolThink lessons. Drawing on data from teacher and school leader surveys administered between November 2020 and January 2021, this baseline report sets the context for the rollout of CoolThink in Cohort 3 schools.
This report is the first in a series from an implementation study being conducted by SRI International (SRI). The purpose of the study is to help stakeholders understand how CoolThink is taking shape in classrooms, schools, and systems, and to offer models for other initiatives as they seek to go to scale. This baseline report, based on surveys of school leaders and teachers prior to their implementation of CoolThink, focuses on conditions for success.
Mid-Scale Research Infrastructure for STEM Education
SRI convened diverse stakeholders in workshops about midscale research infrastructure for STEM education. Participants discussed challenges and opportunities for transforming our STEM education system and what infrastructure is needed to support necessary research.
Maintaining Momentum of 1:1 Programs: Observations from the Apple and ConnectED Initiative
The Apple and ConnectED Initiative provides valuable lessons for practitioners, policymakers, and researchers about what it takes to sustain 1:1 programs in schools serving high concentrations of students facing socioeconomic barriers. SRI’s 6-year study of the initiative illuminates how key factors and conditions came together in some schools to keep their programs going and reveals some important lessons for future endeavors.
Experience has shown that sustaining the progress of 1:1 programs in schools serving under-resourced communities is hard, as technology requires upkeep and the initial burst of focused energy sparked by new initiatives can dissipate. The Apple and ConnectED Initiative was designed with an intentional approach to building a foundation for continued use of technology and to create conditions that would set school communities on a new learning trajectory, leading to continued deepening and expansion of technology use in classrooms. This vision of sustainability involved ramping up the provision of technology and integration support as schools were ready and then removing these scaffolds gradually to allow schools to assume local ownership of their 1:1 programs.
Through SRI International’s (SRI) 6-year study of the initiative, the Apple and ConnectED Initiative provided a unique opportunity to observe how sustainability played out across many schools over an extended time period. This report describes findings from the research about the strategies that schools used to address inevitable challenges to sustainability and what factors and conditions appeared to make a difference. It further addresses the dynamic relationship among these factors and conditions, which can lead to positive reinforcement.
Schools that appeared to maintain momentum of their 1:1 initiatives demonstrated a broad commitment to the program and shared vision for how technology could support instructional goals, strong leadership (often but not exclusively from the principal’s office), and community support. This shared commitment and leadership made it possible to put plans in place for mobilizing resources and devising ways to keep the program going. The continued use of technology and, in some cases, continued growth in practices and community engagement using iPad devices, produced visible benefits for key stakeholders which in turn helped to reinforce commitment.
