• Skip to primary navigation
  • Skip to main content
SRI logo
  • About
    • Press room
    • Our history
  • Expertise
    • Advanced imaging systems
    • Artificial intelligence
    • Biomedical R&D services
    • Biomedical sciences
    • Computer vision
    • Cyber & formal methods
    • Education and learning
    • Innovation strategy and policy
    • National security
    • Ocean & space
    • Quantum
    • QED-C
    • Robotics, sensors & devices
    • Speech & natural language
    • Video test & measurement
  • Ventures
  • NSIC
  • Careers
  • Contact
  • 日本支社
Search
Close
Education & learning publications January 1, 2005

Jason Academy Summative Program Evaluation Final Report

Citation

Copy to clipboard


Bienkowski, M., Penuel, W., Toyama, Y., Molina, A., Hurst, K., & Peck-Theis, L. (2005). JASON Academy summative program evaluation: Final report. Menlo Park, CA: SRI International.

Abstract

Method:

SRI conducted an evaluation study of JASON Academy courses to ascertain whether they are effective in increasing teachers’ content knowledge on topics that they must teach and that are part of most state standards and curriculum frameworks. SRI, in conjunction with JASON Academy staff, selected two JASON Academy courses for study, Structure of the Earth and Forces and Motion. These courses were selected because of the popularity of the courses and their clear connections to teaching standards. Students in one course served as a control for the other course.

SRI’s summative evaluation used a pre-post, comparison-group (quasi-experimental) design with teacher content knowledge as the chief outcome variable of interest. Because treatment and comparison groups were not matched, SRI used statistical controls to account for differences between groups in its analysis. Teacher surveys provided information on levels of participation; data from surveys were matched to assessment data to test the second hypothesis. Both the survey and content knowledge tests were developed by SRI. The content tests were aligned to content standards in the NSES. The surveys and assessments were administered to a total of 4 cohorts of students during the period from February 2, 2004 to November 19, 2004.

SRI, in conjunction with JASON Academy staff, prepared the pre- and post-course survey on teacher background, current teaching practices, and impact of the course on teaching practices. SRI crafted a pre- and post-course assessment for each course that focuses on conceptual understanding of core items in each course as identified in the NSES. The surveys and assessments were administered to a total of 4 cohorts of students.

Results:

Teachers made statistically significant gains in content knowledge, as compared to a control group, after taking the JASON Academy courses. Teachers self-reports indicated that many felt they had achieved their goals of gaining content knowledge and learning new ways to teach the science content as a result of taking the class. For neither of the courses was a correlation between self-reported activity level and gain on the assessment detected. Because the study did not randomly assign teachers to condition, these results cannot provide conclusive evidence that JASON Academy courses caused these gains; however, they do provide promising evidence of efficacy that could be investigated in future studies.

Our survey found that these teachers generally did not take the JASON Academy course in order to be able to incorporate more state or NSES content or process standards into their teaching, although most were familiar with the NSES and some reported feeling more prepared after taking the course. They instead reported goals of understanding science concepts better and gaining curriculum resources for their classroom. When asked to state how the course affected their approach to teaching science, the majority of teachers said that they learned new science content that they could in turn teach to their students. While many did not report feeling strongly that they were more prepared to incorporate NSES into their teaching after the course, they did feel more prepared to teach complex scientific ideas to their students. 43% of the participants said they “very much achieved” an improvement in their skills in incorporating technology into their teaching.

↓ Download

Share this

How can we help?

Once you hit send…

We’ll match your inquiry to the person who can best help you.

Expect a response within 48 hours.

Career call to action image

Make your own mark.

Search jobs

Our work

Case studies

Publications

Timeline of innovation

Areas of expertise

Institute

Leadership

Press room

Media inquiries

Compliance

Careers

Job listings

Contact

SRI Ventures

Our locations

Headquarters

333 Ravenswood Ave
Menlo Park, CA 94025 USA

+1 (650) 859-2000

Subscribe to our newsletter


日本支社
SRI International
  • Contact us
  • Privacy Policy
  • Cookies
  • DMCA
  • Copyright © 2022 SRI International