• Skip to primary navigation
  • Skip to main content
SRI logo
  • About
    • Press room
    • Our history
  • Expertise
    • Advanced imaging systems
    • Artificial intelligence
    • Biomedical R&D services
    • Biomedical sciences
    • Computer vision
    • Cyber & formal methods
    • Education and learning
    • Innovation strategy and policy
    • National security
    • Ocean & space
    • Quantum
    • Robotics, sensors & devices
    • Speech & natural language
    • Video test & measurement
  • Ventures
  • NSIC
  • Careers
  • Contact
  • 日本支社
Search
Close
Teaching quality publications July 1, 2015

Case Study Brief: Promising Practices to Build Evaluator Capacity

Citation

Copy to clipboard


Comstock, M., & Hsieh, T. (2015). Promising Practices to Build Evaluator Capacity. Case study brief. Menlo Park: SRI International.

Abstract

In 2012, the Massachusetts Department of Elementary and Secondary Education contracted with SRI International and its research partners, Abt Associates, Nancy Brigham Associates, and J Koppich and Associates, to conduct an independent study of the implementation of Massachusetts’ Educator Evaluation Framework. During the 2014-15 school year, the research team administered a statewide survey of principals and school staff and conducted educator interviews and focus groups in seven case study districts. In the case study districts, the team focused on exploring promising practices related to use of evaluation data for human resources decisions, implementation of district-determined measures (DDMs) of student learning, and capacity of evaluators to conduct fair and thorough evaluations. This brief is the third in a three-part series dedicated to sharing these promising practices with other districts in Massachusetts.

The case study brief highlights three districts’ (Revere, West Springfield, and Northbridge Public Schools) efforts to calibrate evaluators’ feedback and ratings for school staff and to reduce evaluators’ workloads associated with the new evaluation system. These districts have implemented promising strategies to promote evaluator consistency within and across schools and to relieve burden on evaluators, including analyzing anonymized feedback and teacher videos and revisiting district guidelines on observations, though these areas remain a challenge. Findings from these case studies may be useful for other districts:

  1. Districts provided varied and ongoing opportunities for evaluators across schools to become consistent in their understanding of the performance rating levels and in their manner of providing feedback. They supplemented these efforts with formal and informal collaboration among evaluators at the same schools. Implementing this holistic approach helped ensure that all educators receive clear communications about evaluator expectations for feedback and timing of observations and ultimately heightens educators’ perceptions of the system’s fairness overall.
  2. Districts used technology in a variety of ways to increase consistency across evaluators in the feedback and ratings that they provided to educators.
  3. District administrators served as additional evaluators, and the district adjusted guidelines for the quantity of observations and evidence—strategies that helped to ease evaluator burden.

This brief outlines a series of promising strategies from the three districts for increasing consistency in evaluator practices and reducing evaluator workload, two issues with the EEF that continue to challenge districts across the Commonwealth. In fact, in a recent statewide survey of educators conducted as part of this study, 81 percent of staff agreed or strongly agreed that their evaluator’s assessment of their own practice was fair, but 58 percent disagreed or strongly disagreed that educators were evaluated consistently across grades, subjects, and schools. Furthermore, 72 percent of principals disagreed or strongly disagreed that they had adequate time to evaluate
teachers at their school. The brief begins with a description of a holistic approach for achieving evaluator consistency and then describes methods for relieving evaluator burden. The brief ends with a set of considerations for other districts that are looking for ways to improve the capacity of their evaluators to conduct fair and consistent evaluations under the new system.

↓ Download

Share this
Career call to action image

Work with us

Search jobs

How can we help?

Once you hit send…

We’ll match your inquiry to the person who can best help you.

Expect a response within 48 hours.

Our work

Case studies

Publications

Timeline of innovation

Areas of expertise

Institute

Leadership

Press room

Media inquiries

Compliance

Careers

Job listings

Contact

SRI Ventures

Our locations

Headquarters

333 Ravenswood Ave
Menlo Park, CA 94025 USA

+1 (650) 859-2000

Subscribe to our newsletter


日本支社
SRI International
  • Contact us
  • Privacy Policy
  • Cookies
  • DMCA
  • Copyright © 2023 SRI International
Manage Cookie Consent
To provide the best experiences, we use technologies like cookies to store and/or access device information. Consenting to these technologies will allow us to process data such as browsing behavior or unique IDs on this site. Not consenting or withdrawing consent, may adversely affect certain features and functions.
Functional Always active
The technical storage or access is strictly necessary for the legitimate purpose of enabling the use of a specific service explicitly requested by the subscriber or user, or for the sole purpose of carrying out the transmission of a communication over an electronic communications network.
Preferences
The technical storage or access is necessary for the legitimate purpose of storing preferences that are not requested by the subscriber or user.
Statistics
The technical storage or access that is used exclusively for statistical purposes. The technical storage or access that is used exclusively for anonymous statistical purposes. Without a subpoena, voluntary compliance on the part of your Internet Service Provider, or additional records from a third party, information stored or retrieved for this purpose alone cannot usually be used to identify you.
Marketing
The technical storage or access is required to create user profiles to send advertising, or to track the user on a website or across several websites for similar marketing purposes.
Manage options Manage services Manage {vendor_count} vendors Read more about these purposes
View preferences
{title} {title} {title}