“Can You Give Me Another Word for Hyperbaric?”: Improving Speech Translation Using Targeted Clarification Questions

SRI author:

Citation

Bansal, M., Sizintsev, M., Eledath, J., Sawhney, H., Pearson, D. J., & Stone, R. A. (2013, 3-7 July). 3D optic disc reconstruction via a global fundus stereo algorithm. Paper presented at the International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC ’13), Osaka, Japan.

Abstract

We present a novel approach for improving communication success between users of speech-to-speech translation systems by automatically detecting errors in the output of automatic speech recognition (ASR) and statistical machine translation (SMT) systems. Our approach initiates system-driven targeted clarification about errorful regions in user input and repairs them given user responses. Our system has been evaluated by unbiased subjects in live mode, and results show improved success of communication between users of the system.


Read more from SRI

  • surgeons around a surgical robot

    The SRI research behind today’s surgical robotics

    Intuitive’s da Vinci 5 system represents a major leap in robotic-assisted medicine. It all started at SRI, which continues to advance teleoperation technologies.

  • a collage of digital graphs

    A banner year for quantum

    SRI-managed QED-C’s annual report on quantum trends captures an industry accelerating rapidly from technical promise toward major global impact.

  • ICE Cube containing SRI’s aerogel experiment, photographed prior to launch. Source: Aerospace Applications North America

    An SRI carbon capture experiment launches into space

    By synthesizing carbon-absorbing aerogels in microgravity, SRI research will give us a rare glimpse into how these materials could be radically improved.