Noise-robust Exemplar Matching for Rescoring Query-by-Example Search

SRI Authors: Horacio Franco

Citation

E. Yılmaz, J. van Hout, and H. Franco, “Noise-robust Exemplar Matching for Rescoring Query-by-Example Search,” in Proc. ASRU 2017, pp. 1-7, December 2017.

Abstract

This paper describes a two-step approach for keyword spotting task in which a query-by-example (QbE) search is followed by noise robust exemplar matching (N-REM) rescoring.  In the first stage, subsequence dynamic time warping is performed to detect keywords in search utterances.  In the second stage, these target frame sequences are rescored using the reconstruction errors provided by the linear combination of the available exemplars extracted from the training data.  Due to data sparsity, we align the target frame sequence and the exemplars to a common frame length and the exemplar weights are obtained by solving a convex optimization problem with non-negative sparse coding.   We run keyword spotting experiments on the  Air  Traffic  Control  (ATC)  database  and  evaluate  performance of multiple distance metrics for calculating the weights and reconstruction errors using convolutional neural network (CNN) bottleneck features.  The results demonstrate that the proposed two-step keyword spotting approach provides better keyword detection compared to a baseline with only QbE search


Read more from SRI

  • surgeons around a surgical robot

    The SRI research behind today’s surgical robotics

    Intuitive’s da Vinci 5 system represents a major leap in robotic-assisted medicine. It all started at SRI, which continues to advance teleoperation technologies.

  • a collage of digital graphs

    A banner year for quantum

    SRI-managed QED-C’s annual report on quantum trends captures an industry accelerating rapidly from technical promise toward major global impact.

  • ICE Cube containing SRI’s aerogel experiment, photographed prior to launch. Source: Aerospace Applications North America

    An SRI carbon capture experiment launches into space

    By synthesizing carbon-absorbing aerogels in microgravity, SRI research will give us a rare glimpse into how these materials could be radically improved.