What Will People Say? Speech System Design and Language/Cultural Differences

Citation

Precoda, K., & Podesva, R. J. What will people say? Speech system design and language/cultural differences [speech recognition]. In 2003 IEEE Workshop on Automatic Speech Recognition and Understanding (IEEE Cat. No. 03EX721) (pp. 624-629). IEEE.

Abstract

This paper evaluates the effectiveness of three speech system design strategies in Pashto, a little-studied language of Afghanistan and Pakistan, drawing comparisons with English where possible. The strategies discussed are using (1)promotes at the ends of questions to constrain user responses, (2) specific lexical items in system prompts to encourage user echoing, and (3) introspection as a method for building recognition grammars.  It was found that Pashto speakers were strikingly less influenced by system utterances than American English speakers were, and that introspection grammars, even though constructed by a speaker with unusually broad dialect exposure, had both many too many, and a few too few, choices. We conclude that the effectiveness of these and perhaps other design strategies, many of which derive from work on English, may vary along linguistic or cultural lines, and new strategies may need to be explored for languages where these do not work well. 


Read more from SRI

  • An arid, rural Nevada landscape

    Can AI help us find valuable minerals?

    SRI’s machine learning-based geospatial analytics platform, already adopted by the USGS, is poised to make waves in the mining industry.

  • Two students in a computer lab

    Building a lab-to-market pipeline for education

    The SRI-led LEARN Network demonstrates how we can get the best evidence-based educational programs to classrooms and students.

  • Code reflected in a man's eyeglasses

    LLM risks from A to Z

    A new paper from SRI and Brazil’s Instituto Eldorado delivers a comprehensive update on the security risks to large language models.