Lexical Stress Classification for Language Learning Using Spectral and Segmental Features

, , , ,

Citation

Ferrer, L., Bratt, H., Richey, C., Franco, H., Abrash, V., & Precoda, K. (2014, May). Lexical stress classification for language learning using spectral and segmental features. In 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (pp. 7704-7708). IEEE.

Abstract

We present a system for detecting lexical stress in English words spoken by English learners.  The system uses both spectral and segmental features to detect three levels of stress for each syllable in a word.  The segmental features are computed on the vowels and include normalized energy, pitch, spectral tilt and duration measurements. The spectral features are computed at the frame level and are modeled by one Gaussian Mixture Model (GMM) for each stress class.  These GMMs are used to obtain segmental posteriors, which are then appended to the segmental features to obtain a final set of GMMs.  The segmental GMMs are used to obtain posteriors for each stress class. The system was tested on English speech from native English-speaking children and from Japanese-speaking children with variable levels of English proficiency.  Our algorithm results in an error rate of approximately 13% on native data and 20%on Japanese non-native data.

Keywords: Stress, Adaptation models, Feature extraction, Computational modeling, Hidden Markov models, Data models, Speech.


Read more from SRI

  • Banner and attendees at the IEEE Hard Tech Venture Summit

    Cultivating hard tech startups that scale

    IEEE’s Hard Tech Venture Summit convened innovators at SRI to refine strategies and build new networks.

  • Patient going into a MRI

    Bringing surgical tools inside the MRI

    Drawing on SRI’s unique innovation ecosystem, the startup Medical Devices Corner is seeking to improve cancer surgery by advancing MRI-safe teleoperation.

  • Christopher Mims and Susan Patrick

    PARC Forum: How to AI

    The Wall Street Journal tech columnist Christopher Mims and SRI Education’s Susan Patrick discuss how AI can strengthen human agency.