A phonetic model of non-native spoken word processing

Yevgen Matusevych, Herman Kamper, Thomas Schatz, Naomi Feldman, Sharon Goldwater

Multilinguality Long paper Paper

Zoom-4B: Apr 22, Zoom-4B: Apr 22 (08:00-09:00 UTC) [Join Zoom Meeting]
Gather-3E: Apr 23, Gather-3E: Apr 23 (13:00-15:00 UTC) [Join Gather Meeting]

You can open the pre-recorded video in separate windows.

Abstract: Non-native speakers show difficulties with spoken word processing. Many studies attribute these difficulties to imprecise phonological encoding of words in the lexical memory. We test an alternative hypothesis: that some of these difficulties can arise from the non-native speakers' phonetic perception. We train a computational model of phonetic learning, which has no access to phonology, on either one or two languages. We first show that the model exhibits predictable behaviors on phone-level and word-level discrimination tasks. We then test the model on a spoken word processing task, showing that phonology may not be necessary to explain some of the word processing effects observed in non-native speakers. We run an additional analysis of the model's lexical representation space, showing that the two training languages are not fully separated in that space, similarly to the languages of a bilingual human speaker.
NOTE: Video may display a random order of authors. Correct author list is at the top of this page.

Connected Papers in EACL2021

Similar Papers

Do we read what we hear? Modeling orthographic influences on spoken word recognition
Nicole Macher, Badr Abdullah, Harm Brouwer, Dietrich Klakow,
Disambiguatory Signals are Stronger in Word-initial Positions
Tiago Pimentel, Ryan Cotterell, Brian Roark,
Subword Pooling Makes a Difference
Judit Ács, Ákos Kádár, Andras Kornai,
"Talk to me with left, right, and angles": Lexical entrainment in spoken Hebrew dialogue
Andreas Weise, Vered Silber-Varod, Anat Lerner, Julia Hirschberg, Rivka Levitan,