Brain-To-Speech: Direct Synthesis of Speech from Intracranial Brain Activity Associated with Speech Production
Brain-Computer Interfaces (BCI) that process natural speech present a very intuitive paradigm for human-machine interaction and offer direct machine-mediated human communication and could thus restore communication for speech disabled users. Invasively-measured brain activity, especially electrocorticography (ECoG) is well-suited for the purpose of investigating and decoding articulatory gestures, phonetic features], phonemes, words and continuous sentences. This method presents the first direct synthesis of comprehensible acoustics only from areas involved in speech production. This is especially important as these areas are likely to display similar activity patterns during attempted speech production, as would occur for locked-in patients. In summary, Brain-To-Speech could give back a voice and natural means of conversation for paralyzed patients.
Christian Herff 1, Lorenz Diener 1, Emily Mugler 3, Marc Slutzky 3, Dean Krusienski 2, Tanja Schultz 1
1 Cognitive Systems Lab, University of Bremen, Germany.
2 ASPEN Lab, Old Dominion University, Norfolk, USA.
3 Departments of Neurology, Physiology, and Physical Medicine & Rehabilitation, Northwestern University, Chicago, USA.
BCI Award: [ Ссылка ]
