Skip to main content

Phonated Speech Reconstruction Using Twin Mapping Models

Sharifzadeh, Hamid R. and HajiRassouliha, Amir and McLoughlin, Ian V. and Ardekani, Imam and Allen, Jacqueline E. (2016) Phonated Speech Reconstruction Using Twin Mapping Models. In: 2015 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT). IEEE. ISBN 978-1-5090-0480-5. E-ISBN 978-1-5090-0481-2. (doi:10.1109/ISSPIT.2015.7394247) (Access to this publication is currently restricted. You may be able to access a copy if URLs are provided)

PDF - Author's Accepted Manuscript
Restricted to Repository staff only
Contact us about this Publication Download (1MB)
Official URL


Computational speech reconstruction algorithms have the ultimate aim of returning natural sounding speech to aphonic and dysphonic individuals. These algorithms can also be used by unimpaired speakers for communicating sensitive or private information. When the glottis loses function due to disease or surgery, aphonic and dysphonic patients retain the power of vocal tract modulation to some degree but they are unable to speak anything more than hoarse whispers without prosthetic aid. While whispering can be seen as a natural and secondary aspect of speech communications for most people, it becomes the primary mechanism of communications for those who have impaired voice production mechanisms, such as laryngectomees. In this paper, by considering the current limitations of speech reconstruction methods, a novel algorithm for converting whispers to normal speech is proposed and the efficiency of the algorithm is discussed. The proposed algorithm relies upon twin mapping models and makes use of artificially generated whispers (called whisperised speech) to regenerate natural phonated speech from whispers. Through a training-based approach, the mapping models exploit whisperised speech to overcome frame to frame time alignment problem in the speech reconstruction process.

Item Type: Book section
DOI/Identification number: 10.1109/ISSPIT.2015.7394247
Uncontrolled keywords: Speech reconstruction, laryngectomy, laryngectomee, post-laryngectomised, phonation, whispers, statistical voice conversion
Subjects: T Technology
Divisions: Faculties > Sciences > School of Computing
Depositing User: Ian McLoughlin
Date Deposited: 12 Nov 2015 11:54 UTC
Last Modified: 26 Sep 2019 08:27 UTC
Resource URI: (The current URI for this page, for reference purposes)
McLoughlin, Ian V.:
  • Depositors only (login required):


Downloads per month over past year