Skip to main content

Representing Nonspeech Audio Signals through Speech Classification Models

Phan, Huy, Hertel, Lars, Maass, Marco, Mazur, Radoslaw, Mertins, Alfred (2015) Representing Nonspeech Audio Signals through Speech Classification Models. In: 16th Annual Conference of the International Speech Communication Association (INTERSPEECH 2015). . pp. 3441-3445. ISCA, Dresden, Germany (KAR id:72688)

PDF Author's Accepted Manuscript
Language: English
Download (246kB) Preview
[img]
Preview
Official URL
https://www.isca-speech.org/archive/interspeech_20...

Abstract

The human auditory system is very well matched to both human speech and environmental sounds. Therefore, the question arises whether human speech material may provide useful information for training systems for analyzing nonspeech audio signals, such as in a recognition task. To find out how similar nonspeech signals are to speech, we measure the closeness between target nonspeech signals and different basis speech categories via a speech classification model. The speech similarities are finally employed as a descriptor to represent the target signal. We further show that a better descriptor can be obtained by learning to organize the speech categories hierarchically with a tree structure. We conduct experiments for the audio event analysis application by using speech words from the TIMIT dataset to learn the descriptors for the audio events of the Freiburg-106 dataset. Our results on the event recognition task outperform those achieved by the best system even though a simple linear classifier is used. Furthermore, integrating the learned descriptors as an additional source leads to improved performance.

Item Type: Conference or workshop item (Proceeding)
Divisions: Faculties > Sciences > School of Computing
Depositing User: Huy Phan
Date Deposited: 25 Feb 2019 16:38 UTC
Last Modified: 03 Jun 2019 09:28 UTC
Resource URI: https://kar.kent.ac.uk/id/eprint/72688 (The current URI for this page, for reference purposes)
Phan, Huy: https://orcid.org/0000-0003-4096-785X
  • Depositors only (login required):

Downloads

Downloads per month over past year