arXiv Analytics

Sign in

arXiv:1707.01090 [cs.SD]AbstractReferencesReviewsResources

Hidden-Markov-Model Based Speech Enhancement

Daniel Dzibela, Armin Sehr

Published 2017-07-04Version 1

The goal of this contribution is to use a parametric speech synthesis system for reducing background noise and other interferences from recorded speech signals. In a first step, Hidden Markov Models of the synthesis system are trained. Two adequate training corpora consisting of text and corresponding speech files have been set up and cleared of various faults, including inaudible utterances or incorrect assignments between audio and text data. Those are tested and compared against each other regarding e.g. flaws in the synthesized speech, it's naturalness and intelligibility. Thus different voices have been synthesized, whose quality depends less on the number of training samples used, but much more on the cleanliness and signal-to-noise ratio of those. Generalized voice models have been used for synthesis and the results greatly differ between the two speech corpora. Tests regarding the adaptation to different speakers show that a resemblance to the original speaker is audible throughout all recordings, yet the synthesized voices sound robotic and unnatural in smaller parts. The spoken text, however, is usually intelligible, which shows that the models are working well. In a novel approach, speech is synthesized using side information of the original audio signal, particularly the pitch frequency. Results show an increase of speech quality and intelligibility in comparison to speech synthesized solely from text, up to the point of being nearly indistinguishable from the original.

Related articles: Most relevant | Search more
arXiv:2203.13086 [cs.SD] (Published 2022-03-24)
HiFi++: a Unified Framework for Neural Vocoding, Bandwidth Extension and Speech Enhancement
arXiv:2002.04027 [cs.SD] (Published 2020-02-10)
On Cross-Corpus Generalization of Deep Learning Based Speech Enhancement
arXiv:2305.13796 [cs.SD] (Published 2023-05-23)
SE-Bridge: Speech Enhancement with Consistent Brownian Bridge