University of Oulu

Zhou, L., Feng, K., Wang, T., Xu, Y., Shi, J. (2021). Binaural Speech Separation Algorithm Based on Deep Clustering. Intelligent Automation & Soft Computing, 30(2), 527–537

Binaural speech separation algorithm based on deep clustering

Saved in:
Author: Zhou, Lin1; Feng, Kun1; Wang, Tianyi1;
Organizations: 1School of Information Science and Engineering, Southeast University, Nanjing, 210096, China
2Center for Machine Vision and Signal Analysis, University of Oulu, Oulu, FI-90014, Finland
Format: article
Version: published version
Access: open
Online Access: PDF Full Text (PDF, 5.4 MB)
Persistent link:
Language: English
Published: Tech Science Press, 2021
Publish Date: 2021-11-11


Neutral network (NN) and clustering are the two commonly used methods for speech separation based on supervised learning. Recently, deep clustering methods have shown promising performance. In our study, considering that the spectrum of the sound source has time correlation, and the spatial position of the sound source has short-term stability, we combine the spectral and spatial features for deep clustering. In this work, the logarithmic amplitude spectrum (LPS) and the interaural phase difference (IPD) function of each time frequency (TF) unit for the binaural speech signal are extracted as feature. Then, these features of consecutive frames construct feature map, which are regarded as the input to the Bi-directional long short-term memory (BiLSTM). The feature maps are converted to the high-dimensional vectors through BiLSTM, which are used to classify the time-frequency units by K-means clustering. The clustering index are combined with mixed speech signal to reconstruct the target speech signal. The simulation results show that the proposed algorithm has a significant improvement in speech separation and speech quality, since the spectral and spatial information are all utilized for clustering. Also, the method is more generalized in untrained conditions compared with traditional NN method e.g., deep neural network (DNN) and convolutional neural networks (CNN) based method.

see all

Series: Intelligent automation & soft computing
ISSN: 1079-8587
ISSN-E: 2326-005X
ISSN-L: 1079-8587
Volume: 30
Issue: 2
Pages: 527 - 537
DOI: 10.32604/iasc.2021.018414
Type of Publication: A1 Journal article – refereed
Field of Science: 113 Computer and information sciences
Funding: This work is supported by the National Key Research and Development Program of China under Grant 2020YFC2004002 and Grant 2020YFC2004003, and the National Nature Science Foundation of China (NSFC) under Grant No. 61571106.
Copyright information: © The Authors 2021. This work is licensed under a Creative Commons Attribution 4.0 International License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.