基于特征流融合的带噪语音检测算法

doi:10.11959/j.issn.1000-436x.2020067

通信学报 ›› 2020, Vol. 41 ›› Issue (4): 134-142.doi: 10.11959/j.issn.1000-436x.2020067

基于特征流融合的带噪语音检测算法

龙华,杨明亮(),邵玉斌

昆明理工大学信息工程与自动化学院，云南昆明 650031

修回日期:2020-03-12 出版日期:2020-04-25 发布日期:2020-04-30
作者简介:龙华（1963- ），女，回族，云南大理人，博士，昆明理工大学教授，主要研究方向为无线网络及音频信号处理|杨明亮（1994- ），男，四川宜宾人，昆明理工大学硕士生，主要研究方向为音频信号处理、语音识别|邵玉斌（1970- ），男，云南曲靖人，昆明理工大学教授，主要研究方向为移动通信和个人通信系统以及信号处理
基金资助:
国家自然科学基金资助项目(61761025)

Noisy voice detection algorithm based on feature stream fusion

Hua LONG,Mingliang YANG(),Yubin SHAO

Faculty of Information Engineering and Automation,Kunming University of Science and Technology,Kunming 650031,China

Revised:2020-03-12 Online:2020-04-25 Published:2020-04-30
Supported by:
The National Natural Science Foundation of China(61761025)

摘要/Abstract

摘要：

针对语音通话中语音段的起始检测性能不佳，检测语音连续性结构受到破坏的问题，提出了一种基于特征流融合的带噪语音检测算法。首先，根据语音特性分别提取时域特征流、谱图特征流和统计特征流；其次，利用不同的语音特征流分别对带噪音频中的语音段进行概率估测；最后，将各个特征流估测得到的语音估测概率进行加权融合，并利用隐马尔可夫模型对语音估测概率进行短时状态处理。通过对复合语音数据库在多类型噪声与不同信噪比条件下的性能测试表明，所提算法相对于基于贝叶斯与 DNN 分类器的基线模型相比，语音检测正确率分别提高了21.26%与11.01%，显著提高了目标语音的质量。

关键词: 语音通话, 语音检测, 特征流融合, 隐马尔可夫模型

Abstract:

Aiming at the problem that the initial detection performance of voice segment was poor,and the voice continuity structure was damaged in voice communication,a noisy voice detection algorithm based on feature stream fusion was proposed.Firstly,the time domain feature stream,the spectral pattern feature stream and the statistical feature stream were extracted according to the voice characteristics.Secondly,the voice segment in the noisy audio was estimated by different voice feature streams.Finally,the voice prediction probability obtained by each feature stream was weighted and fused,and the voice estimation probability was processed in short time by the hidden Markov model.The performance test of composite voice database under the condition of multi-type noise and different signal-to-noise ratio shows that compared with the baseline model based on Bayesian and DNN classifier,the voice detection accuracy of the proposed algorithm is improved by 21.26% and 11.01% respectively,and the quality of target voice is significantly improved.

Key words: voice communication, voice detection, feature stream fusion, hidden Markov model

中图分类号:

TP391.42

龙华,杨明亮,邵玉斌. 基于特征流融合的带噪语音检测算法[J]. 通信学报, 2020, 41(4): 134-142.

Hua LONG,Mingliang YANG,Yubin SHAO. Noisy voice detection algorithm based on feature stream fusion[J]. Journal on Communications, 2020, 41(4): 134-142.

图/表 10

图1

表1

表2

表3

表4

表5

图2

图3

图4

图5

参考文献 22

[1]	WEI J , SUN X . Research on speech endpoint detection algorithm with low SNR[J]. Open Access Library Journal, 2017,4(3): 1-8.
[2]	LI Q , XIE H E , ZHENG Q J ,et al. The voice activity detection algorithm based on spectral entropy and high-order statistics[J]. Applied Mechanics and Materials, 2014(624): 495-499.
[3]	PALIWAL K K , WOJCICKI K , SCHWERIN B ,et al. Single-channe speech enhancement using spectral subtraction in the short-time modulation domain[J]. Speech Communication, 2010,52(5): 450-475.
[4]	MENDELEV V , PRISYACH T , PRUDNIKOV A ,et al. Robust voice activity detection with deep maxout neural networks[J]. Mathematical Models and Methods in Applied Sciences, 2015,9(8): 153-159.
[5]	LENGERICH C , HANNUN A . An end-to-end architecture for keyword spotting and voice activity detection[J]. arXiv Preprint,arXiv:1611.09405, 2016
[6]	IVRY A , BERDUGO B , COHEN I ,et al. Voice activity detection for transient noisy environment based on diffusion nets[J]. IEEE Journal of Selected Topics in Signal Processing, 2019,13(2): 254-264.
[7]	SOHN J , KIM N S , SUNG W ,et al. A statistical model-based voice activity detection[J]. IEEE Signal Processing Letters, 1999,6(1): 1-3.
[8]	FISHER E , TABRIKIAN J , DUBNOV S ,et al. Generalized likelihood ratio test for voiced-unvoiced decision in noisy speech using the harmonic model[J]. IEEE Transactions on Audio,Speech,and Language Processing, 2006,14(2): 502-510.
[9]	KIM J T , JUNG S H , CHO K H ,et al. Efficient harmonic peak detection of vowel sounds for enhanced voice activity detection[J]. Let Signal Processing, 2018,12(8): 975-982.
[10]	SHAMMA S A , ELHILALI M , MICHEYL C ,et al. Temporal coherence and attention in auditory scene analysis[J]. Trends in Neurosciences, 2011,34(3): 114-123.
[11]	HWANG S , JIN Y G , SHIN J W ,et al. Dual microphone voice activity detection based on reliable spatial cues[J]. Sensors, 2019,19(14): 3056-3064.
[12]	TEKI S , BARASCUD N , PICARD S ,et al. Neural correlates of auditory figure-ground segregation based on temporal coherence[J]. Cerebral Cortex, 2016,26(9): 3669-3680.
[13]	KLEINSCHMIDT M , . Spectro-temporal Gabor features as a front end for automatic speech recognition[C]// In 3rd European Congress on Acoustics.[S.n.:s.l]. 2002: 1-6.
[14]	罗智勇, 杨旭, 孙广路 ,等. 基于马尔可夫的有限自动机入侵容忍系统模型[J]. 通信学报, 2019,40(10): 79-89.
	LUO Z Y , YANG X , SUN G L ,et al. Finite automaton intrusion tolerance system model based on Markov[J]. Journal on Communications, 2019,40(10): 79-89.
[15]	NIELSEN J K , JENSEN T L , JENSEN J R ,et al. Fast fundamental frequency estimation:making a statistically efficient estimator computationally efficient[J]. Signal Process, 2017(135): 188-197.
[16]	SHE L M , NIELSEN J K , JENSEN J R ,et al. Bayesian pitch tracking based on the harmonic model[J]. IEEE/ACM Transactions on Audio,Speech,and Language Processing, 2019,27(11): 1737-1751.
[17]	SCHLUTER R , BEZRUKOV L , WANGNER H ,et al. Gammatone features and feature combination for large vocabulary speech recognition[C]// International Conference on Acoustics,Speech and Signal Processing. Piscataway:IEEE Press, 2007: 649-652.
[18]	SHAO Y , JIN Z , WANG D L ,et al. An auditory-based feature for robust speech recognition[C]// Proceedings of International Conference on Acoustics,Speech and Signal Processing. Piscataway:IEEE Press, 2009: 4625-4628.
[19]	MAARTEN V S , ANDREAS T , NARAYANAN S . A robust front end for VAD:exploiting contextual,discriminative and spectral cues of human voice[C]// Proceedings of the Annual Conference of the International Speech Communication Association. Piscataway:IEEE Press, 2013: 704-708.
[20]	MAARTEN V S , ANDREAS T ， NARAYANAN . A robust front end for VAD:exploiting contextual,discriminative and spectral cues of human voice[C]// Proceedings of the Annual Conference of the International Speech Communication Association. Piscataway:IEEE Press, 2013: 704-708.
[21]	LU L , JIANG H , ZHANG H ,et al. A robust audio classification and segmentation method[C]// ACM Multimedia. New York:ACM Press, 2001: 203-211.
[22]	ZHAO J H , GAO H B , LIU Y C ,et al. Speech recognition algorithm based on neural network and hidden Markov model[J]. The Journal of China Universities of Posts and Telecommunications, 2018,25(4): 28-37.

数据集	语音数据/句			噪声数据/句
数据集	TIMIT	THCHS30	DRC	SBNL	Nonspeech
训练集	4 620	220	3 000	80	0
测试集	1 680	200	500	0	100

检测方法	SNR=-5 dB	SNR=0 dB	SNR=5 dB	SNR=10 dB
BFS	0.206 4	0.197 2	0.162 1	0.118 3
SCS	0.219 4	0.198 4	0.165 3	0.153 8
FSF	0.194 1	0.185 8	0.175 1	0.122 2

检测方法	SNR=-5 dB	SNR=0 dB	SNR=5 dB	SNR=10 dB
BFS	0.194 7	0.175 9	0.186 7	0.193 6
SCS	0.127 6	0.116 9	0.110 6	0.106 1
FSF	0.094 0	0.057 3	0.032 9	0.028 1

检测方法	SNR=-5 dB	SNR=0 dB	SNR=5 dB	SNR=10 dB
BFS	0.598 9	0.626 9	0.651 2	0.688 1
SCS	0.653 0	0.684 7	0.724 1	0.740 1
FSF	0.711 9	0.756 8	0.792 0	0.849 7

检测方法	Pf	Pm	Pc
BFS	0.171 050	0.187 725	0.641 275
SCS	0.184 225	0.115 300	0.700 475
FSF	0.169 300	0.053 0475	0.777 600

基于特征流融合的带噪语音检测算法

Noisy voice detection algorithm based on feature stream fusion

在线阅读

PDF下载

可视化

摘要/Abstract

引用本文

使用本文

图/表 10

参考文献 22

相关文章 8

Metrics

推荐阅读 0

[1]	钱榕, 许建婷, 张克君, 董宏宇, 邢方远. 隐马尔可夫模型的异质网络链接预测方法研究[J]. 通信学报, 2022, 43(5): 214-225.
[2]	郭渊博,刘春辉,孔菁,王一丰. 内部威胁检测中用户行为模式画像方法研究[J]. 通信学报, 2018, 39(12): 141-150.
[3]	罗建桢,余顺争,蔡君. 基于最大似然概率的协议关键词长度确定方法[J]. 通信学报, 2016, 37(6): 119-128.
[4]	王昌海,张建忠,徐敬东,许昱玮. 基于HMM的动作识别结果可信度计算方法[J]. 通信学报, 2016, 37(5): 143-151.
[5]	杨晓峰,孙明明,胡雪蕾,杨静宇. 基于改进隐马尔可夫模型的网络攻击检测方法[J]. 通信学报, 2010, 31(3): 95-101.
[6]	邬书跃,田新广. 基于隐马尔可夫模型的用户行为异常检测新方法[J]. 通信学报, 2007, 28(4): 38-43.
[7]	王春桃,倪江群,黄继武,张荣跃,罗锡璋. 基于内容自适应的优化DWT-HMM顽健图像水印算法[J]. 通信学报, 2007, 28(2): 80-87.
[8]	殷玮玮,吴乐南. 基于HMM的信源—信道迭代联合译码[J]. 通信学报, 2006, 27(7): 61-65.