采用恒Q调制包络的合成语音伪装检测方法

doi:10.11959/j.issn.1000-0801.2023187

Abstract

Abstract:

In response to the low accuracy of synthetic speech spoofing detection based on traditional acoustic feature parameters, poor detection performance for unknown types of synthetic speech, and performance degradation in noisy environments, a method for detecting spoofing synthetic speech was proposed using constant Q modulation envelope (CQME) .The motivation of the method was from the fact that the temporal envelope of speech contained abundant information and there was a big difference in detail between the envelope of synthetic speech and genuine speech.The modulation envelope spectrum of speech was obtained by employing constant Q transform (CQT), and the root mean square of each frequency component was calculated to derive the CQME feature vector.And then the CQME feature vector was used to train the random forest classifier for discriminating genuine speech from spoofing synthetic speech.Experimental results demonstrate that the random forest trained with CQME features achieves high detection performance on the ASVspoof 2019 dataset and exhibites good detection efficacy for unknown types of synthetic speech.Furthermore, the proposed method shows high detection performance even under various noise conditions, having excellent noise robustness.

Key words: synthetic speech, spoofing speech detection, constant Q modulation envelope, random forest

CLC Number:

TP391.42

Jia XU, Zhihua JIAN, Honghui JIN, Chao WU. A method of synthetic speech spoofing detection using constant Q modulation envelope[J]. Telecommunications Science, 2023, 39(11): 107-115.

Figures/Tables 8

References 20

[1]	TAN C B , HIJAZI M H A , KHAMIS N ,et al. A survey on presentation attack detection for automatic speaker verification systems:state-of-the-art,taxonomy,issues and future direction[J]. Multimedia Tools and Applications, 2021,80(21-23): 32725-32762.
[2]	徐嘉, 简志华, 金宏辉 ,等. 基于中心对称局部二值模式的合成伪装语音检测方法[J]. 电信科学, 2023,39(1): 72-78.
	XU J , JIAN Z H , JIN H H ,et al. A method for synthetic spoofing speech detection based on center-symmetric local binary pattern[J]. Telecommunications Science, 2023,39(1): 72-78.
[3]	MITTAL A , DUA M . Automatic speaker verification systems and spoof detection techniques:review and analysis[J]. International Journal of Speech Technology, 2021,25(1): 105-134.
[4]	ALZANTOT M , WANG Z , SRIVASTAVA M B . Deep residual neural networks for audio spoofing detection[C]// Proceedings of 20th Annual Conference of the International Speech Communication Association 2019 (INTERSPEECH 2019). Graz,Austria:ISCA, 2019: 1078-1082.
[5]	NAGAKRISHNAN R , REVATHI A . Generic speech based person authentication system with genuine and spoofed utterances:different feature sets and models[J]. Multimedia Tools and Applications, 2021,81(1): 1179-1208.
[6]	TODISCO M , HéCTOR D , EVANS N . Constant Q cepstral coefficients:a spoofing countermeasure for automatic speaker verification[J]. Computer Speech ＆ Language, 2017(45): 516-535.
[7]	RAJAN P , PARTHASARATHI S , MURTHY H A . Robustness of phase based features for speaker recognition[C]// Proceedings of 10th Annual Conference of the International Speech Communication Association 2009 (INTERSPEECH 2009). Brighton:ISCA, 2009: 2299-2302.
[8]	SARATXAGA I , SANCHEZ J , WU Z ,et al. Synthetic speech detection using phase information[J]. Speech Communication, 2016(81): 30-41.
[9]	DRULLMAN R , FESTEN J M , PLOMP R . Effect of temporal envelope smearing on speech reception[J]. The Journal of the Acoustical Society of America, 1994,95(2): 1053-1064.
[10]	LU X , UNOKI M , NAKAMURA S . Sub-band temporal modulation envelopes and their normalization for automatic speech recognition in reverberant environments[J]. Computer Speech ＆Language, 2011,25(3): 571-584.
[11]	DING N , PATEL A D , CHEN L ,et al. Temporal modulations in speech and music[J]. Neuroscience ＆ Biobehavioral Reviews, 2017(81): 181-187.
[12]	NING Y , HE S , WU Z ,et al. A review of deep learning based speech synthesis[J]. Applied Sciences, 2019,9(19): 4050.
[13]	林朗, 王让定, 严迪群 ,等. 基于逆梅尔对数频谱系数的回放语音检测算法[J]. 电信科学, 2018,34(5): 90-98.
	LIN L , WANG R D , YAN D Q ,et al. A playback speech detection algorithm based on log inverse Mel-frequency spectral coefficient[J]. Telecommunications Science, 2018,34(5): 90-98.
[14]	BROWN J C . Calculation of a constant Q spectral transform[J]. Journal of the Acoustical Society of America, 1998,89(1): 425-434.
[15]	HAMSA S , SHAHIN I , IRAQI Y ,et al. Emotion recognition from speech using wavelet packet transform cochlear filter bank and random forest classifier[J]. IEEE Access, 2020(8): 96994-97006.
[16]	CHEN L , SU W , FENG Y ,et al. Two-layer fuzzy multiple random forest for speech emotion recognition in human-robot interaction[J]. Information Sciences, 2020(509): 150-163.
[17]	RAMOSAJ B , PAULY M . Consistent estimation of residual variance with random forest out-of-bag errors[J]. Statistics ＆Probability Letters, 2019(151): 49-57.
[18]	WANG X , YAMAGISHI J , TODISCO M ,et al. ASVspoof 2019:a large-scale public database of synthesized,converted and replayed speech[J]. Computer Speech ＆ Language, 2020(64): 101114.
[19]	KINNUNEN T , DELGADO H , EVANS N ,et al. Tandem assessment of spoofing countermeasures and automatic speaker verification:fundamentals[J]. IEEE/ACM Transactions on Au-dio,Speech,and Language Processing, 2020(28): 2195-2210.
[20]	WANG X , TAKAKI S , YAMAGISHI J . Neural source-filterbased waveform model for statistical parametric speech synthesis[C]// 2019 IEEE International Conference on Acoustics,Speech and Signal Processing (ICASSP). Piscataway:IEEE Press, 2019: 5916-5920.

Metrics

Recommended 0

No Suggested Reading articles found!

子集	说话人数目		语音数目
子集	男性	女性	真实	伪装	合成
训练集	8	12	2 580	22 800	15 200
开发集	4	6	2 548	22 296	14 864
评估集	21	27	7 355	63 882	49 140

K	SVM	随机森林
8	0.703 1	0.362 6
16	0.202 6	0.136 6
32	0.113 3	0.062 4
64	0.122 6	0.078 0
128	0.123 2	0.081 7
256	0.107 9	0.096 2

特征	开发集		评估集
特征	SVM	RF	SVM	RF
MFCC	0.380 0	0.357 1	0.743 8	0.731 3
LPCC	0.349 4	0.211 6	0.631 1	0.495 4
LFCC	0.124 6	0.122 8	0.187 3	0.136 7
CQCC	0.159 0	0.130 0	0.172 9	0.172 0
MS	0.164 8	0.084 5	0.189 3	0.098 5
CQME	0.098 2	0.060 1	0.113 3	0.062 4

分类器	CQME噪声鲁棒性
分类器	无噪	babble噪声	volvo噪声	pink噪声
SVM	0.113 3	0.157 4	0.130 8	0.153 2
RF	0.062 4	0.095 0	0.072 5	0.089 5

A method of synthetic speech spoofing detection using constant Q modulation envelope

RichHTML

PDF下载

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 8

References 20

Related Articles 12

Metrics

Recommended 0

[1]	Bensheng YUN, Xiaoya GAN, Yaguan QIAN. A network traffic classification method based on random forest and improved convolutional neural network [J]. Telecommunications Science, 2023, 39(7): 80-89.
[2]	Honghui JIN, Zhihua JIAN, Man YANG, Chao WU. Synthetic speech detection method using texture feature based on circumferential local ternary pattern [J]. Telecommunications Science, 2023, 39(6): 85-95.
[3]	Jia XU, Zhihua JIAN, Honghui JIN, Chao WU, Lin YOU, Yingxiao WU. Synthetic spoofing speech detection method based on center-symmetric local binary pattern [J]. Telecommunications Science, 2023, 39(1): 72-78.
[4]	Jiaqi YU, Zhihua JIAN, Jia XU, Lin YOU, Yunlu WANG, Chao WU. Spoofing speech detection algorithm based on joint feature and random forest [J]. Telecommunications Science, 2022, 38(6): 91-99.
[5]	Zimeng LU,Jiayi CHEN,Jing LI,Yue XIE,Xinli JIANG,Lei HAN,Qian GUO. An empty-nest power user identification method based on weighted random forest algorithm [J]. Telecommunications Science, 2020, 36(8): 112-121.
[6]	Rongfang ZHANG,Dandan XU,Yuanguang WANG,Siyu PAN,Zhengmao LI. Application of machine learning in the fake user identification of IoT [J]. Telecommunications Science, 2019, 35(7): 136-144.
[7]	Peng WEN,Zongju PENG,Fen CHEN,Gangyi JIANG,Mei YU. Complexity control method of random forest based HEVC [J]. Telecommunications Science, 2019, 35(2): 14-26.
[8]	Yanqing WANG,Hanchen WANG. Research on a combining algorithm for harassing calls to identify [J]. Telecommunications Science, 2017, 33(7): 112-119.
[9]	Xu DU,Jingyu FENG,Shaoqing LV,Wei SHI. PM2.5 concentration prediction model based on random forest regression analysis [J]. Telecommunications Science, 2017, 33(7): 66-75.
[10]	Qian LI,Hao JIANG,Jintao YANG. Individual encounter prediction based on mobile internet record data [J]. Telecommunications Science, 2017, 33(10): 115-123.
[11]	Ge LIU,Guoyi ZHANG,Yan YU. Intra-pulse modulation recognition of radar signal based on random forest [J]. Telecommunications Science, 2016, 32(5): 69-78.
[12]	Zheng WANG,Hua REN,Yanping FANG. Application of random forest in big data completion [J]. Telecommunications Science, 2016, 32(12): 7-12.