基于中心对称局部二值模式的合成伪装语音检测方法

doi:10.11959/j.issn.1000-0801.2023005

Abstract

Abstract:

In view of the fact that the local binary pattern (LBP) based speech spoofing detection method has low detection accuracy when detecting synthetic speech, a spoofing speech detection method based on center-symmetric local binary pattern (CSLBP) was proposed.In this method, the spectrogram of the speech signal was obtained through short-time Fourier transform (STFT), and then the texture feature was extracted from the spectrogram using the CSLBP.The random forest classifier was trained by the extracted texture feature to realize the discrimination of genuine and spoofing speech.The CSLBP-based method comprehensively considered the value and position relationship of pixels in the spectrogram so as to contain more texture information, and reduced the feature dimension to 16 beneficial to decrease the amount of computation.Experimental results on the ASVspoof 2019 dataset show that, compared with the LBP-based spoofing detection method, the proposed method reduced the tandem detection cost function (t-DCF) of synthetic spoofing speech by 16.98% and increased the detection speed by 89.73%.

Key words: speaker verification, spoofing speech detection, CSLBP, random forest

CLC Number:

TP391.42

Jia XU, Zhihua JIAN, Honghui JIN, Chao WU, Lin YOU, Yingxiao WU. Synthetic spoofing speech detection method based on center-symmetric local binary pattern[J]. Telecommunications Science, 2023, 39(1): 72-78.

Figures/Tables 9

References 21

[1]	KANERVISTO A , HAUTAM?KI V , KINNUNEN T ,et al. Optimizing tandem speaker verification and anti-spoofing systems[J]. IEEE/ACM Transactions on Audio,Speech,and Language Processing, 2022,30: 477-488.
[2]	LEI Z C , YAN H , LIU C H ,et al. Two-path GMM-ResNet and GMM-SENet for ASV spoofing detection[C]// Proceedings of ICASSP 2022 - 2022 IEEE International Conference on Acoustics,Speech and Signal Processing. Piscataway:IEEE Press, 2022: 6377-6381.
[3]	ALZANTOT M , WANG Z Q , SRIVASTAVA M B . Deep residual neural networks for audio spoofing detection[C]// Proceedings of Interspeech 2019. Cary:ISCA, 2019: 1078-1082.
[4]	崔兆国 . 基于SVM的反蓄意模仿说话人识别研究[D]. 桂林:桂林电子科技大学, 2013.
	CUI Z G . Research on speaker recognition of anti-deliberate imitation based on SVM[D]. Guilin:Guilin University of Electronic Technology, 2013.
[5]	PADMANABHAN R , PARTHASARATHI S H K , MURTHY H A . Robustness of phase based features for speaker recognition[C]// Proceedings of Interspeech 2009. Cary:ISCA, 2009: 2299-2302.
[6]	SARATXAGA I , SANCHEZ J , WU Z ,et al. Synthetic speech detection using phase information[J]. Speech Communication, 2016(81): 30-41.
[7]	HOANG V T , . Unsupervised LBP histogram selection for color texture classification via sparse representation[C]// Proceedings of 2018 IEEE International Conference on Information Communication and Signal Processing. Piscataway:IEEE Press, 2018: 79-84.
[8]	SHU X , SONG Z , SHI J ,et al. Multiple channels local binary pattern for color texture representation and classification[J]. Signal Processing:Image Communication, 2021(98): 116392.
[9]	KARANWAL S . A comparative study of 14 state of art descriptors for face recognition[J]. Multimedia Tools and Applications, 2021,80(8): 12195-12234.
[10]	SHI L , WANG X , SHEN Y . Research on 3D face recognition method based on LBP and SVM[J]. Optik:International Journal for Light and Electron Optics, 2020(220): 165157.
[11]	ALEGRE F , VIPPERLA R , AMEHRAYE A ,et al. A new speaker verification spoofing countermeasure based on local binary patterns[C]// Proceedings of Interspeech 2013. Cary:ISCA, 2013: 940-944.
[12]	徐剑, 简志华, 于佳祺 ,等. 采用完整局部二进制模式的伪装语音检测[J]. 电信科学, 2021,37(5): 91-99.
	XU J , JIAN Z H , YU J Q ,et al. Completed local binary pattern based speech anti-spoofing[J]. Telecommunications Science, 2021,37(5): 91-99.
[13]	XIA Z H , YUAN C S , LYU R ,et al. A novel weber local binary descriptor for fingerprint liveness detection[J]. IEEE Transactions on Systems,Man,and Cybernetics:Systems, 2018,50(4): 1526-1536.
[14]	TOFFA O K , MIGNOTTE M . Environmental sound classification using local binary pattern and audio features collaboration[J]. IEEE Transactions on Multimedia, 2021(23): 3978-3985.
[15]	SHAH A , EL-ALFY E , . Comparative analysis of feature extraction and fusion for blind authentication of digital images using chroma channels[J]. Signal Processing:Image Communication, 2021(95): 116271.
[16]	王科俊, 曹逸, 邢向磊 . 基于MB-CSLBP的手指静脉加密算法研究[J]. 智能系统学报, 2018,13(4): 543-549.
	WANG K J , CAO Y , XING X L . Finger-vein encryption algorithm based on MB-CSLBP[J]. CAAI Transactions on Intelligent Systems, 2018,13(4): 543-549.
[17]	WANG X , YAMAGISHI J , TODISCO M ,et al. ASVspoof 2019:a large-scale public database of synthesized,converted and replayed speech[J]. Computer Speech ＆ Language, 2020(64): 101114.
[18]	KINNUNEN T , DELGADO H , EVANS N ,et al. Tandem assessment of spoofing countermeasures and automatic speaker verification:fundamentals[J]. IEEE/ACM Transactions on Audio,Speech,and Language Processing, 2020(28): 2195-2210.
[19]	HEIKKILA M , PIETIKAINEN M . A texture-based method for modeling the background and detecting moving objects[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2006,28(4): 657-662.
[20]	LIU L J , LING Z H , JIANG Y ,et al. WaveNet vocoder with limited training data for voice conversion[C]// Proceedings of Annual Conference of the International Speech Communication Association (Interspeech). Cary:ISCA, 2018: 1983-1987.
[21]	LI Y J , SWERSKY K , ZEMEL R . Generative moment matching networks[C]// Proceedings of International Conference on Machine Learning (ICML).[S.l.:s.n.], 2015: 1718-1727.

Metrics

Recommended 0

No Suggested Reading articles found!

子集	语音数目/个
子集	真实	伪装	合成
训练集	2 580	22 800	15 200
开发集	2 548	22 296	14 864
评估集	7 355	63 882	49 140

T	0	1	2	3	4	5	6	7	8	9	10
SVM	0.218 4	0.202 9	0.164 8	0.134 4	0.131 4	0.123 1	0.124 7	0.128 5	0.142 3	0.154 6	0.167 2
随机森林	0.189 2	0.190 6	0.179 0	0.144 0	0.116 4	0.101 7	0.102 1	0.106 3	0.116 3	0.130 6	0.147 9

模型	MFCC	LPCC	LBP	CSLBP
SVM	0.275 4	0.646 8	0.156 3	0.123 1
随机森林	0.391 8	0.541 5	0.122 5	0.101 7

模型	检测耗时/s
模型	MFCC	LPCC	LBP	CSLBP
SVM	16	31	247	17
随机森林	65	42	516	53

特征	A07	A08	A09	A10	A11	A12	A13	A14	A15	A16	平均
MFCC	0.363 5	0.232 1	0.444 0	0.413 0	0.518 8	0.586 5	0.318 4	0.354 0	0.332 3	0.398 4	0.396 1
LPCC	0.481 9	0.748 4	0.604 2	0.454 9	0.529 9	0.597 6	0.184 3	0.758 0	0.703 6	0.384 7	0.544 8
LBP	0.020 8	0.014 2	0.067 3	0.133 8	0.238 7	0.100 0	0.050 5	0.104 6	0.396 4	0.093 6	0.122 0
CSLBP	0.050 9	0.032 3	0.055 7	0.086 1	0.070 8	0.026 1	0.050 4	0.238 0	0.336 5	0.062 2	0.100 9

Synthetic spoofing speech detection method based on center-symmetric local binary pattern

RichHTML

PDF下载

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 9

References 21

Related Articles 11

Metrics

Recommended 0

[1]	Honghui JIN, Zhihua JIAN, Man YANG, Chao WU. Synthetic speech detection method using texture feature based on circumferential local ternary pattern [J]. Telecommunications Science, 2023, 39(6): 85-95.
[2]	Jiaqi YU, Zhihua JIAN, Jia XU, Lin YOU, Yunlu WANG, Chao WU. Spoofing speech detection algorithm based on joint feature and random forest [J]. Telecommunications Science, 2022, 38(6): 91-99.
[3]	Jian XU, Zhihua JIAN, Jiaqi YU, Yifan JIN, Lin YOU, Yunlu WANG. Completed local binary pattern based speech anti-spoofing [J]. Telecommunications Science, 2021, 37(5): 91-99.
[4]	Zimeng LU,Jiayi CHEN,Jing LI,Yue XIE,Xinli JIANG,Lei HAN,Qian GUO. An empty-nest power user identification method based on weighted random forest algorithm [J]. Telecommunications Science, 2020, 36(8): 112-121.
[5]	Rongfang ZHANG,Dandan XU,Yuanguang WANG,Siyu PAN,Zhengmao LI. Application of machine learning in the fake user identification of IoT [J]. Telecommunications Science, 2019, 35(7): 136-144.
[6]	Peng WEN,Zongju PENG,Fen CHEN,Gangyi JIANG,Mei YU. Complexity control method of random forest based HEVC [J]. Telecommunications Science, 2019, 35(2): 14-26.
[7]	Xu DU,Jingyu FENG,Shaoqing LV,Wei SHI. PM2.5 concentration prediction model based on random forest regression analysis [J]. Telecommunications Science, 2017, 33(7): 66-75.
[8]	Yanqing WANG,Hanchen WANG. Research on a combining algorithm for harassing calls to identify [J]. Telecommunications Science, 2017, 33(7): 112-119.
[9]	Qian LI,Hao JIANG,Jintao YANG. Individual encounter prediction based on mobile internet record data [J]. Telecommunications Science, 2017, 33(10): 115-123.
[10]	Ge LIU,Guoyi ZHANG,Yan YU. Intra-pulse modulation recognition of radar signal based on random forest [J]. Telecommunications Science, 2016, 32(5): 69-78.
[11]	Zheng WANG,Hua REN,Yanping FANG. Application of random forest in big data completion [J]. Telecommunications Science, 2016, 32(12): 7-12.