基于非线性音频特征分类的频带扩展方法

doi:10.3969/j.issn.1000-436x.2013.08.016

通信学报 ›› 2013, Vol. 34 ›› Issue (8): 120-130.doi: 10.3969/j.issn.1000-436x.2013.08.016

基于非线性音频特征分类的频带扩展方法

张丽燕,鲍长春,刘鑫,张兴涛

北京工业大学电子信息与控制工程学院语音与音频信号处理研究室，北京 100124

出版日期:2013-08-25 发布日期:2017-08-31
基金资助:
国家自然科学基金资助项目;国家自然科学基金资助项目;北京市教育委员会科技发展计划重点基金资助项目;北京市自然科学基金资助项目;北京市属高等学校人才强教计划基金资助项目;北京工业大学第九届研究生科技基金资助项目

Bandwidth extension method based on nonlinear audio characteristics classification

Li-yan ZHANG,Chang-chun BAO,Xin LIU,Xing-tao ZHANG

Speech and Audio Signal Processing Lab,School of Electronic Information and Control Engineering,Beijing University of Technology,Beijing 100124,China

Online:2013-08-25 Published:2017-08-31
Supported by:
The National Natural Science Foundation of China;The National Natural Science Foundation of China;Beijing Natural Science Foundation Program and Scientific Research Key Program of Beijing Municipal Commission of Education;The Natural Science Foundation of Beijing;The Funding Project for Academic Human Resources Development in Institutions of Higher Learning Under the Jurisdiction of Beijing Municipality;The 9th Postgraduate Science Foundation of Beijing University of Technology

摘要/Abstract

摘要：

提出了一种基于非线性音频分类的频带扩展方法，即利用递归图和定量递归分析将音频信号的时间序列分成4类，并分别采用4种方法恢复高频频谱细节，最终利用高斯混合模型和基于软判决的码书映射调整频谱包络和能量增益。主客观测试表明，该方法优于传统的盲目式频带扩展方法，且应用到ITU-T G.722.1编解码器时，音频质量优于同码率下的G.722.1C编解码器。

关键词: 音频编码, 频带扩展, 音频分类, 递归图, 定量递归分析

Abstract:

A bandwidth extension method based on audio classification was proposed.Time series of audio signals were classified into four types based on recurrence plot and recurrence quantification analysis,and the fine spectrums were recovered by taking advantage of four methods respectively.In addition,the spectrum envelope and energy gain were adjusted by Gaussian mixture model and codebook mapping on the basis of soft decision respectively.Subjective and objective testing results indicate that the proposed method has good quality compared with conventional blind bandwidth extension methods,and the performance of ITU-T G.722.1 codec with the proposed algorithm is better than that of G.722.1C codec at the same bit rate.

Key words: audio coding, bandwidth extension, audio classification, recurrence plot, recurrence quantification analysis

张丽燕,鲍长春,刘鑫,张兴涛. 基于非线性音频特征分类的频带扩展方法[J]. 通信学报, 2013, 34(8): 120-130.

Li-yan ZHANG,Chang-chun BAO,Xin LIU,Xing-tao ZHANG. Bandwidth extension method based on nonlinear audio characteristics classification[J]. Journal on Communications, 2013, 34(8): 120-130.

图/表 19

图1

图2

图3

图4

图5

表1

图6

图7

图8

图9

表2

图10

图11

图12

图13

图14

图15

图16

表3

参考文献 18

[1]	LARSEN E , AARTS R M . Audio Bandwidth Extension-Application of Psychoacoustics,Signal Processing and Loudspeaker Design[M]. UK: John Wiley ＆ Sons Ltd, 2004.
[2]	VARY P , MARTIN R . Digital Speech Transmission-Enhancement,Coding and Error Concealment[M]. UK: John Wiley ＆ Sons Ltd, 2006.
[3]	MARTIN R , HEUTE U , ANTWEILER C . Advances in Digital Speech Transmission[M]. UK: John Wiley ＆ Sons Ltd, 2008.
[4]	SHA Y T , BAO C C , JIA M S . high frequency reconstruction of audio signal based on chaotic prediction theory[A]. ICASSP2010[C]. Dallas,USA, 2010. 381-384.
[5]	LIU X , BAO C C , ZHANG L Y . Nonlinear bandwidth extension of audio signals based on hidden markov model[A]. ISSPIT2011[C]. Bilbao,Spain, 2011. 144-149.
[6]	LIU H J , BAO C C , LIU X . Audio bandwidth extension based on RBF neural network[A]. ISSPIT2011[C]. Bilbao,Spain, 2011. 150-154.
[7]	崔玉强 . 基于内容的音频分类方法研究[D]. 武汉:华中科技大学, 2007. CUI Y Q . Research on Content-Based Audio Classification[D]. Wuhan:Huazhong University of Science and Technology, 2007.
[8]	闫润强 . 语音信号动力学特性递归分析[D]. 上海:上海交通大学, 2006. YAN R Q . Recurrence Analysis of Dynamical Characteristics for Speech Signals[D]. Shanghai:Shanghai Jiao Tong University, 2006.
[9]	刘秉正, 彭建华 . 非线性动力学[M]. 北京: 高等教育出版社, 2004. LIU B Z , PENG J H . Nonlinear Dynamics[M]. Beijing: Higher Education Press, 2004.
[10]	ECKMANN J P , KAMPHORST S O , RUELLE D . Recurrence plots of dynamical systems[J]. Europhys Lett, 1987,4(9): 973-977.
[11]	ZHANG L Y , BAO C C , LIU X . Audio classification algorithm based on nonlinear characteristics analysis[A]. APSIPA ASC 2011[C]. Xi’an,China, 2011.
[12]	ZBILUT J P , WEBBER C L . Embeddings and delays as derived from quantification of recurrence plots[J]. Phys Lett A, 1992,171(3/4): 199-203.
[13]	MARWAN N . Encounters with Neighbours-current Developments of Concepts based on Recurrence Plots and their Applications[D]. Germany:University of Potsdam, 2003.
[14]	窦庚欣 . 4kbit/s 快速 DP-CELP 语音编码与频带扩展技术研究[D]. 北京:北京工业大学, 2006. DOU G X . Research on 4kbit/s Fast DP-CELP Speech Coding and Bandwidth Extension[D]. Beijing:Beijing University of Technology, 2006.
[15]	ISO/IEC 15938-4:Information Technology-Multimedia Content Description Interface - Part 4:Audio[S]. 2001.
[16]	张丽燕, 刘鑫, 鲍长春 . 基于软判决矢量量化的语音频带扩展[A]. 中国电子学会第十六届青年学术年会论文集[C]. 2010 307-313. ZHANG L Y , LIU X , BAO C C . Bandwidth extension of speech based on soft-decision vector quantization[A]. CIE-YC 2010[C]. 2010. 307-313.
[17]	PULAKKA H , LAAKSONEN L , VAINIO M . Evaluation of an artificial speech bandwidth extension method in three languages[J]. IEEE Transactions on Audio,Speech and Language Processing, 2008,16(6): 1124-1137.
[18]	LIU X , BAO C C , JIA M S . Nonlinear bandwidth extension based on nearest-neighbor matching[A]. APSIPA ASC 2010[C]. Singapore, 2010. 169-172.

概率类型	噪声型	暂态型	谐波型	混合型
噪声型的概率	87.51%	0.08%	1.98%	7.08%
暂态型的概率	2.73%	83.81%	2.03%	3.48%
谐波型的概率	2.25%	10.76%	90.21%	7.01%
混合型的概率	7.51%	5.35%	5.78%	82.43%

特征类型	特征名称	特征维数
	过零率	1
听觉感知特征	梯度指数	1
	子带通量	1
	子带能量均方根	14
	音频谱重心	1
音色描述特征	音频扩展度	1
	音频谱平坦度	7

方法	主观偏爱比例
G.722.1+频带扩展	37.9%
无偏爱测试	28.3%
G.722.1C	33.8%

基于非线性音频特征分类的频带扩展方法

Bandwidth extension method based on nonlinear audio characteristics classification

在线阅读

PDF下载

可视化

被引次数

摘要/Abstract

引用本文

使用本文

图/表 19

参考文献 18

相关文章 5

Metrics

推荐阅读 0

[1]	董石，胡瑞敏，杨玉红，王晓晨，涂卫平. 面向多声道三维音频的和差压缩编码技术[J]. 通信学报, 2014, 35(6): 19-153.
[2]	董石,胡瑞敏,杨玉红,王晓晨,涂卫平. 面向多声道三维音频的和差压缩编码技术[J]. 通信学报, 2014, 35(6): 148-153.
[3]	张丽燕，鲍长春，刘鑫，张兴涛. 基于非线性音频特征分类的频带扩展方法[J]. 通信学报, 2013, 34(8): 16-131.
[4]	贾懋珅,鲍长春,李锐. 8～64kbit/s超宽带嵌入式语音频编码方法[J]. 通信学报, 2009, 30(5): 27-34.
[5]	闫润强,朱贻盛. 基于信号递归度分析的语音端点检测方法[J]. 通信学报, 2007, 28(1): 35-39.