移动设备生物特征识别多模态融合标准研究及展望

doi:10.11959/j.issn.1000-0801.2021007

电信科学 ›› 2021, Vol. 37 ›› Issue (1): 32-38.doi: 10.11959/j.issn.1000-0801.2021007

移动设备生物特征识别多模态融合标准研究及展望

林冠辰¹, 王智飞²

¹ 蚂蚁科技集团股份有限公司，北京 100004
² 人力资源和社会保障部信息中心，北京 100013

修回日期:2020-11-10 出版日期:2021-01-20 发布日期:2021-01-01
作者简介:林冠辰（1984- ），男，蚂蚁科技集团股份有限公司高级工程师，主要研究方向为生物特征识别多模态融合、人脸识别防假体攻击、AI高阶对抗模型等。
王智飞（1984- ），男，博士，人力资源和社会保障部信息中心高级工程师，主要研究方向为低分辨率人脸识别、鲁棒表情识别、多模态生物特征识别、场景分析及智能视觉感知等。
基金资助:
国家重点研发计划基金资助项目(2018YFF0213004)

Research and prospect of standard for biometric multi-modal fusion used with mobile devices

Guanchen LIN¹, Zhifei WANG²

¹ Ant Group Co., Ltd., Beijing 100004, China
² Information Centre, Ministry of Human Resources and Social Security, Beijing 100013, China

Revised:2020-11-10 Online:2021-01-20 Published:2021-01-01
Supported by:
The National Key R＆D Program of China(2018YFF0213004)

摘要/Abstract

摘要：

针对用于移动设备的生物特征识别多模态融合技术框架不统一以及标准缺失的问题，提出了多模态融合的分类、层级以及标准统一技术框架。首先分析国内外与移动设备生物特征识别相关的标准化现状；其次研究移动设备生物特征识别标准的本地识别以及远程识别应用模式，分析提出多特征、多算法、多实例、多传感器4种多模态融合分类方法，研究并提出样本级融合、特征级融合、分数级融合和决策级融合4种多模态融合的层级，并且提出用于移动设备的生物特征识别多模态融合标准技术框架；最后对移动设备生物特征识别多模态融合技术应用进行展望。

关键词: 生物特征识别, 多模态融合, 标准, 移动设备

Abstract:

Aiming at the problem of inconsistent biometric multi-modal fusion technology framework for mobile devices and lack of standards, a unified technical framework of multi-modal fusion standards was proposed.Firstly, the current status of standardization related to biometric used with mobile device was analyzed.Secondly, the local recognition and remote recognition application modes of mobile device biometrics standards were studied, and then four sub-multimodal fusion classification methods of multi-feature, multi-algorithm, multi-instance, and multi-sensor were analyzed and proposed.Then, four levels of multi-modal fusion were researched and proposed: sample-level fusion, feature-level fusion, score-level fusion, and decision-level fusion, and a standard technical framework for biometric multi-modal fusion for mobile devices was proposed.Finally, prospects for the application of biometric multi-modal fusion technology were given.

Key words: biometric, multi-modal fusion, standard, mobile device

中图分类号:

TP393

林冠辰, 王智飞. 移动设备生物特征识别多模态融合标准研究及展望[J]. 电信科学, 2021, 37(1): 32-38.

Guanchen LIN, Zhifei WANG. Research and prospect of standard for biometric multi-modal fusion used with mobile devices[J]. Telecommunications Science, 2021, 37(1): 32-38.

图/表 2

参考文献 13

[1]	中国支付清算协会. 2019中国支付清算行业社会责任报告[R]. 2019.
	China Association for Payment and Clearing. 2019 social responsibility report of payment and clearing industry in China[R]. 2019.
[2]	KHELLAT-KIHELAB S , ABRISHAMBAFC R , MONTEIROB J L ,et al. Multimodal fusion of the finger vein,fingerprint and the finger-knuckle-print using Kernel Fisher analysis[S]. Applied Soft Computing, 2016, 42(5): 439-447.
[3]	WANG Y , TAN T , JAIN A K . Combining face and iris biometrics for identity verification[C]// Proceedings of Fourth International Conference on Audio and Video-Based Biometric Person Authentication.[S.l.:s.n.], 2003: 805-813.
[4]	BIGUN J , FIERREZ-AGUILAR J , ORTEGA-GARCIA J ,et al. Multimodal biometric authentication using quality signals in mobile communications[C]// Proceedings of 12th International Conference on Image Analysis and Processing.[S.l.:s.n.], 2003: 2-11.
[5]	CHANG K , BOWYER K W , SARKAR S ,et al. Comparison and combination of ear and face images in appearance-based biometrics[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2003,25(9): 1160-1165.
[6]	DAMER N , FüHRER J B , KUIJPER A . Missing data estimation in multi-biometric identification and verification[C]// Proceedings of IEEE Workshop on Biometric Measurements and Systems for Security and Medical Applications:BioMS 2013. Piscataway:IEEE Press, 2003: 41-45.
[7]	JAIN A K , NANDAKUMAR K , ROSS A . Score normalization in multimodal biometric systems[J]. Pattern Recognition, 2005,38(12,): 2270-2285.
[8]	JAIN A K , ROSS A . Learning user-specific parameters in a multibiometric system[C]// Proceedings of.International Conference on Image Processing.[S.l.:s.n.], 2002:I-57-I-60.
[9]	JAIN A K , ROSS A . Multibiometric systems[J]. Communications of the ACM,Special Issue on Multimodal Interfaces, 2004,47(1): 34-40.
[10]	SHAO G F , LI Z S , CHENG W ,et al. Fusion image quality evaluation method based on human perception[J]. Computer Applications, 2004,24(5): 69-71.
[11]	VHADURI S , POELLABAUER C . Summary:multi-modal biometric-based implicit authentication of wearable device users[J]. IEEE Transactions on Information Forensics and Security, 2019,14(12): 3116-3225.
[12]	ZHANG X M , CHENG D X , DAI Y X ,et al. Multimodal biometric authentication system for smartphone based on face and voice using matching level fusion[C]// Proceedings of 2018 IEEE 4th International Conference on Computer and Communications. Piscataway:IEEE Press, 2018: 1468-1472.
[13]	REGOUID M , TOUAHRIA M , BENOUIS M ,et al. Multimodal biometric system for ECG,ear and iris recognition based on local descriptors[J]. Multimedia Tools and Applications, 2019(4): 22509-22535.

[1]	马辉, 王瑞琴, 杨帅. 一种渐进式增长条件生成对抗网络模型[J]. 电信科学, 2023, 39(6): 105-113.
[2]	缪新育, 胡昌军, 程华. 移动通信同步关键问题研究：技术、标准与测试[J]. 电信科学, 2023, 39(3): 80-88.
[3]	孙鹏飞, 林立, 司哲. 5GtoB规模复制方法论及标准化能力构建[J]. 电信科学, 2022, 38(Z1): 3-10.
[4]	李振斌,赵锋. “IPv6+”技术标准体系[J]. 电信科学, 2020, 36(8): 11-21.
[5]	朱应钊,李嫚. 步态识别现状及发展趋势[J]. 电信科学, 2020, 36(8): 130-138.
[6]	林琳,李璐,葛雨明. 车联网通信标准化与产业发展分析[J]. 电信科学, 2020, 36(4): 15-26.
[7]	张园,王慧芬,王翰铭. 机器视觉技术、标准及安全产业应用[J]. 电信科学, 2020, 36(11): 104-112.
[8]	张迪. WLAN中基于IEEE 802.11u协议的终端节能功耗管理方案[J]. 电信科学, 2019, 35(8): 88-96.
[9]	汤瑞, 张庚, 吴冰冰, 赵文玉, 张海懿. 全光网标准化现状与技术发展分析[J]. 电信科学, 2019, 35(4): 1-9.
[10]	赖俊森,吴冰冰,汤瑞,丁梦宇,赵文玉,张海懿. 量子保密通信测评与标准化发展分析[J]. 电信科学, 2018, 34(9): 2-9.
[11]	陈山枝,胡金玲,时岩,赵丽. LTE-V2X车联网技术、标准与应用[J]. 电信科学, 2018, 34(4): 1-11.
[12]	徐明,杨雪,章坚武. 移动设备网络流量分析技术综述[J]. 电信科学, 2018, 34(4): 98-108.
[13]	罗莹,宋利,解蓉,罗传飞. 全景媒体的系统架构研究综述[J]. 电信科学, 2018, 34(2): 88-98.
[14]	张园,曹宁,胡豆豆. 视频监控标准化最新进展[J]. 电信科学, 2018, 34(10): 130-136.
[15]	赖俊森,吴冰冰,汤瑞,赵文玉,张海懿. 量子保密通信标准化现状与发展分析[J]. 电信科学, 2018, 34(1): 1-07.

移动设备生物特征识别多模态融合标准研究及展望

Research and prospect of standard for biometric multi-modal fusion used with mobile devices

在线阅读

PDF下载

可视化

摘要/Abstract

引用本文

使用本文

图/表 2

参考文献 13

相关文章 15

Metrics

推荐阅读 0