通信学报 ›› 2023, Vol. 44 ›› Issue (11): 94-109.doi: 10.11959/j.issn.1000-436x.2023209

• 专题:复杂环境下分布式边缘智能 • 上一篇    

联邦学习中的模型逆向攻防研究综述

王冬1, 秦倩倩1, 郭开天1, 刘容轲1, 颜伟鹏1, 任一支1, 罗清彩2, 申延召3   

  1. 1 杭州电子科技大学网络空间安全学院,浙江 杭州 310018
    2 山东浪潮科学研究院有限公司,山东 济南 250000
    3 山东区块链研究院,山东 济南 250000
  • 修回日期:2023-10-18 出版日期:2023-11-01 发布日期:2023-11-01
  • 作者简介:王冬(1990− ),女,山东泰安人,博士,杭州电子科技大学讲师,主要研究方向为人工智能安全、隐私计算等
    秦倩倩(2000− ),女,湖北随州人,杭州电子科技大学博士生,主要研究方向为人工智能安全、隐私计算等
    郭开天(2000− ),男,山东菏泽人,杭州电子科技大学博士生,主要研究方向为人工智能安全、隐私计算等
    刘容轲(1999− ),男,安徽安庆人,杭州电子科技大学博士生,主要研究方向为人工智能安全、隐私计算等
    颜伟鹏(2001− ),男,福建泉州人,杭州电子科技大学博士生,主要研究方向为人工智能安全、数据安全等
    任一支(1981− ),男,安徽枞阳人,博士,杭州电子科技大学教授,主要研究方向为大数据安全、人工智能、区块链、知识图谱
    罗清彩(1978− ),男,山东青岛人,山东浪潮科学院有限公司高级工程师,主要研究方向为隐私计算、人工智能安全等
    申延召(1984− ),男,河南汝州人,博士,山东区块链研究院高级工程师,主要研究方向为隐私计算、人工智能安全、密码学等
  • 基金资助:
    浙江省“尖兵”“领雁”研发基金资助项目(2023C03203);浙江省“尖兵”“领雁”研发基金资助项目(2023C03180);浙江省“尖兵”“领雁”研发基金资助项目(2022C03174);浙江省属高校基本科研业务费专项资金资助项目(GK229909299001-023)

Survey on model inversion attack and defense in federated learning

Dong WANG1, Qianqian QIN1, Kaitian GUO1, Rongke LIU1, Weipeng YAN1, Yizhi REN1, Qingcai LUO2, Yanzhao SHEN3   

  1. 1 School of Cyberspace Security, Hangzhou Dianzi University, Hangzhou 310018, China
    2 Shandong Inspur Science Research Institute Co., Ltd, Jinan 250000, China
    3 Shandong Blockchain Research Institute, Jinan 250000, China
  • Revised:2023-10-18 Online:2023-11-01 Published:2023-11-01
  • Supported by:
    Zhejiang Province’s “Sharp Blade” and “Leading Goose” Research and Development Project(2023C03203);Zhejiang Province’s “Sharp Blade” and “Leading Goose” Research and Development Project(2023C03180);Zhejiang Province’s “Sharp Blade” and “Leading Goose” Research and Development Project(2022C03174);Zhejiang Province-funded Basic Research Fund for Universities Affiliated with Zhejiang Province(GK229909299001-023)

摘要:

联邦学习作为一种分布式机器学习技术可以解决数据孤岛问题,但机器学习模型会无意识地记忆训练数据,导致参与方上传的模型参数与全局模型会遭受各种隐私攻击。针对隐私攻击中的模型逆向攻击,对现有的攻击方法进行了系统总结。首先,概括并详细分析了模型逆向攻击的理论框架;其次,从威胁模型的角度对现有的攻击方法进行总结分析与比较;再次,总结与比较了不同技术类型的防御策略;最后,对现有模型逆向攻击常用的评估标准及数据集进行汇总,并对模型逆向攻击现有的主要挑战以及未来研究方向进行总结。

关键词: 联邦学习, 模型逆向攻击, 隐私安全

Abstract:

As a distributed machine learning technology, federated learning can solve the problem of data islands.However, because machine learning models will unconsciously remember training data, model parameters and global models uploaded by participants will suffer various privacy attacks.A systematic summary of existing attack methods was conducted for model inversion attacks in privacy attacks.Firstly, the theoretical framework of model inversion attack was summarized and analyzed in detail.Then, existing attack methods from the perspective of threat models were summarized, analyzed and compared.Then, the defense strategies of different technology types were summarized and compared.Finally, the commonly used evaluation criteria and datasets were summarized for inversion attack of existing models, and the main challenges and future research directions were summarized for inversion attack of models.

Key words: federated learning, model inversion attack, privacy security

中图分类号: 

No Suggested Reading articles found!