基于脑机接口的人机共享控制技术研究

doi:10.11959/j.issn.2096-6652.202109

智能科学与技术学报 ›› 2021, Vol. 3 ›› Issue (1): 85-92.doi: 10.11959/j.issn.2096-6652.202109

基于脑机接口的人机共享控制技术研究

邓晓燕, 俞祝良, 林灿光, 顾正晖, 李远清

华南理工大学自动化科学与工程学院，广东广州 510641

修回日期:2020-02-08 出版日期:2021-03-15 发布日期:2021-03-01
作者简介:邓晓燕（1983- ），女，华南理工大学自动化科学与工程学院高级实验师，主要研究方向为模式识别与智能控制系统。
俞祝良（1973- ），男，博士，华南理工大学自动化科学与工程学院教授，主要研究方向为信号处理、模式识别、机器学习及其在通信、生物医学工程等方面的应用。
林灿光（1995- ），男，华南理工大学自动化科学与工程学院硕士生，主要研究方向为控制工程。
顾正晖（1973- ），女，博士，华南理工大学自动化科学与工程学院教授，主要研究方向为信号处理和模式识别。
李远清（1966- ）男，博士，华南理工大学自动化科学与工程学院教授，主要研究方向为盲信号处理、稀疏表示、机器学习和脑机接口。
基金资助:
国家自然科学基金资助项目(61836003);中央高校基本科研业务费专项资金资助项目(2019MS138)

Research on human-computer shared control technology based on brain-computer interface

Xiaoyan DENG, Zhuliang YU, Canguang LIN, Zhenghui GU, Yuanqing LI

School of Automation Science and Engineering, South China University of Technology, Guangzhou 510641, China

Revised:2020-02-08 Online:2021-03-15 Published:2021-03-01
Supported by:
The National Natural Science Foundation of China(61836003);The Fundamental Research Funds for the Central Universities(2019MS138)

摘要/Abstract

摘要：

脑机接口作为神经工程领域中活跃的研究方向，在生物医学、神经康复和智能机器人等领域具有重要的研究意义。基于脑机接口的人机共享控制技术结合了人和机器智能的自身特点，相较于直接控制的脑机接口控制技术有着诸多的优势。因此，从不同角度对基于非植入式的脑机接口的人机共享控制进行了分类和阐述，并对其未来研究方向和发展趋势进行了展望，以期为人机共享控制技术研究提供新的思路和方向。

关键词: 脑机接口, 人机交互, 共享控制, 智能机器人

Abstract:

As an active research direction in the field of neural engineering, brain-computer interface (BCI) has important research significance in biomedicine, neural rehabilitation, intelligent robot and other fields.The human-computer shared control technology based on BCI combines the advantages of human and machine intelligence, and has many advantages compared with the direct control BCI control technology.The human-computer shared control based on non-invasive BCI was classified and introduced from different points of view, and the future research direction and development trend of the human-computer shared control system based on BCI were forecasted to provide new ideas and directions.

Key words: brain-computer interface, human-computer interaction, shared control, intelligent robot

中图分类号:

TP242

邓晓燕, 俞祝良, 林灿光, 等. 基于脑机接口的人机共享控制技术研究[J]. 智能科学与技术学报, 2021, 3(1): 85-92.

Xiaoyan DENG, Zhuliang YU, Canguang LIN, et al. Research on human-computer shared control technology based on brain-computer interface[J]. Chinese Journal of Intelligent Science and Technology, 2021, 3(1): 85-92.

图/表 2

参考文献 58

[1]	RYBSKI P E , YOON K , STOLARZ J ,et al. Interactive robot task training through dialog and demonstration[C]// Proceedings of the 2nd ACM/IEEE International Conference on Human-Robot Interaction. New York:ACM Press, 2007.
[2]	GOODRICH M A , SCHULTZ A C . Human-robot interaction:a survey[M].[S.l.]: Now Publishers Inc., 2008.
[3]	WOLPAW J R , BIRBAUMER N , MCFARLAND D J ,et al. Braincomputer interfaces for communication and control[J]. Clinical Neurophysiology, 2002,113(6): 767-791.
[4]	WILSON J A , FELTON E A , GARELL P C ,et al. ECoG factors underlying multimodal control of a brain-computer interface[J]. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2006,14(2): 246-250.
[5]	CHAPIN J K , MOXON K A , MARKOWITZ R S ,et al. Real-time control of a robot arm using simultaneously recorded neurons in the motor cortex[J]. Nature Neuroscience, 1999,2(7): 664-670.
[6]	HOCHBERG L R , BACHER D , JAROSIEWICZ B ,et al. Reach and grasp by people with tetraplegia using a neurally controlled robotic arm[J]. Nature, 2013,485(7398): 372-375.
[7]	KIM D J , HAZLETT-KNUDSEN R , CULVER-GODFREY H ,et al. How autonomy impacts performance and satisfaction:results from a study with spinal cord injured subjects using an assistive robot[J]. IEEE Transactions on Systems,Man,and Cybernetics-Part A:Systems and Humans, 2011,42(1): 2-14.
[8]	DIEZ P F , MüLLER S M T , MUT V A ,et al. Commanding a robotic wheelchair with a high-frequency steady-state visual evoked potential based brain-computer interface[J]. Medical Engineering and Physics, 2013,35(8): 1155-1164.
[9]	TANAKA K , MATSUNAGA K , WANG H O . Electroencephalogram-based control of an electric wheelchair[J]. IEEE Transactions on Robotics, 2005,21(4): 762-766.
[10]	CHOI K , CICHOCKI A . Control of a wheelchair by motor imagery in real time[C]// Proceedings of the 9th International Conference on Intelligent Data Engineering and Automated Learning.[S.l.:s.n.], 2008.
[11]	LOPES A C , PIRES G , NUNES U . Assisted navigation for a brain-actuated intelligent wheelchair[J]. Robotics and Autonomous Systems, 2013,61: 245-258.
[12]	FIFER M S , HOTSON G , WESTER B A ,et al. Simultaneous neural control of simple reaching and grasping with the modular prosthetic limb using intracranial EEG[J]. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2014,22(3): 695-705.
[13]	VIDAURRE C , KLAUER C , SCHAUER T ,et al. EEG-based BCI for the linear control of an upper-limb neuroprosthesis[J]. Medical Engineering and Physics, 2016: 1195-1204.
[14]	HORTAL E , PLANELLES D , COSTA A ,et al. SVM-based brain-machine interface for controlling a robot arm through four mental tasks[J]. Neurocomputing, 2015,151(1): 116-121.
[15]	BI L Z , FAN X A , LIU Y L . EEG-based brain-controlled mobile robots:a survey[J]. IEEE Transactions on Human-Machine Systems, 2013,43(2): 161-176.
[16]	DASGUPTA S , FANTON M , PHAM J ,et al. Brain controlled robotic platform using steady state visual evoked potentials acquired by EEG[C]// Proceedings of the 45th Asilomar Conference on Signals,Systems and Computers. Piscataway:IEEE Press, 2011.
[17]	LONG J Y , LI Y Q , WANG H T ,et al. A hybrid brain computer interface to control the direction and speed of a simulated or real wheelchair[J]. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2012,20(5): 720-729.
[18]	MILLAN J R , RENKENS F , MOURINO J ,et al. Noninvasive brain-actuated control of a mobile robot by human EEG[J]. IEEE Transactions on Biomedical Engineering, 2004,51(6): 1026-1033.
[19]	SATTI A R , COYLE D,PRASADG . Self-paced brain-controlled wheelchair methodology with shared and automated assistive control[C]// Proceedings of the 2011 IEEE Symposium on Computational Intelligence,Cognitive Algorithms,Mind,and Brain. Piscataway:IEEE Press, 2011.
[20]	ZHANG Z J , HUANG Y Q , CHEN S Y ,et al. An intention-driven semi-autonomous intelligent robotic system for drinking[J]. Frontiers in Neurorobotics, 2017,11: 1-14.
[21]	BURGARD W , CREMERS A B , FOX D ,et al. Experiences with an interactive museum tour-guide robot[J]. Artificial Intelligence, 1999,114(1-2): 3-55.
[22]	BOURHIS G , AGOSTINI Y . The vahm robotized wheelchair:system architecture and human-machine interaction[J]. Journal of Intelligent and Robotic Systems, 1998,22(1): 39-50.
[23]	ITURRATE I , ANTELIS J M , KUBLER A ,et al. A noninvasive brain-actuated wheelchair based on a P300 neurophysiological protocol and automated navigation[J]. IEEE Transactions on Robotics, 2009,25(3): 614-627.
[24]	MANDEL C , LUTH T , LAUE T ,et al. Navigating a smart wheelchair with a brain-computer interface interpreting steady-state visual evoked potentials[C]// Proceedings of the 31st 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems. Piscataway:IEEE Press, 2009: 1118-1125.
[25]	MILLAN J J D R , GALAN F , VANHOOYDONCK D ,et al. Asynchronous non-invasive brain-actuated control of an intelligent wheelchair[C]// Proceedings of the 31st International Conference of the IEEE Engineering in Medicine and Biology Society.[S.l.:s.n.], 2009.
[26]	YANG C G , WU H W , LI Z J ,et al. Mind control of a robotic arm with visual fusion technology[J]. IEEE Transactions on Industrial Informatics, 2018,14: 3822-3830.
[27]	PERRIN X , CHAVARRIAGA R , COLAS F ,et al. Brain-coupled interaction for semi-autonomous navigation of an assistive robot[J]. Robotics and Autonomous Systems, 2010,58(12): 1246-1255.
[28]	VANACKER G , MILLáN J R , LEW E ,et al. Context-based filtering for assisted brain-actuated wheelchair driving[J]. Computational Intelligence and Neuroscience, 2010,2007: 25130.
[29]	DENG X Y , YU Z L , LIN C G ,et al. A Bayesian shared control approach for wheelchair robot with brain machine interface[J]. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2020,28: 328-338.
[30]	ZHANG R , LI Y Q , YAN Y Y ,et al. Control of a wheelchair in an indoor environment based on a brain-computer interface and automated navigation[J]. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2016,24: 128-139.
[31]	ABU-ALQUMSAN M , EBERT F , PEER A . Goal-recognition-based adaptive brain-computer interface for navigating immersive robotic systems[J]. Journal of Neural Engineering, 2017,14: 036024.
[32]	STAWICKI P , GEMBLER F , VOLOSYAK I . Driving a semiautonomous mobile robotic car controlled by an SSVEP-based BCI[J]. Computational Intelligence and Neuroscience, 2016: 4909685.
[33]	XU Y , DING C , SHU X K ,et al. Shared control of a robotic arm using non-invasive brain-computer interface and computer vision guidance[J]. Robotics and Autonomous Systems, 2019,115(6).
[34]	ZHANG W C , SUN F C , WU H ,et al. Asynchronous brain-computer interface shared control of robotic grasping[J]. Tsinghua Science and Technology, 2019,24: 360-370.
[35]	SUN F C , ZHANG W C , CHEN J H ,et al. Fused fuzzy petri nets:a shared control method for brain-computer interface systems[J]. IEEE Transactions on Cognitive and Developmental Systems, 2018,11: 188-199.
[36]	SHI T W , WANG H , ZHANG C . Brain computer interface system based on indoor semi-autonomous navigation and motor imagery for unmanned aerial vehicle control[J]. Expert Systems with Applications, 2015,42: 4196-4206.
[37]	DUAN F , LIN D X , LI W Y ,et al. Design of a multimodal EEG-based hybrid BCI system with visual servo module[J]. IEEE Transactions on Autonomous Mental Development, 2015,7: 332-341.
[38]	张超, 熊馨, 任泓锦 ,等. 直接脑控多机器人协作任务研究[J]. 生物医学工程学杂志, 2018,35(6): 943-952.
	ZHANG C , XIONG X , REN H J ,et al. Direct brain-controlled multi-robot cooperation task[J]. Journal of Biomedical Engineering, 2018,35(6): 943-952.
[39]	KIRCHNER E A , KIM S K , TABIE M ,et al. An intelligent man-machine interface-multi-robot control adapted for task engagement based on single-trial detectability of P300[J]. Frontiers in Human Neuroscience, 2016,10: 291.
[40]	ZHAO S , LI Z J , CUI R C ,et al. Brain-machine interfacing-based teleoperation of multiple coordinated mobile robots[J]. IEEE Transactions on Industrial Electronics, 2016,64: 5161-5170.
[41]	FARWELL L A , DONCHIN E . Talking off the top of your head:toward a mental prosthesis utilizing event-related brain potentials[J]. Electroencephalography and Clinical Neurophysiology, 1988,70: 510-523.
[42]	TANG J S , ZHOUZ T . A shared-control based BCI system:for a robotic arm control[C]// Proceedings of the 1st International Conference on Electronics Instrumentation and Information Systems.[S.l.:s.n.], 2017: 1-5.
[43]	REGAN D . Some characteristics of average steady-state and transient responses evoked by modulated light[J]. Electroencephalography and Clinical Neurophysiology, 1966,20(3): 238-248.
[44]	DUAN J D , LI Z J , YANG C G ,et al. Shared control of a brain-actuated intelligent wheelchair[C]// Proceedings of the 11th World Congress on Intelligent Control and Automation. Piscataway:IEEE Press, 2015: 341-346.
[45]	LI Z J , ZHAO S N , DUAN J D ,et al. Human cooperative wheelchair with brain-machine interaction based on shared control strategy[J]. IEEE/ASME Transactions on Mechatronics, 2017,22(1): 185-195.
[46]	JEANNEROD M . The representing brain:neural correlates of motor intention and imagery[J]. Behavioral and Brain Sciences, 1994,17(2): 187-202.
[47]	GANDHI V , PRASAD G , COYLE D ,et al. EEG-based mobile robot control through an adaptive brain-robot interface[J]. IEEE Transactions on Systems Man and Cybernetics Systems, 2014,44(9): 1278-1285.
[48]	PHILIPS J , MILLáNJ D R , VANACKER G ,et al. Adaptive shared control of a brain-actuated simulated wheelchair[C]// Proceedings of the 2007 IEEE 10th International Conference on Rehabilitation Robotics. Piscataway:IEEE Press, 2007.
[49]	王仲朋, 陈龙, 何峰 ,等. 面向康复与辅助应用的脑-机接口趋势与展望[J]. 仪器仪表学报, 2017,38(6): 1307-1318.
	WANG Z P , CHEN L , HE F ,et al. Development trend and prospect of BCI technology facing rehabilitation and assisting applications[J]. Chinese Journal of Scientific Instrument, 2017,38(6): 1307-1318.
[50]	HUANG D D , QIAN K , FEI D Y ,et al. Electroencephalography (EEG)-based brain-computer interface (BCI):a 2-D virtual wheelchair control based on event-related desynchronization/synchronization and state control[J]. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2012,20(3): 379-388.
[51]	胡章芳, 张力, 徐渝松 ,等. 混合脑机接口的研究现状及应用[J]. 重庆邮电大学学报(自然科学版), 2018,30(4): 511-517.
	HU Z F , ZHANG L , XU Y S ,et al. Research status and application based on hybrid brain computer interface[J]. Journal of Chongqing University of Posts and Telecommunications (Natural Science Edition), 2018,30(4): 511-517.
[52]	ZHANG W C , SUN F C , LIU C F ,et al. A hybrid EEG-based BCI for robot grasp controlling[C]// Proceedings of the 2017 IEEE International Conference on Systems,Man and Cybernetics. Piscataway:IEEE Press, 2017.
[53]	MCMULLEN D P , HOTSON G , KATYAL K D ,et al. Demonstration of a semi-autonomous hybrid brain-machine interface using human intracranial EEG,eye tracking,and computer vision to control a robotic upper limb prosthetic[J]. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2014,22: 784-796.
[54]	MILLIKEN L , HOLLINGER G A . Modeling user expertise for choosing levels of shared autonomy[C]// Proceedings of the 2017 IEEE International Conference on Robotics and Automation. Piscataway:IEEE Press, 2017: 2285-2291.
[55]	DENG X Y , YU Z L , LIN C G ,et al. Self-adaptive shared control with brain state evaluation network for human-wheelchair cooperation[J]. Journal of Neural Engineering, 2020,17: 45005.
[56]	戴廷飞, 刘邈, 叶阳阳 ,等. 人机共享控制机器人系统的应用与发展[J]. 仪器仪表学报, 2019,40(3): 62-73.
	DAI T F , LIU M , YE Y Y ,et al. Application and development of human-machine shared control robot system[J]. Chinese Journal of Scientific Instrument, 2019,40(3): 62-73.
[57]	刘佳, 陈增强, 刘忠信 . 多智能体系统及其协同控制研究进展[J]. 智能系统学报, 2010,5(1): 1-9.
	LIU J , CHEN Z Q , LIU Z X . Advances in multi-agent systems and cooperative control[J]. CAAI Transactions on Intelligent Systems, 2010,5(1): 1-9.
[58]	李方博, 龚安民, 刘方毅 ,等. 基于运动想象的双脑脑机接口系统设计与鼠标控制应用[J]. 科学技术与工程, 2018,18(27): 170-175.
	LI F B , GONG A M , LIU F Y ,et al. Design of double brain brain-computer interface system based motor imagery and application of mouse-control[J]. Science Technology and Engineering, 2018,18(27): 170-175.

基于脑机接口的人机共享控制技术研究

Research on human-computer shared control technology based on brain-computer interface

在线阅读

PDF下载

可视化

摘要/Abstract

引用本文

使用本文

图/表 2

参考文献 58

相关文章 4

Metrics

推荐阅读 0

[1]	徐德, 秦方博. 机器人自动轴孔装配研究进展[J]. 智能科学与技术学报, 2022, 4(2): 200-211.
[2]	吕宝粮, 张亚倩, 郑伟龙. 情感脑机接口研究综述[J]. 智能科学与技术学报, 2021, 3(1): 36-48.
[3]	高寒冰, 张驰, 靳明艳, 肖杨, 丛丰裕. 基于多源域自适应的跨被试情感脑电识别[J]. 智能科学与技术学报, 2021, 3(1): 59-64.
[4]	张俊,李灵犀,林懿伦,张天韵,张科,许沛东,阮克羽,沈聃. 虚实系统互驱的混合增强智能开放创新平台的架构与方案[J]. 智能科学与技术学报, 2019, 1(4): 379-391.