基于脑机接口的人机共享控制技术研究

doi:10.11959/j.issn.2096-6652.202109

Abstract

Abstract:

As an active research direction in the field of neural engineering, brain-computer interface (BCI) has important research significance in biomedicine, neural rehabilitation, intelligent robot and other fields.The human-computer shared control technology based on BCI combines the advantages of human and machine intelligence, and has many advantages compared with the direct control BCI control technology.The human-computer shared control based on non-invasive BCI was classified and introduced from different points of view, and the future research direction and development trend of the human-computer shared control system based on BCI were forecasted to provide new ideas and directions.

Key words: brain-computer interface, human-computer interaction, shared control, intelligent robot

CLC Number:

TP242

Xiaoyan DENG, Zhuliang YU, Canguang LIN, et al. Research on human-computer shared control technology based on brain-computer interface[J]. Chinese Journal of Intelligent Science and Technology, 2021, 3(1): 85-92.

Figures/Tables 2

References 58

[1]	RYBSKI P E , YOON K , STOLARZ J ,et al. Interactive robot task training through dialog and demonstration[C]// Proceedings of the 2nd ACM/IEEE International Conference on Human-Robot Interaction. New York:ACM Press, 2007.
[2]	GOODRICH M A , SCHULTZ A C . Human-robot interaction:a survey[M].[S.l.]: Now Publishers Inc., 2008.
[3]	WOLPAW J R , BIRBAUMER N , MCFARLAND D J ,et al. Braincomputer interfaces for communication and control[J]. Clinical Neurophysiology, 2002,113(6): 767-791.
[4]	WILSON J A , FELTON E A , GARELL P C ,et al. ECoG factors underlying multimodal control of a brain-computer interface[J]. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2006,14(2): 246-250.
[5]	CHAPIN J K , MOXON K A , MARKOWITZ R S ,et al. Real-time control of a robot arm using simultaneously recorded neurons in the motor cortex[J]. Nature Neuroscience, 1999,2(7): 664-670.
[6]	HOCHBERG L R , BACHER D , JAROSIEWICZ B ,et al. Reach and grasp by people with tetraplegia using a neurally controlled robotic arm[J]. Nature, 2013,485(7398): 372-375.
[7]	KIM D J , HAZLETT-KNUDSEN R , CULVER-GODFREY H ,et al. How autonomy impacts performance and satisfaction:results from a study with spinal cord injured subjects using an assistive robot[J]. IEEE Transactions on Systems,Man,and Cybernetics-Part A:Systems and Humans, 2011,42(1): 2-14.
[8]	DIEZ P F , MüLLER S M T , MUT V A ,et al. Commanding a robotic wheelchair with a high-frequency steady-state visual evoked potential based brain-computer interface[J]. Medical Engineering and Physics, 2013,35(8): 1155-1164.
[9]	TANAKA K , MATSUNAGA K , WANG H O . Electroencephalogram-based control of an electric wheelchair[J]. IEEE Transactions on Robotics, 2005,21(4): 762-766.
[10]	CHOI K , CICHOCKI A . Control of a wheelchair by motor imagery in real time[C]// Proceedings of the 9th International Conference on Intelligent Data Engineering and Automated Learning.[S.l.:s.n.], 2008.
[11]	LOPES A C , PIRES G , NUNES U . Assisted navigation for a brain-actuated intelligent wheelchair[J]. Robotics and Autonomous Systems, 2013,61: 245-258.
[12]	FIFER M S , HOTSON G , WESTER B A ,et al. Simultaneous neural control of simple reaching and grasping with the modular prosthetic limb using intracranial EEG[J]. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2014,22(3): 695-705.
[13]	VIDAURRE C , KLAUER C , SCHAUER T ,et al. EEG-based BCI for the linear control of an upper-limb neuroprosthesis[J]. Medical Engineering and Physics, 2016: 1195-1204.
[14]	HORTAL E , PLANELLES D , COSTA A ,et al. SVM-based brain-machine interface for controlling a robot arm through four mental tasks[J]. Neurocomputing, 2015,151(1): 116-121.
[15]	BI L Z , FAN X A , LIU Y L . EEG-based brain-controlled mobile robots:a survey[J]. IEEE Transactions on Human-Machine Systems, 2013,43(2): 161-176.
[16]	DASGUPTA S , FANTON M , PHAM J ,et al. Brain controlled robotic platform using steady state visual evoked potentials acquired by EEG[C]// Proceedings of the 45th Asilomar Conference on Signals,Systems and Computers. Piscataway:IEEE Press, 2011.
[17]	LONG J Y , LI Y Q , WANG H T ,et al. A hybrid brain computer interface to control the direction and speed of a simulated or real wheelchair[J]. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2012,20(5): 720-729.
[18]	MILLAN J R , RENKENS F , MOURINO J ,et al. Noninvasive brain-actuated control of a mobile robot by human EEG[J]. IEEE Transactions on Biomedical Engineering, 2004,51(6): 1026-1033.
[19]	SATTI A R , COYLE D,PRASADG . Self-paced brain-controlled wheelchair methodology with shared and automated assistive control[C]// Proceedings of the 2011 IEEE Symposium on Computational Intelligence,Cognitive Algorithms,Mind,and Brain. Piscataway:IEEE Press, 2011.
[20]	ZHANG Z J , HUANG Y Q , CHEN S Y ,et al. An intention-driven semi-autonomous intelligent robotic system for drinking[J]. Frontiers in Neurorobotics, 2017,11: 1-14.
[21]	BURGARD W , CREMERS A B , FOX D ,et al. Experiences with an interactive museum tour-guide robot[J]. Artificial Intelligence, 1999,114(1-2): 3-55.
[22]	BOURHIS G , AGOSTINI Y . The vahm robotized wheelchair:system architecture and human-machine interaction[J]. Journal of Intelligent and Robotic Systems, 1998,22(1): 39-50.
[23]	ITURRATE I , ANTELIS J M , KUBLER A ,et al. A noninvasive brain-actuated wheelchair based on a P300 neurophysiological protocol and automated navigation[J]. IEEE Transactions on Robotics, 2009,25(3): 614-627.
[24]	MANDEL C , LUTH T , LAUE T ,et al. Navigating a smart wheelchair with a brain-computer interface interpreting steady-state visual evoked potentials[C]// Proceedings of the 31st 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems. Piscataway:IEEE Press, 2009: 1118-1125.
[25]	MILLAN J J D R , GALAN F , VANHOOYDONCK D ,et al. Asynchronous non-invasive brain-actuated control of an intelligent wheelchair[C]// Proceedings of the 31st International Conference of the IEEE Engineering in Medicine and Biology Society.[S.l.:s.n.], 2009.
[26]	YANG C G , WU H W , LI Z J ,et al. Mind control of a robotic arm with visual fusion technology[J]. IEEE Transactions on Industrial Informatics, 2018,14: 3822-3830.
[27]	PERRIN X , CHAVARRIAGA R , COLAS F ,et al. Brain-coupled interaction for semi-autonomous navigation of an assistive robot[J]. Robotics and Autonomous Systems, 2010,58(12): 1246-1255.
[28]	VANACKER G , MILLáN J R , LEW E ,et al. Context-based filtering for assisted brain-actuated wheelchair driving[J]. Computational Intelligence and Neuroscience, 2010,2007: 25130.
[29]	DENG X Y , YU Z L , LIN C G ,et al. A Bayesian shared control approach for wheelchair robot with brain machine interface[J]. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2020,28: 328-338.
[30]	ZHANG R , LI Y Q , YAN Y Y ,et al. Control of a wheelchair in an indoor environment based on a brain-computer interface and automated navigation[J]. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2016,24: 128-139.
[31]	ABU-ALQUMSAN M , EBERT F , PEER A . Goal-recognition-based adaptive brain-computer interface for navigating immersive robotic systems[J]. Journal of Neural Engineering, 2017,14: 036024.
[32]	STAWICKI P , GEMBLER F , VOLOSYAK I . Driving a semiautonomous mobile robotic car controlled by an SSVEP-based BCI[J]. Computational Intelligence and Neuroscience, 2016: 4909685.
[33]	XU Y , DING C , SHU X K ,et al. Shared control of a robotic arm using non-invasive brain-computer interface and computer vision guidance[J]. Robotics and Autonomous Systems, 2019,115(6).
[34]	ZHANG W C , SUN F C , WU H ,et al. Asynchronous brain-computer interface shared control of robotic grasping[J]. Tsinghua Science and Technology, 2019,24: 360-370.
[35]	SUN F C , ZHANG W C , CHEN J H ,et al. Fused fuzzy petri nets:a shared control method for brain-computer interface systems[J]. IEEE Transactions on Cognitive and Developmental Systems, 2018,11: 188-199.
[36]	SHI T W , WANG H , ZHANG C . Brain computer interface system based on indoor semi-autonomous navigation and motor imagery for unmanned aerial vehicle control[J]. Expert Systems with Applications, 2015,42: 4196-4206.
[37]	DUAN F , LIN D X , LI W Y ,et al. Design of a multimodal EEG-based hybrid BCI system with visual servo module[J]. IEEE Transactions on Autonomous Mental Development, 2015,7: 332-341.
[38]	张超, 熊馨, 任泓锦 ,等. 直接脑控多机器人协作任务研究[J]. 生物医学工程学杂志, 2018,35(6): 943-952.
	ZHANG C , XIONG X , REN H J ,et al. Direct brain-controlled multi-robot cooperation task[J]. Journal of Biomedical Engineering, 2018,35(6): 943-952.
[39]	KIRCHNER E A , KIM S K , TABIE M ,et al. An intelligent man-machine interface-multi-robot control adapted for task engagement based on single-trial detectability of P300[J]. Frontiers in Human Neuroscience, 2016,10: 291.
[40]	ZHAO S , LI Z J , CUI R C ,et al. Brain-machine interfacing-based teleoperation of multiple coordinated mobile robots[J]. IEEE Transactions on Industrial Electronics, 2016,64: 5161-5170.
[41]	FARWELL L A , DONCHIN E . Talking off the top of your head:toward a mental prosthesis utilizing event-related brain potentials[J]. Electroencephalography and Clinical Neurophysiology, 1988,70: 510-523.
[42]	TANG J S , ZHOUZ T . A shared-control based BCI system:for a robotic arm control[C]// Proceedings of the 1st International Conference on Electronics Instrumentation and Information Systems.[S.l.:s.n.], 2017: 1-5.
[43]	REGAN D . Some characteristics of average steady-state and transient responses evoked by modulated light[J]. Electroencephalography and Clinical Neurophysiology, 1966,20(3): 238-248.
[44]	DUAN J D , LI Z J , YANG C G ,et al. Shared control of a brain-actuated intelligent wheelchair[C]// Proceedings of the 11th World Congress on Intelligent Control and Automation. Piscataway:IEEE Press, 2015: 341-346.
[45]	LI Z J , ZHAO S N , DUAN J D ,et al. Human cooperative wheelchair with brain-machine interaction based on shared control strategy[J]. IEEE/ASME Transactions on Mechatronics, 2017,22(1): 185-195.
[46]	JEANNEROD M . The representing brain:neural correlates of motor intention and imagery[J]. Behavioral and Brain Sciences, 1994,17(2): 187-202.
[47]	GANDHI V , PRASAD G , COYLE D ,et al. EEG-based mobile robot control through an adaptive brain-robot interface[J]. IEEE Transactions on Systems Man and Cybernetics Systems, 2014,44(9): 1278-1285.
[48]	PHILIPS J , MILLáNJ D R , VANACKER G ,et al. Adaptive shared control of a brain-actuated simulated wheelchair[C]// Proceedings of the 2007 IEEE 10th International Conference on Rehabilitation Robotics. Piscataway:IEEE Press, 2007.
[49]	王仲朋, 陈龙, 何峰 ,等. 面向康复与辅助应用的脑-机接口趋势与展望[J]. 仪器仪表学报, 2017,38(6): 1307-1318.
	WANG Z P , CHEN L , HE F ,et al. Development trend and prospect of BCI technology facing rehabilitation and assisting applications[J]. Chinese Journal of Scientific Instrument, 2017,38(6): 1307-1318.
[50]	HUANG D D , QIAN K , FEI D Y ,et al. Electroencephalography (EEG)-based brain-computer interface (BCI):a 2-D virtual wheelchair control based on event-related desynchronization/synchronization and state control[J]. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2012,20(3): 379-388.
[51]	胡章芳, 张力, 徐渝松 ,等. 混合脑机接口的研究现状及应用[J]. 重庆邮电大学学报(自然科学版), 2018,30(4): 511-517.
	HU Z F , ZHANG L , XU Y S ,et al. Research status and application based on hybrid brain computer interface[J]. Journal of Chongqing University of Posts and Telecommunications (Natural Science Edition), 2018,30(4): 511-517.
[52]	ZHANG W C , SUN F C , LIU C F ,et al. A hybrid EEG-based BCI for robot grasp controlling[C]// Proceedings of the 2017 IEEE International Conference on Systems,Man and Cybernetics. Piscataway:IEEE Press, 2017.
[53]	MCMULLEN D P , HOTSON G , KATYAL K D ,et al. Demonstration of a semi-autonomous hybrid brain-machine interface using human intracranial EEG,eye tracking,and computer vision to control a robotic upper limb prosthetic[J]. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2014,22: 784-796.
[54]	MILLIKEN L , HOLLINGER G A . Modeling user expertise for choosing levels of shared autonomy[C]// Proceedings of the 2017 IEEE International Conference on Robotics and Automation. Piscataway:IEEE Press, 2017: 2285-2291.
[55]	DENG X Y , YU Z L , LIN C G ,et al. Self-adaptive shared control with brain state evaluation network for human-wheelchair cooperation[J]. Journal of Neural Engineering, 2020,17: 45005.
[56]	戴廷飞, 刘邈, 叶阳阳 ,等. 人机共享控制机器人系统的应用与发展[J]. 仪器仪表学报, 2019,40(3): 62-73.
	DAI T F , LIU M , YE Y Y ,et al. Application and development of human-machine shared control robot system[J]. Chinese Journal of Scientific Instrument, 2019,40(3): 62-73.
[57]	刘佳, 陈增强, 刘忠信 . 多智能体系统及其协同控制研究进展[J]. 智能系统学报, 2010,5(1): 1-9.
	LIU J , CHEN Z Q , LIU Z X . Advances in multi-agent systems and cooperative control[J]. CAAI Transactions on Intelligent Systems, 2010,5(1): 1-9.
[58]	李方博, 龚安民, 刘方毅 ,等. 基于运动想象的双脑脑机接口系统设计与鼠标控制应用[J]. 科学技术与工程, 2018,18(27): 170-175.
	LI F B , GONG A M , LIU F Y ,et al. Design of double brain brain-computer interface system based motor imagery and application of mouse-control[J]. Science Technology and Engineering, 2018,18(27): 170-175.

Metrics

Recommended 0

No Suggested Reading articles found!

Research on human-computer shared control technology based on brain-computer interface

RichHTML

PDF下载

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 2

References 58

Related Articles 4

Metrics

Recommended 0

[1]	De XU, Fangbo QIN. Research development on automated robotic peg-in-hole assembly [J]. Chinese Journal of Intelligent Science and Technology, 2022, 4(2): 200-211.
[2]	Bao-Liang LU, Yaqian ZHANG, Wei-Long ZHENG. A survey of affective brain-computer interface [J]. Chinese Journal of Intelligent Science and Technology, 2021, 3(1): 36-48.
[3]	Hanbing GAO, Chi ZHANG, Mingyan JIN, Yang XIAO, Fengyu CONG. Cross-subject emotional EEG recognition based on multi-source domain adaptation [J]. Chinese Journal of Intelligent Science and Technology, 2021, 3(1): 59-64.
[4]	Jun ZHANG,Lingxi LI,Yilun LIN,Tianyun ZHANG,Ke ZHANG,Peidong XU,Keyu RUAN,Dan SHEN. The architecture and scheme of the hybrid-augmented intelligence open innovation platform based on the virtual and real systems [J]. Chinese Journal of Intelligent Science and Technology, 2019, 1(4): 379-391.