Chinese Journal of Intelligent Science and Technology ›› 2021, Vol. 3 ›› Issue (1): 85-92.doi: 10.11959/j.issn.2096-6652.202109
• Papers and Reports • Previous Articles Next Articles
Xiaoyan DENG, Zhuliang YU, Canguang LIN, Zhenghui GU, Yuanqing LI
Revised:
2020-02-08
Online:
2021-03-15
Published:
2021-03-01
Supported by:
CLC Number:
Xiaoyan DENG, Zhuliang YU, Canguang LIN, et al. Research on human-computer shared control technology based on brain-computer interface[J]. Chinese Journal of Intelligent Science and Technology, 2021, 3(1): 85-92.
[1] | RYBSKI P E , YOON K , STOLARZ J ,et al. Interactive robot task training through dialog and demonstration[C]// Proceedings of the 2nd ACM/IEEE International Conference on Human-Robot Interaction. New York:ACM Press, 2007. |
[2] | GOODRICH M A , SCHULTZ A C . Human-robot interaction:a survey[M].[S.l.]: Now Publishers Inc., 2008. |
[3] | WOLPAW J R , BIRBAUMER N , MCFARLAND D J ,et al. Braincomputer interfaces for communication and control[J]. Clinical Neurophysiology, 2002,113(6): 767-791. |
[4] | WILSON J A , FELTON E A , GARELL P C ,et al. ECoG factors underlying multimodal control of a brain-computer interface[J]. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2006,14(2): 246-250. |
[5] | CHAPIN J K , MOXON K A , MARKOWITZ R S ,et al. Real-time control of a robot arm using simultaneously recorded neurons in the motor cortex[J]. Nature Neuroscience, 1999,2(7): 664-670. |
[6] | HOCHBERG L R , BACHER D , JAROSIEWICZ B ,et al. Reach and grasp by people with tetraplegia using a neurally controlled robotic arm[J]. Nature, 2013,485(7398): 372-375. |
[7] | KIM D J , HAZLETT-KNUDSEN R , CULVER-GODFREY H ,et al. How autonomy impacts performance and satisfaction:results from a study with spinal cord injured subjects using an assistive robot[J]. IEEE Transactions on Systems,Man,and Cybernetics-Part A:Systems and Humans, 2011,42(1): 2-14. |
[8] | DIEZ P F , MüLLER S M T , MUT V A ,et al. Commanding a robotic wheelchair with a high-frequency steady-state visual evoked potential based brain-computer interface[J]. Medical Engineering and Physics, 2013,35(8): 1155-1164. |
[9] | TANAKA K , MATSUNAGA K , WANG H O . Electroencephalogram-based control of an electric wheelchair[J]. IEEE Transactions on Robotics, 2005,21(4): 762-766. |
[10] | CHOI K , CICHOCKI A . Control of a wheelchair by motor imagery in real time[C]// Proceedings of the 9th International Conference on Intelligent Data Engineering and Automated Learning.[S.l.:s.n.], 2008. |
[11] | LOPES A C , PIRES G , NUNES U . Assisted navigation for a brain-actuated intelligent wheelchair[J]. Robotics and Autonomous Systems, 2013,61: 245-258. |
[12] | FIFER M S , HOTSON G , WESTER B A ,et al. Simultaneous neural control of simple reaching and grasping with the modular prosthetic limb using intracranial EEG[J]. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2014,22(3): 695-705. |
[13] | VIDAURRE C , KLAUER C , SCHAUER T ,et al. EEG-based BCI for the linear control of an upper-limb neuroprosthesis[J]. Medical Engineering and Physics, 2016: 1195-1204. |
[14] | HORTAL E , PLANELLES D , COSTA A ,et al. SVM-based brain-machine interface for controlling a robot arm through four mental tasks[J]. Neurocomputing, 2015,151(1): 116-121. |
[15] | BI L Z , FAN X A , LIU Y L . EEG-based brain-controlled mobile robots:a survey[J]. IEEE Transactions on Human-Machine Systems, 2013,43(2): 161-176. |
[16] | DASGUPTA S , FANTON M , PHAM J ,et al. Brain controlled robotic platform using steady state visual evoked potentials acquired by EEG[C]// Proceedings of the 45th Asilomar Conference on Signals,Systems and Computers. Piscataway:IEEE Press, 2011. |
[17] | LONG J Y , LI Y Q , WANG H T ,et al. A hybrid brain computer interface to control the direction and speed of a simulated or real wheelchair[J]. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2012,20(5): 720-729. |
[18] | MILLAN J R , RENKENS F , MOURINO J ,et al. Noninvasive brain-actuated control of a mobile robot by human EEG[J]. IEEE Transactions on Biomedical Engineering, 2004,51(6): 1026-1033. |
[19] | SATTI A R , COYLE D,PRASADG . Self-paced brain-controlled wheelchair methodology with shared and automated assistive control[C]// Proceedings of the 2011 IEEE Symposium on Computational Intelligence,Cognitive Algorithms,Mind,and Brain. Piscataway:IEEE Press, 2011. |
[20] | ZHANG Z J , HUANG Y Q , CHEN S Y ,et al. An intention-driven semi-autonomous intelligent robotic system for drinking[J]. Frontiers in Neurorobotics, 2017,11: 1-14. |
[21] | BURGARD W , CREMERS A B , FOX D ,et al. Experiences with an interactive museum tour-guide robot[J]. Artificial Intelligence, 1999,114(1-2): 3-55. |
[22] | BOURHIS G , AGOSTINI Y . The vahm robotized wheelchair:system architecture and human-machine interaction[J]. Journal of Intelligent and Robotic Systems, 1998,22(1): 39-50. |
[23] | ITURRATE I , ANTELIS J M , KUBLER A ,et al. A noninvasive brain-actuated wheelchair based on a P300 neurophysiological protocol and automated navigation[J]. IEEE Transactions on Robotics, 2009,25(3): 614-627. |
[24] | MANDEL C , LUTH T , LAUE T ,et al. Navigating a smart wheelchair with a brain-computer interface interpreting steady-state visual evoked potentials[C]// Proceedings of the 31st 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems. Piscataway:IEEE Press, 2009: 1118-1125. |
[25] | MILLAN J J D R , GALAN F , VANHOOYDONCK D ,et al. Asynchronous non-invasive brain-actuated control of an intelligent wheelchair[C]// Proceedings of the 31st International Conference of the IEEE Engineering in Medicine and Biology Society.[S.l.:s.n.], 2009. |
[26] | YANG C G , WU H W , LI Z J ,et al. Mind control of a robotic arm with visual fusion technology[J]. IEEE Transactions on Industrial Informatics, 2018,14: 3822-3830. |
[27] | PERRIN X , CHAVARRIAGA R , COLAS F ,et al. Brain-coupled interaction for semi-autonomous navigation of an assistive robot[J]. Robotics and Autonomous Systems, 2010,58(12): 1246-1255. |
[28] | VANACKER G , MILLáN J R , LEW E ,et al. Context-based filtering for assisted brain-actuated wheelchair driving[J]. Computational Intelligence and Neuroscience, 2010,2007: 25130. |
[29] | DENG X Y , YU Z L , LIN C G ,et al. A Bayesian shared control approach for wheelchair robot with brain machine interface[J]. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2020,28: 328-338. |
[30] | ZHANG R , LI Y Q , YAN Y Y ,et al. Control of a wheelchair in an indoor environment based on a brain-computer interface and automated navigation[J]. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2016,24: 128-139. |
[31] | ABU-ALQUMSAN M , EBERT F , PEER A . Goal-recognition-based adaptive brain-computer interface for navigating immersive robotic systems[J]. Journal of Neural Engineering, 2017,14: 036024. |
[32] | STAWICKI P , GEMBLER F , VOLOSYAK I . Driving a semiautonomous mobile robotic car controlled by an SSVEP-based BCI[J]. Computational Intelligence and Neuroscience, 2016: 4909685. |
[33] | XU Y , DING C , SHU X K ,et al. Shared control of a robotic arm using non-invasive brain-computer interface and computer vision guidance[J]. Robotics and Autonomous Systems, 2019,115(6). |
[34] | ZHANG W C , SUN F C , WU H ,et al. Asynchronous brain-computer interface shared control of robotic grasping[J]. Tsinghua Science and Technology, 2019,24: 360-370. |
[35] | SUN F C , ZHANG W C , CHEN J H ,et al. Fused fuzzy petri nets:a shared control method for brain-computer interface systems[J]. IEEE Transactions on Cognitive and Developmental Systems, 2018,11: 188-199. |
[36] | SHI T W , WANG H , ZHANG C . Brain computer interface system based on indoor semi-autonomous navigation and motor imagery for unmanned aerial vehicle control[J]. Expert Systems with Applications, 2015,42: 4196-4206. |
[37] | DUAN F , LIN D X , LI W Y ,et al. Design of a multimodal EEG-based hybrid BCI system with visual servo module[J]. IEEE Transactions on Autonomous Mental Development, 2015,7: 332-341. |
[38] | 张超, 熊馨, 任泓锦 ,等. 直接脑控多机器人协作任务研究[J]. 生物医学工程学杂志, 2018,35(6): 943-952. |
ZHANG C , XIONG X , REN H J ,et al. Direct brain-controlled multi-robot cooperation task[J]. Journal of Biomedical Engineering, 2018,35(6): 943-952. | |
[39] | KIRCHNER E A , KIM S K , TABIE M ,et al. An intelligent man-machine interface-multi-robot control adapted for task engagement based on single-trial detectability of P300[J]. Frontiers in Human Neuroscience, 2016,10: 291. |
[40] | ZHAO S , LI Z J , CUI R C ,et al. Brain-machine interfacing-based teleoperation of multiple coordinated mobile robots[J]. IEEE Transactions on Industrial Electronics, 2016,64: 5161-5170. |
[41] | FARWELL L A , DONCHIN E . Talking off the top of your head:toward a mental prosthesis utilizing event-related brain potentials[J]. Electroencephalography and Clinical Neurophysiology, 1988,70: 510-523. |
[42] | TANG J S , ZHOUZ T . A shared-control based BCI system:for a robotic arm control[C]// Proceedings of the 1st International Conference on Electronics Instrumentation and Information Systems.[S.l.:s.n.], 2017: 1-5. |
[43] | REGAN D . Some characteristics of average steady-state and transient responses evoked by modulated light[J]. Electroencephalography and Clinical Neurophysiology, 1966,20(3): 238-248. |
[44] | DUAN J D , LI Z J , YANG C G ,et al. Shared control of a brain-actuated intelligent wheelchair[C]// Proceedings of the 11th World Congress on Intelligent Control and Automation. Piscataway:IEEE Press, 2015: 341-346. |
[45] | LI Z J , ZHAO S N , DUAN J D ,et al. Human cooperative wheelchair with brain-machine interaction based on shared control strategy[J]. IEEE/ASME Transactions on Mechatronics, 2017,22(1): 185-195. |
[46] | JEANNEROD M . The representing brain:neural correlates of motor intention and imagery[J]. Behavioral and Brain Sciences, 1994,17(2): 187-202. |
[47] | GANDHI V , PRASAD G , COYLE D ,et al. EEG-based mobile robot control through an adaptive brain-robot interface[J]. IEEE Transactions on Systems Man and Cybernetics Systems, 2014,44(9): 1278-1285. |
[48] | PHILIPS J , MILLáNJ D R , VANACKER G ,et al. Adaptive shared control of a brain-actuated simulated wheelchair[C]// Proceedings of the 2007 IEEE 10th International Conference on Rehabilitation Robotics. Piscataway:IEEE Press, 2007. |
[49] | 王仲朋, 陈龙, 何峰 ,等. 面向康复与辅助应用的脑-机接口趋势与展望[J]. 仪器仪表学报, 2017,38(6): 1307-1318. |
WANG Z P , CHEN L , HE F ,et al. Development trend and prospect of BCI technology facing rehabilitation and assisting applications[J]. Chinese Journal of Scientific Instrument, 2017,38(6): 1307-1318. | |
[50] | HUANG D D , QIAN K , FEI D Y ,et al. Electroencephalography (EEG)-based brain-computer interface (BCI):a 2-D virtual wheelchair control based on event-related desynchronization/synchronization and state control[J]. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2012,20(3): 379-388. |
[51] | 胡章芳, 张力, 徐渝松 ,等. 混合脑机接口的研究现状及应用[J]. 重庆邮电大学学报(自然科学版), 2018,30(4): 511-517. |
HU Z F , ZHANG L , XU Y S ,et al. Research status and application based on hybrid brain computer interface[J]. Journal of Chongqing University of Posts and Telecommunications (Natural Science Edition), 2018,30(4): 511-517. | |
[52] | ZHANG W C , SUN F C , LIU C F ,et al. A hybrid EEG-based BCI for robot grasp controlling[C]// Proceedings of the 2017 IEEE International Conference on Systems,Man and Cybernetics. Piscataway:IEEE Press, 2017. |
[53] | MCMULLEN D P , HOTSON G , KATYAL K D ,et al. Demonstration of a semi-autonomous hybrid brain-machine interface using human intracranial EEG,eye tracking,and computer vision to control a robotic upper limb prosthetic[J]. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2014,22: 784-796. |
[54] | MILLIKEN L , HOLLINGER G A . Modeling user expertise for choosing levels of shared autonomy[C]// Proceedings of the 2017 IEEE International Conference on Robotics and Automation. Piscataway:IEEE Press, 2017: 2285-2291. |
[55] | DENG X Y , YU Z L , LIN C G ,et al. Self-adaptive shared control with brain state evaluation network for human-wheelchair cooperation[J]. Journal of Neural Engineering, 2020,17: 45005. |
[56] | 戴廷飞, 刘邈, 叶阳阳 ,等. 人机共享控制机器人系统的应用与发展[J]. 仪器仪表学报, 2019,40(3): 62-73. |
DAI T F , LIU M , YE Y Y ,et al. Application and development of human-machine shared control robot system[J]. Chinese Journal of Scientific Instrument, 2019,40(3): 62-73. | |
[57] | 刘佳, 陈增强, 刘忠信 . 多智能体系统及其协同控制研究进展[J]. 智能系统学报, 2010,5(1): 1-9. |
LIU J , CHEN Z Q , LIU Z X . Advances in multi-agent systems and cooperative control[J]. CAAI Transactions on Intelligent Systems, 2010,5(1): 1-9. | |
[58] | 李方博, 龚安民, 刘方毅 ,等. 基于运动想象的双脑脑机接口系统设计与鼠标控制应用[J]. 科学技术与工程, 2018,18(27): 170-175. |
LI F B , GONG A M , LIU F Y ,et al. Design of double brain brain-computer interface system based motor imagery and application of mouse-control[J]. Science Technology and Engineering, 2018,18(27): 170-175. |
[1] | De XU, Fangbo QIN. Research development on automated robotic peg-in-hole assembly [J]. Chinese Journal of Intelligent Science and Technology, 2022, 4(2): 200-211. |
[2] | Bao-Liang LU, Yaqian ZHANG, Wei-Long ZHENG. A survey of affective brain-computer interface [J]. Chinese Journal of Intelligent Science and Technology, 2021, 3(1): 36-48. |
[3] | Hanbing GAO, Chi ZHANG, Mingyan JIN, Yang XIAO, Fengyu CONG. Cross-subject emotional EEG recognition based on multi-source domain adaptation [J]. Chinese Journal of Intelligent Science and Technology, 2021, 3(1): 59-64. |
[4] | Jun ZHANG,Lingxi LI,Yilun LIN,Tianyun ZHANG,Ke ZHANG,Peidong XU,Keyu RUAN,Dan SHEN. The architecture and scheme of the hybrid-augmented intelligence open innovation platform based on the virtual and real systems [J]. Chinese Journal of Intelligent Science and Technology, 2019, 1(4): 379-391. |
Viewed | ||||||
Full text |
|
|||||
Abstract |
|
|||||
|