一种基于深度神经网络的临床记录ICD自动编码方法

doi:10.11959/j.issn.2096-0271.2020040

大数据 ›› 2020, Vol. 6 ›› Issue (5): 3-15.doi: 10.11959/j.issn.2096-0271.2020040

一种基于深度神经网络的临床记录ICD自动编码方法

杜逸超¹,徐童¹,马建辉¹,陈恩红¹,郑毅²,刘同柱³,童贵显³

¹ 中国科学技术大学计算机科学与技术学院，安徽合肥 230027
² 华为技术有限公司，浙江杭州 310007
³ 中国科学技术大学附属第一医院，安徽合肥 230027

出版日期:2020-09-20 发布日期:2020-09-29
作者简介:杜逸超（1997- ），男，中国科学技术大学计算机科学与技术学院硕士生，主要研究方向为数据挖掘、知识图谱|徐童（1988- ），男，博士，中国科学技术大学计算机科学与技术学院副教授，主要研究方向为数据挖掘|马建辉（1975- ），男，中国科学技术大学计算机科学与技术学院讲师，主要研究方向为数据挖掘|陈恩红（1968- ），男，博士，中国科学技术大学计算机科学与技术学院教授，主要研究方向为数据挖掘和机器学习|郑毅（1987- ），男，博士，华为技术有限公司自然语言处理技术专家，主要研究方向为自然语言处理和机器学习|刘同柱（1967- ），男，博士，中国科学技术大学附属第一医院副研究员，主要研究方向为健康大数据和医院管理|童贵显（1991- ），男，中国科学技术大学附属第一医院初级经济师，主要研究方向为健康大数据和医院管理
基金资助:
国家自然科学基金资助项目(U1605251);国家自然科学基金资助项目(61703386);中央高校基本科研业务费专项资金项目(WK911000014);安徽省重点研发计划项目(1804b06020377)

An automatic ICD coding method for clinical records based on deep neural network

Yichao DU¹,Tong XU¹,Jianhui MA¹,Enhong CHEN¹,Yi ZHENG²,Tongzhu LIU³,Guixian TONG³

¹ School of Computer Science and Technology,University of Science and Technology of China,Hefei 230027,China
² Huawei Technologies Co.,Ltd.,Hangzhou 310007,China
³ The First Affiliated Hospital of USTC,Hefei 230027,China

Online:2020-09-20 Published:2020-09-29
Supported by:
The National Natural Science Foundation of China(U1605251);The National Natural Science Foundation of China(61703386);The Fundamental Research Funds for the Central Universities(WK911000014);The Key Research and Development Program of Anhui Province(1804b06020377)

摘要/Abstract

摘要：

随着国际疾病分类（international classification of diseases，ICD）编码数量的增加，基于临床记录的人工编码难度和成本大大提高，自动ICD编码技术引起了广泛的关注。提出一种基于多尺度残差图卷积网络的自动ICD编码技术，该技术采用多尺度残差网络来捕获临床文本的不同长度的文本模式，并基于图卷积神经网络抽取标签之间的层次关系，以加强自动编码能力。在真实医疗数据集MIMIC-III上的实验结果表明，该方法的P@k和Micro-F1分别为72.2%和53.9%，显著提高了预测性能。

关键词: ICD编码, 多尺度, 残差网络, 图卷积网络

Abstract:

With the increase in the number of the international classification of diseases (ICD) codes,the difficulty and cost of manual coding based on clinical records have greatly increased,and automatic ICD coding technology has attracted widespread attention.A multi-scale residual graph convolution network automatic ICD coding technology was proposed.This technology uses a multi-scale residual network to capture text patterns of different lengths of clinical text and extracts the hierarchical relationship between labels based on the graph convolutional neural network to enhance the ability of automatic coding.The experimental results on the real medical data set MIMIC-III show that the P@k and Micro-F1 of this method are 72.2% and 53.9%,respectively,which significantly improves the prediction performance.

Key words: ICD coding, multi-scale, residual network, graph convolutional network

中图分类号:

TP391

杜逸超, 徐童, 马建辉, 陈恩红, 郑毅, 刘同柱, 童贵显. 一种基于深度神经网络的临床记录ICD自动编码方法[J]. 大数据, 2020, 6(5): 3-15.

Yichao DU, Tong XU, Jianhui MA, Enhong CHEN, Yi ZHENG, Tongzhu LIU, Guixian TONG. An automatic ICD coding method for clinical records based on deep neural network[J]. Big Data Research, 2020, 6(5): 3-15.

图/表 7

图1

图2

图3

图4

表1

表2

表3

参考文献 30

[1]	SCHNAKERS C , VANHAUDENHUYSE A , GIACINO J ,et al. Diagnostic accuracy of the vegetative and minimally conscious state:clinical consensus versus standardized neurobehavioral assessment[J]. BMC Neurology, 2009,9(1).
[2]	MULLENBACH J , WIEGREFFE S , DUKE J ,et al. Explainable prediction of medical codes from clinical text[C]// The 2018 Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies.[S.l.:s.n]. 2018.
[3]	JOHNSON A E W , POLLARD T J , SHEN L ,et al. MIMIC-III:a freely accessible critical care database[J]. Scientific Data, 2016(3).
[4]	LARKEY L S , CROFT W B . Combining classifiers in text categorization[C]// The 19th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. New York:ACM Press, 1996: 289-297.
[5]	FRANZ P , ZAISS A , SCHULZ S ,et al. Automated coding of diagnoses-three methods compared[C]// The AMIA Symposium.[S.l.:s.n]. 2000.
[6]	PEROTTE A , PIVOVAROV R , NATARAJAN K ,et al. Diagnosis code assignment:models and evaluation metrics[J]. Journal of the American Medical Informatics Association, 2014,21(2): 231-237.
[7]	KAVULURU R , HAN S , HARRIS D . Unsupervised extraction of diagnosis codes from EMRs using knowledgebased and extractive text summarization techniques[C]// 2013 Canadian Conference on Artificial Intelligence. Heidelberg:Springer-Verlag, 2013: 77-88.
[8]	KAVULURU R , RIOS A , LU Y . An empirical evaluation of supervised learning approaches in assigning diagnosis codes to electronic medical records[J]. Artificial Intelligence in Medicine, 2015,65(2): 155-166.
[9]	KOOPMAN B , ZUCCON G , NGUYEN A ,et al. Automatic ICD-10 classification of cancers from free-text death certificates[J]. International Journal of Medical Informatics, 2015,84(11): 956-965.
[10]	SCHEURWEGS E , CULE B , LUYCKX K ,et al. Selecting relevant features from the electronic health record for clinical code prediction[J]. Journal of Biomedical Informatics, 2017,77: 92-103.
[11]	SHICKEL B , TIGHE P J , BIHORAC A ,et al. Deep EHR:a survey of recent advances in deep learning techniques for electronic health record (EHR) analysis[J]. IEEE Journal of Biomedical and Health Informatics, 2017,22(5): 1589-1604.
[12]	LIPTON Z C , KALE D C , ELKAN C ,et al. Learning to diagnose with LSTM recurrent neural networks[J]. arXiv preprint, 2015,arXiv:1511.03677v7.
[13]	XU K , LAM M , PANG J ,et al. Multimodal machine learning for automated ICD coding[J]. arXiv preprint, 2018,arXiv:1810.13348v1.
[14]	SHI H , XIE P , HU Z ,et al. Towards automated ICD coding using deep learning[J]. arXiv preprint, 2017,arXiv:1711.04075v3.
[15]	XIE P , XING E . A neural architecture for automated ICD coding[C]// The 56th Annual Meeting of the Association for Computational Linguistics.[S.l.:s.n]. 2018: 1066-1077.
[16]	DUARTE F , MARTINS B , PINTO C S ,et al. Deep neural models for ICD-10 coding of death certificates and autopsy reports in free-text[J]. Journal of Biomedical Informatics, 2018,80: 64-77.
[17]	PRAKASH A , ZHAO S , HASAN S A ,et al. Condensed memory networks for clinical diagnostic inferencing[C]// The 31st AAAI Conference on Artificial Intelligence. Palo Alto:AAAI Press, 2017: 3274-3280.
[18]	BAUMEL T , NASSOUR-KASSIS J , COHEN R , ,et al. Multi-label classification of patient notes:case study on ICD code assignment[C]// The 32nd AAAI Conference on Artificial Intelligence. Palo Alto:AAAI Press, 2018.
[19]	ZENG M , LI M , FEI Z ,et al. Automatic ICD-9 coding via deep transfer learning[J]. Neurocomputing, 2019
[20]	CAI H , ZHENG V W , CHANG K C C . A comprehensive survey of graph embedding:problems,techniques,and applications[J]. IEEE Transactions on Knowledge and Data Engineering, 2018,30(9): 1616-1637.
[21]	BATTAGLIA P W , HAMRICK J B , BAPST V ,et al. Relational inductive biases,deep learning,and graph networks[J]. arXiv preprint, 2018,arXiv:1806.01261v3.
[22]	BRUNA J , ZAREMBA W , SZLAM A ,et al. Spectral networks and locally connected networks on graphs[J]. arXiv preprint, 2013,arXiv:1312.6203v2.
[23]	DEFFERRARD M , BRESSON X , VANDERGHEYNST P . Convolutional neural networks on graphs with fast localized spectral filtering[C]// Advances in Neural Information Processing Systems.[S.l.:s.n]. 2016.
[24]	KIPF T N , WELLING M . Semi-supervised classification with graph convolutional networks[J]. arXiv preprint, 2016,arXiv:1609.02907v4.
[25]	YAO L , MAO C , LUO Y . Graph convolutional networks for text classification[C]// The 33rd AAAI Conference on Artificial Intelligence. Palo Alto:AAAI Press, 2019.
[26]	PENG H , LI J , HE Y ,et al. Largescale hierarchical text classification with recursively regularized deep graphCNN[C]// The 2018 World Wide Web Conference.[S.l.:s.n]. 2018: 1063-1072.
[27]	RIOS A , KAVULURU R . Few-shot and zero-shot multi-label learning for structured label spaces[C]// The 2018 Conference on Empirical Methods in Natural Language Processing.[S.l.:s.n]. 2018: 3132-3142.
[28]	WANG W , XU H , GAN Z ,et al. Graphdriven generative models for heterogeneous multi-task learning[C]// The 34th AAAI Conference on Artificial Intelligence. PaloAlto:AAAI Press, 2020.
[29]	MIKOLOV T , CHEN K , CORRADO G ,et al. Efficient estimation of word representations in vector space[J]. arXiv preprint, 2013,arXiv:1301.3781v3.
[30]	KIM Y . Convolutional neural networks for sentence classification[J]. arXiv preprint, 2014,arXiv:1408.5882v2.

对比项	样本数/条	平均字符数	平均标签个数/个	标签种类/种
训练集	46 157	1 445	15.68	8 579
验证集	3 280	1 742	17.72	4 051
测试集	3 285	1 727	17.31	4 042

模型	P@k		F1		AUC
模型	8	15	Micro	Marco	Micro	Marco
LR	54.5%	41.7%	29.3%	1.2%	92.5%	57.1%
Bi-GRU	63.5%	46.2%	43.3%	4.2%	97.2%	82.4%
Text-CNN	60.1%	45.5%	43.9%	4.5%	96.9%	81.7%
DR-CAML	69.0%	55.3%	52.5%	7.2%	97.9%	87.2%
CAML	71.4%	55.6%	52.8%	7.2%	97.9%	86.4%
MSResGCN	72.2%	56.8%	53.9%	7.6%	98.3%	87.7%

模型	P@k	F1		AUC
模型	8	Micro	Macro	Micro	Macro
w/o-MSRes	71.7%	53.2%	7.5%	98.1%	87.5%
w/o-GCN	72.0%	53.8%	6.9%	98.0%	87.4%
MSResGCN	72.2%	53.9%	7.6%	98.3%	87.7%

一种基于深度神经网络的临床记录ICD自动编码方法

An automatic ICD coding method for clinical records based on deep neural network

在线阅读

PDF下载

可视化

摘要/Abstract

引用本文

使用本文

图/表 7

参考文献 30

相关文章 1

Metrics

推荐阅读 0