Please wait a minute...

大连海洋大学学报  2022, Vol. 37 Issue (3): 524-530    DOI: 10.16535/j.cnki.dlhyxb.2022-047
  |
基于多核卷积神经网络(BERT+Multi-CNN+CRF)的水产医学嵌套命名实体识别
刘巨升,于红*,杨惠宁,邵立铭,宋奇书,李光宇,张思佳,孙华
1.大连海洋大学 信息工程学院,辽宁省海洋信息技术重点实验室,辽宁 大连 116023;2.设施渔业教育部重点实验室(大连海洋大学),辽宁 大连 116023
Recognition of nested named entities in aquature medicine based on multi-kernel convolution (BERT+Multi-CNN+CRF)
LIU Jusheng,YU Hong*,YANG Huining,SHAO Liming,SONG Qishu,LI Guangyu,ZHANG Sijia,SUN Hua
1.College of Information Engineering,Key Laboratory of Marine Information Technology of Liaoning Province,Dalian Ocean University,Dalian 116023,China;2.Key Laboratory of Environment Controlled Aquaculture(Dalian Ocean University),Ministry of Education,Dalian 116023,China
下载:  HTML  PDF (3220KB) 
输出:  BibTeX | EndNote (RIS)      
摘要 为解决水产医学命名实体识别中存在的嵌套实体识别准确率不高的问题,提出一种基于多核卷积的命名实体识别模型(BERT+Multi-CNN+CRF),采用多核卷积神经网络提取嵌套实体特征,通过BERT(bidirectional encoder representations from transformers)方法对输入语料进行预训练,丰富嵌套实体位置向量信息,获得嵌套实体输入特征矩阵,将提取特征矩阵与输入特征矩阵融合,以增强嵌套实体的特征表示,并进行不同模型的对比试验。结果表明,本文中提出的BERT+Multi-CNN+CRF模型,在水产医学嵌套命名实体识别任务中的准确率、召回率和F1值分别为88.04%、88.92%和88.48%,与识别准确率较高的BERT+BiLSTM+ATT+CRF模型相比,分别提高了2.25%、3.23%和2.74%。研究表明,本文中提出的BERT+Multi-CNN+CRF模型可有效解决水产医学嵌套实体识别准确率不高的问题,是一种有效的水产医学嵌套命名实体识别方法。
服务
把本文推荐给朋友
加入引用管理器
E-mail Alert
RSS
作者相关文章
关键词:  水产医学  BERT  嵌套命名实体识别  卷积神经网络  多卷积核    
Abstract: To address the problem of low accuracy of nested named entity recognition in named entity recognition in aquature medicine,a named entity recognition method is proposed based on multi-core convolutional neural networks (BERT+Multi-CNN+CRF).Multi-core convolutional neural networks are used to extract nested entity features,while BERT (bidirectional encoder representations from transformers) is used to pre-train the input corpus to obtain nested entity input feature matrix and enhance the position vector of nested entity.Then the extracted feature matrix is fused with the input feature matrix to enhance the feature representation of nested entities.Comparison experiments of different models verified the recognition effectiveness of the proposed model,with the accuracy of 88.04%,recall of 88.92% and F1 values of 88.48% in the proposed BERT+Multi-CNN+CRF model in the nested NER task in aquature medicine.Compared with the BERT+BiLSTM+ATT+CRF model which has good recognition ability,the accuracy,recall,and F1 value of the proposed model are improved by 2.25%,3.23%,and 2.74% respectively.The finding shows that the model proposed in this paper can effectively solve the problem of low accuracy of NER in aquaculture medicine,and is an effective method for nested NER recognition in aquatic medicine.
Key words:  aquaculture medicine    BERT    nested named entity recognition    convolutional neural network    multiple convolution kernel
               出版日期:  2022-08-04      发布日期:  2022-08-04      期的出版日期:  2022-08-04
中图分类号:  S 932.2  
  TP 391  
基金资助: 设施渔业教育部重点实验室开放课题(2021-MOEKLECA-KF-05);国家自然科学基金(61802046)
引用本文:    
刘巨升, 于红, 杨惠宁, 邵立铭, 宋奇书, 李光宇, 张思佳, 孙华. 基于多核卷积神经网络(BERT+Multi-CNN+CRF)的水产医学嵌套命名实体识别[J]. 大连海洋大学学报, 2022, 37(3): 524-530.
LIU Jusheng, YU Hong, YANG Huining, SHAO Liming, SONG Qishu, LI Guangyu, ZHANG Sijia, SUN Hua. Recognition of nested named entities in aquature medicine based on multi-kernel convolution (BERT+Multi-CNN+CRF). Journal of Dalian Ocean University, 2022, 37(3): 524-530.
链接本文:  
https://xuebao.dlou.edu.cn/CN/10.16535/j.cnki.dlhyxb.2022-047  或          https://xuebao.dlou.edu.cn/CN/Y2022/V37/I3/524
[1] 张胜茂, 孙永文, 樊伟, 唐峰华, 崔雪森, 伍玉梅. 面向海洋渔业捕捞生产的深度学习方法应用研究进展[J]. 大连海洋大学学报, 2022, 37(4): 683-337.
[2] 何津民, 张丽珍. 基于自注意力机制和CNN-LSTM深度学习的对虾投饵量预测模型[J]. 大连海洋大学学报, 2022, 37(2): 304-311.
[3] 杨鹤, 于红, 刘巨升, 杨惠宁, 孙哲涛, 程名, 任媛, 张思佳. 基于BERT+BiLSTM+CRF深度学习模型和多元组合数据增广的渔业标准命名实体识别[J]. 大连海洋大学学报, 2021, 36(4): 661-669.
[4] 袁红春, 刘慧, 张硕, 陈冠奇. 基于深度学习和典型相关分析的渔情预测方法[J]. 大连海洋大学学报, 2021, 36(4): 670-678.
[5] 贺琳, 张雨, 巴韩飞. 基于注意力机制和深度学习模型的外来海洋生物命名实体识别[J]. 大连海洋大学学报, 2021, 36(3): 503-509.
[6] 于亚群, 田涛, 陈勇, 刘永虎, 尹增强, 陈雷, 王刚. 獐子岛深水人工鱼礁区大泷六线鱼生长特性研究[J]. 大连海洋大学学报, 2016, 31(2): 205-210.
[7] 孙成波, 李婷, 李义军, 王平, 徐安敏, 孙成志, 李咏. 高位池精养日本囊对虾的生长规律[J]. 大连海洋大学学报, 2011, 26(4): 316-321.
No Suggested Reading articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed