Recognition of nested named entities in aquature medicine based on multi-kernel convolution (BERT+Multi-CNN+CRF)
LIU Jusheng,YU Hong*,YANG Huining,SHAO Liming,SONG Qishu,LI Guangyu,ZHANG Sijia,SUN Hua
1.College of Information Engineering,Key Laboratory of Marine Information Technology of Liaoning Province,Dalian Ocean University,Dalian 116023,China;2.Key Laboratory of Environment Controlled Aquaculture(Dalian Ocean University),Ministry of Education,Dalian 116023,China
Abstract: To address the problem of low accuracy of nested named entity recognition in named entity recognition in aquature medicine,a named entity recognition method is proposed based on multi-core convolutional neural networks (BERT+Multi-CNN+CRF).Multi-core convolutional neural networks are used to extract nested entity features,while BERT (bidirectional encoder representations from transformers) is used to pre-train the input corpus to obtain nested entity input feature matrix and enhance the position vector of nested entity.Then the extracted feature matrix is fused with the input feature matrix to enhance the feature representation of nested entities.Comparison experiments of different models verified the recognition effectiveness of the proposed model,with the accuracy of 88.04%,recall of 88.92% and F1 values of 88.48% in the proposed BERT+Multi-CNN+CRF model in the nested NER task in aquature medicine.Compared with the BERT+BiLSTM+ATT+CRF model which has good recognition ability,the accuracy,recall,and F1 value of the proposed model are improved by 2.25%,3.23%,and 2.74% respectively.The finding shows that the model proposed in this paper can effectively solve the problem of low accuracy of NER in aquaculture medicine,and is an effective method for nested NER recognition in aquatic medicine.
刘巨升, 于红, 杨惠宁, 邵立铭, 宋奇书, 李光宇, 张思佳, 孙华. 基于多核卷积神经网络(BERT+Multi-CNN+CRF)的水产医学嵌套命名实体识别[J]. 大连海洋大学学报, 2022, 37(3): 524-530.
LIU Jusheng, YU Hong, YANG Huining, SHAO Liming, SONG Qishu, LI Guangyu, ZHANG Sijia, SUN Hua. Recognition of nested named entities in aquature medicine based on multi-kernel convolution (BERT+Multi-CNN+CRF). Journal of Dalian Ocean University, 2022, 37(3): 524-530.