Enhanced Named Entity Recognition Based on Multi-Feature Fusion Using Dual Graph Neural Networks
Journal Title: Acadlore Transactions on AI and Machine Learning - Year 2024, Vol 3, Issue 2
Abstract
Named Entity Recognition (NER), a pivotal task in information extraction, is aimed at identifying named entities of various types within text. Traditional NER methods, however, often fall short in providing sufficient semantic representation of text and preserving word order information. Addressing these challenges, a novel approach is proposed, leveraging dual Graph Neural Networks (GNNs) based on multi-feature fusion. This approach constructs a co-occurrence graph and a dependency syntax graph from text sequences, capturing textual features from a dual-graph perspective to overcome the oversight of word interdependencies. Furthermore, Bidirectional Long Short-Term Memory Networks (BiLSTMs) are utilized to encode text, addressing the issues of neglecting word order features and the difficulty in capturing contextual semantic information. Additionally, to enable the model to learn features across different subspaces and the varying degrees of information significance, a multi-head self-attention mechanism is introduced for calculating internal dependency weights within feature vectors. The proposed model achieves F1-scores of 84.85% and 96.34% on the CCKS-2019 and Resume datasets, respectively, marking improvements of 1.13 and 0.67 percentage points over baseline models. The results affirm the effectiveness of the presented method in enhancing performance on the NER task.
Authors and Affiliations
Hanzhao Gu,Jialin Ma,Yanran Zhao,Ashim Khadka
Keywords
Related Articles
- EP ID EP740738
- DOI -
- Views 56
- Downloads 0
A Novel Machine Learning Approach for Optimizing Radar Warning Receiver Preprogramming
Radar warning receivers (RWRs) are critical for swiftly and accurately identifying potential threats in complex electromagnetic environments. Numerous methods have been developed over the years, with recent advances in a...
Predictive Modelling of Employee Attrition Using Deep Learning
This investigation delineates an optimised predictive model for employee attrition within a substantial workforce, identifying pertinent models tailored to the specific context of employee and organisational variables. T...
Innovative Hybrid Deep Learning Models for Financial Sentiment Analysis
This study explores hybrid deep learning architectures for the classification of financial sentiment, focusing on the integration of the Convolutional Neural Network (CNN) with the Support Vector Machine (SVM) and the Ra...
A Survey on Multimedia Ontologies for a Semantic Annotation of Cinematographic Resources for the Web of Data
The Semantic Web provides approaches and tools that allow for the processing and analysis of online content, including multimedia resources. Multimedia resources like videos, audios, and photos are increasingly common in...
Performance Evaluation of ANN Models for Prediction
One of the biggest problems that humans are faced with today is pollution and climate change. Pollution is not a new phenomenon and remains a leading cause of diseases and deaths. Mining, industrialization, exploration a...