Artificial Intelligence in Healthcare Text Processing: A Review Applied to Named Entity Recognition

Samuel Santana De Almeida^1*Raphael Silva Fontes²Luca Pareja Credidio Freire Alves³Methanias Colaço Júnior^1,2,3Gleyson José Pinheiro Caldeira Silva²Lyane Ramalho Cortez³Antonio Higor Freire de Morais²Guilherme Medeiros Machado⁴Hugo Gonçalo Oliveira⁵Aliete Cunha-Oliveira⁶João Paulo Queiroz dos Santos²Ricardo Valentim³

• ¹Federal University of Sergipe, São Cristóvão, Brazil
• ²Instituto Federal do Rio Grande do Norte, Natal, Rio Grande do Norte, Brazil
• ³Federal University of Rio Grande do Norte, Natal, Rio Grande do Norte, Brazil
• ⁴School of Engineering of the City of Paris, Paris, France
• ⁵Department of Informatics Engineering, Faculty of Engineering, University of Porto, Porto, Portugal
• ⁶Coimbra Nursing School, Coimbra, Coimbra, Portugal

We examine the growing importance of NER in the analysis of healthcare texts. NER, a fundamental technique in Natural Language Processing (NLP), automatically identifies and categorizes named entities in the text, such as names of people and organizations, in medical texts, medical conditions and drug names. This facilitates better information retrieval, personalized medicine approaches and clinical decision support systems. Problem: Traditional methods such as rule-based systems, word embeddings (e.g. Word2Vec, GloVe) and sequence tagging models such as CRFs and HMMs have difficulty capturing the complex and nuanced context of medical texts, leading to low precision and inflexibility. These methods also often require large and difficult-to-obtain labeled datasets. Solution: Systematic mapping has focused on advanced language models, specifically transformation-based models such as BERT. These models are known for capturing complex semantic dependencies and linguistic nuances, which are crucial for accurate processing of medical texts. Transformation architectures, unlike traditional techniques such as CNNs and RNNs, are better suited to dealing with the contextual and semantic nature of medical texts due to their ability to manage long sequences and the need for high precision. Results:The results indicate that transformation-based models, in particular BERT and its specialized 1 Samuel Santana de Almeida et al.variants (e.g. ClinicalBERT), consistently demonstrate high performance on NER tasks, with F1 scores often exceeding 97%, outperforming traditional and hybrid methods. When examining the geographical distribution of contributions, the research identifies a significant contribution from China, followed by the United States. These findings have crucial implications for the integration of NER technologies into the Brazilian National Health System (SUS). In conclusion, this systematic review contributes to the advancement of NER in health texts by evaluating methods, showing results and highlighting the wider implications for the field. The article is systematically structured into the following sections: Methodology, Bibliometric analysis, Results and discussion, Threats to validity, Future work and Conclusion. This systematic organization provides a comprehensive review of the research, its impact and future directions, highlighting the importance of keeping up to date with advances in the field to increase the relevance of NER applications in healthcare.