Dynamic Taxonomy Generation for Future Skills Identification using a Named Entity Recognition and Relation Extraction Pipeline

Luis Jose Gonzalez-Gomez¹Sofia Margarita Hernandez-Munoz²Abiel Borja²Fernando A. Arana-Salas²Jose Daniel Azofeifa^1,2Julieta Noguez²Patricia Caratozzolo^1,2*

• ¹Institute for the Future of Education, Tecnologico de Monterrey, Monterrey, México, Mexico
• ²School of Engineering and Sciences, Tecnologico de Monterrey, Mexico City, Mexico

The labor market is rapidly evolving, leading to a mismatch between existing Knowledge, Skills, and Abilities and future occupational requirements. Reports from organizations like the World Economic Forum and the OECD emphasize the need for dynamic skill identification. This paper introduces a novel system for constructing a dynamic taxonomy using Natural Language Processing techniques, specifically Named Entity Recognition and Relation Extraction, to identify and predict future skills. By leveraging machine learning models, this taxonomy aims to bridge the gap between current skills and future demands, contributing to educational and professional development. To achieve this, an NLP-based architecture was developed using a combination of text preprocessing, NER, and RE models. The NER model identifies and categorizes KSAs and occupations from a corpus of labor market reports, while the RE model establishes the relationships between these entities. A custom pipeline was used for PDF text extraction, tokenization, and lemmatization to standardize the data. The models were trained and evaluated using over 1,700 annotated documents, and the training process was optimized for accuracy in both entity recognition and relationship prediction. 1 Blind review Dynamic taxonomy to identify future skills. The NER and RE models demonstrated promising performance, The NER model achieved a best micro-averaged F1-score of 65.38% in identifying occupations, skills, and knowledge entities. The RE model subsequently reached a best micro-F1 of 82.2% for accurately classifying semantic relationships between these entities at epoch 1009. The taxonomy generated from these models effectively identified emerging skills and occupations, offering insights into future workforce requirements. Visualizations of the taxonomy were created using various graph structures, demonstrating its applicability across multiple sectors. The results indicate that this system can dynamically update and adapt to changes in skill demand over time. The dynamic taxonomy model not only provides real-time updates on current competencies but also predicts emerging skill trends, offering a valuable tool for workforce planning. The high recall rates in NER suggest strong entity recognition capabilities, though precision improvements are needed to reduce false positives. Limitations include the need for a larger corpus and sector-specific models.