AUTHOR=Blinova Olga , Tarasov Nikita 

TITLE=A hybrid model of complexity estimation: Evidence from Russian legal texts

JOURNAL=Frontiers in Artificial Intelligence

VOLUME=Volume 5 - 2022

YEAR=2022

URL=https://www.frontiersin.org/journals/artificial-intelligence/articles/10.3389/frai.2022.1008530

DOI=10.3389/frai.2022.1008530

ISSN=2624-8212

ABSTRACT=This paper proposes a hybrid model for the estimation of the complexity of legal documents in Russian. The model consists of two main modules: linguistic feature extractor and a transformer-based neural encoder. The set of linguistic metrics includes both non-specific metrics traditionally used to predict complexity, as well as style-specific metrics developed in order to deal with the peculiarities of official texts. The model was trained on a dataset constructed from text sequences from Russian textbooks. Training data was collected on either subjects related to the topic of of legal documents such as Jurisprudence, Economics, Social Sciences, or subjects characterized by the use of general language such as Literature, History and Culturology. The final set of materials used contain 48 thousand selected text blocks having various subject and level-of-complexity identifiers. We have tested the baseline fine-tuned BERT model, models trained on linguistic features, and models trained on features in combination with BERT predictions. The scores show that a hybrid approach to complexity estimation can provide high-quality results in terms of different metrics. The model has tested on three sets of legal documents.