This paper presents a new approach for the evaluation of the detection of synonymy relations between terms. Our goal is to help the terminology structuring. This approach exploits the synonymy relationships which have been extracted from lexical resources to infer synonymy links between complex terms. The inferred links are then validated by an human expert in the context of a terminological application. In a previous evaluation on documents dealing with electric power plant, the expert has underlined that the most important point is to increase the recall even if the precision is low and if some links are mistyped. This paper reports new experiments which help to understand how this synonymy detection approach is to be used. Various lexical resources — from general language dictionary to very specialized semantic information — are exploited and compared as bootstrapping knowledge. Results show the complementary of the different sources.
The first evaluation relied on traditional recall and precision measures. However, those scores do not reflect the usefulness of the inferred links for the terminology structuring. From the terminologist’s point of view, erroneous links are quick to eliminated. They may even suggest good ones. Above all, the system points out relations between terms which are generally not found manually. We thus aim at proposing a new evaluation criteria which better reflects the expert’s and terminologist’s point of view in the application context. This score points out the quality of the results and the validation cost rather than the proportion of validated links. We have designed an evaluation score which takes into account the productivity of the dictionary links. It can be viewed as a normalization of the precision.
2019. 2019 International Symposium on Systems Engineering (ISSE), ► pp. 1 ff.
Heng, Fatin Nabila Rafei, Mustafa Mat Deris & Nurlida Basir
2018. A Similarity Precision for Selecting Ontology Component in an Incomplete Sentence. In Recent Advances on Soft Computing and Data Mining [Advances in Intelligent Systems and Computing, 700], ► pp. 95 ff.
2019. The Cognitive and Communicative Functions of Term Variation in Research Articles: A Comparative Study in Psychology and Geology. Applied Linguistics 40:4 ► pp. 624 ff.
Koza, Walter, Maria Jose Ojeda, Mirian Munoz, Sofia Koza & Eduin Yepes
2013. 2013 Second International Conference on Informatics & Applications (ICIA), ► pp. 53 ff.
Ratkovic, Zorana, Wiktoria Golik & Pierre Warnier
2012. Event extraction of bacteria biotopes: a knowledge-intensive NLP-based approach. BMC Bioinformatics 13:S11
Hamon, Thierry & Natalia Grabar
2008. Acquisition of Elementary Synonym Relations from Biological Structured Terminology. In Computational Linguistics and Intelligent Text Processing [Lecture Notes in Computer Science, 4919], ► pp. 40 ff.
Daille, Béatrice
2003. Terminology Mining. In Information Extraction in the Web Era [Lecture Notes in Computer Science, 2700], ► pp. 29 ff.
Rinaldi, Fabio, James Dowdall, Michael Hess, Diego Mollá, Rolf Schwitter & Kaarel Kaljurand
2003. Knowledge-Based Question Answering. In Knowledge-Based Intelligent Information and Engineering Systems [Lecture Notes in Computer Science, 2773], ► pp. 785 ff.
This list is based on CrossRef data as of 20 september 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers.
Any errors therein should be reported to them.