The Open Information Systems Journal

2013, 6 : 1-12
Published online 2013 December 13. DOI: 10.2174/1874133920131121001
Publisher ID: TOISJ-6-1

A Study of the Morpho-Semantic Relationship in Medline

W. John Wilbur and Larry Smith
National Library of Medicine, Bldg. 38A, Rm. 6S606, 8600 Rockville Pike, Bethesda, MD 20894, U.S.A.

ABSTRACT

Morphological analysis as applied to English has generally involved the study of rules for inflections and derivations. Recent work has attempted to derive such rules from automatic analysis of corpora. Here we study similar issues, but in the context of the biological literature. We introduce a new approach which allows us to assign probabilities of the semantic relatedness of pairs of tokens that occur in text in consequence of their relatedness as character strings. Our analysis is based on over 84 million sentences from the MEDLINE database, over 2.3 million token types that occur in MEDLINE, and enables us to identify over 36 million token type pairs which have assigned probabilities of semantic relatedness of at least 0.7 based on their similarity as strings. The quality of these predictions is tested by two different manual evaluations and found to be good.

Keywords:

Morphology, lexical similarity, weight, potential, cost function, mutual information.