Yarowsky Algorithm

Herausgegeben:Surhone, Lambert M.; Tennoe, Mariam T.; Henssonow, Susan F.

• Broschiertes Buch

Produktbeschreibung

Please note that the content of this book primarily consists of articles available from Wikipedia or other free sources online. In computational linguistics the Yarowsky algorithm is an unsupervised learning algorithm for word sense disambiguation that uses the "one sense per collocation" and the "one sense per discourse" properties of human languages for word sense disambiguation. From observation, words tend to exhibit only one sense in most given discourse and in a given collocation. The algorithm starts with a large, untagged corpus, in which it identifies examples of the given polysemous word, and stores all the relevant sentences as lines. For instance, Yarowsky uses the word "plant" in his 1995 paper to demonstrate the algorithm. If it is assumed that there are two possible senses of the word, the next step is to identify a small number of seed collocations representative of each sense, give each sense a label (i.e. sense A and B), then assign the appropriate label to all training examples containing the seed collocations. In this case, the words "life" and "manufacturing" are chosen as initial seed collocations for senses A and B respectively. The residual examples (85% 98% according to Yarowsky) remain untagged.

Produktdetails

• Verlag: Betascript Publishing
• Seitenzahl: 68
• Englisch
• Abmessung: 220mm
• ISBN-13: 9786131325564
• ISBN-10: 6131325561
• Artikelnr.: 30033875