A Finite-State Based Morphological Analyzer for Hebrew

Shlomo Yona (Knowledge Center for Processing Hebrew)

Abstract:

Morphological analysis is an important component in many natural language processing tasks. Existing morphological analyzers for Hebrew are either limited or proprietary. We developed a morphological analyzer for undotted Hebrew words that is based on finite-state linguistically motivated rules and a broad coverage lexicon. The lexicon contains base forms of words and linguistic attributes that are used by the rules to allow analysis and generation of Hebrew words.

The current set of rules comprehensively covers the morphological phenomena that are observable in contemporary Hebrew texts. Our analyzer produces output for over 90% of the tokens observed in daily newspapers.




Back to ISCOL'05 homepage