Lemmatization

Lemmatization is the process of determining the base or dictionary form (lemma) of a given word form. For morphologically rich languages, normalizing word forms to their base form can better support search engines and linguistic research. The main challenges of lemmatization lie in handling unseen word forms during inference and disambiguating polysemous word forms in different contexts.