Basic language processing/nl: Difference between revisions

From Clarin K-Centre
Jump to navigation Jump to search
(Created page with "Basic language processing")
 
(Created page with "Onder eenvoudige taalverwerking verstaan we gedeelte-van-spraak tagging, lemmatisering, named entity recognition, chunking en gelijksoortige taken die individuele woorden labelen.")
Line 1: Line 1:
<div lang="en" dir="ltr" class="mw-content-ltr">
Onder eenvoudige taalverwerking verstaan we gedeelte-van-spraak tagging, lemmatisering, named entity recognition, chunking en gelijksoortige taken die individuele woorden labelen.
Under basis language processing, we understand part-of-speech tagging, lemmatization, named entity recognition, chunking and similar tasks which label individual words.
</div>


<div lang="en" dir="ltr" class="mw-content-ltr">
<div lang="en" dir="ltr" class="mw-content-ltr">

Revision as of 08:43, 3 April 2024

Onder eenvoudige taalverwerking verstaan we gedeelte-van-spraak tagging, lemmatisering, named entity recognition, chunking en gelijksoortige taken die individuele woorden labelen.

Frog

Frog is an integration of memory-based natural language processing (NLP) modules developed for Dutch. Frog's current version will tokenize, tag, lemmatize, and morphologically segment word tokens in Dutch text files, will assign a dependency graph to each sentence, will identify the base phrase chunks in the sentence, and will attempt to find and label all named entities.

DeepFrog

DeepFrog aims to be a (partial) successor of the Dutch-NLP suite Frog. Whereas the various NLP modules in Frog were built on k-NN classifiers, DeepFrog builds on deep learning techniques and can use a variety of neural transformers.

The system is not yet officially released.

LeTs

LeTs is preprocessor that can be used for Dutch, German, English and French.

Spacy

Stanza

A Python NLP Package for Many Human Languages

Adelheid Tagger-Lemmatizer: A Distributed Lemmatizer for Historical Dutch

With this web-application an end user can have historical Dutch texts tokenized, lemmatized and part-of-speech tagged, using the most appropriate resources (such as lexica) for the text in question. For each specific text, the user can select the best resources from those available in CLARIN, wherever they might reside, and where necessary supplemented by own lexica.