K-Dutch: Difference between revisions

From Clarin K-Centre
Jump to navigation Jump to search
 
(135 intermediate revisions by 5 users not shown)
Line 1: Line 1:
<languages/>
<translate>
<span style="color:white">Mediawiki:Mainpage</span><br>
<span style="color:white">Mediawiki:Mainpage</span><br>


Welcome to [[K-DUTCH]], the place for anyone who wants to know anything about the Dutch language: linguistic properties, language advice, available tools and resources, etymology, dialects...  
[[File:K-centre-logo.jpg|frameless|right]]
Welcome to [[K-Dutch]], the place for anyone who wants to know anything about the Dutch language: linguistic properties, language advice, available tools and resources, etymology, dialects...  


K-Dutch is (will be soon) a [https://www.clarin.eu/content/knowledge-centres CLARIN Knowledge Centre]. It is hosted by the [https://www.ivdnt.org Instituut voor de Nederlandse Taal] (Dutch Language Institute) , which is also a [https://www.clarin.eu/content/certified-centres CLARIN-B centre] and host of many resources for Dutch, which are, in general, freely available for research purposes.
K-Dutch is a [https://www.clarin.eu/content/knowledge-centres CLARIN Knowledge Centre]. It is hosted by the [https://www.ivdnt.org Instituut voor de Nederlandse Taal] (Dutch Language Institute) , which is also a [https://www.clarin.eu/content/certified-centres CLARIN-B centre] and host of many resources for Dutch, which are, in general, freely available for research purposes. K-Dutch is an initiative of [https://www.clarin.eu CLARIN-ERIC] and [https://clarin-be.ivdnt.org CLARIN-BE].


The status of Dutch with respect to language technologies is described in


* Short version: [https://link.springer.com/chapter/10.1007/978-3-031-28819-7_12https://link.springer.com/chapter/10.1007/978-3-031-28819-7_12 Steurs, Vandeghinste and Daelemans (2023).] Language Report Dutch. In : Rehm, G., Way, A. (eds) ''European Language Equality''. Cognitive Technologies. Springer, Cham. <nowiki>https://doi.org/10.1007/978-3-031-28819-7_12</nowiki>
* Longer version: [https://european-language-equality.eu/wp-content/uploads/2022/03/ELE___Deliverable_D1_10__Language_Report_Dutch_.pdf Steurs, Vandeghinste and Daelemans (2022). Report on Dutch.] Project deliverable. European Language Equality.
You are most welcome to contribute to these pages, please contact [mailto://servicedesk@ivdnt.org servicedesk@ivdnt.org] with as subject K-Dutch, and we will be in touch.
==Linguisitic topics==
==Linguisitic topics==


===Grammar===
===[[Grammar]]===
====Phonology, Morphology and Syntax: Taalportaal====
Many aspects of Dutch linguistics are described in the [https://www.taalportaal.org/ Taalportaal website]


Taalportaal (or Language Portal) is an interactive knowledge base about Dutch, Frisian and Afrikaans. It provides access to a comprehensive and authoritative scientific grammar for these three languages.
* [[Grammar#Phonology,_Morphology_and_Syntax:_Taalportaal|Phonology, Morphology and Syntax: Taalportaal]]
Up to now there has been no comprehensive scientifically-based description of the grammars of Dutch, Frisian and Afrikaans. This is a serious shortcoming, considering that
* [[Grammar#Morphosyntax|Morphosyntax]]
* language is seen as an important part of cultural identity and cultural heritage
* [[Grammar#Syntactic_Atlas_of_the_Dutch_dialects_(SAND)|Syntactic Atlas of the Dutch dialects (SAND)]]
* a large number of people learn these languages as a second language
* [[Grammar#Dutch_descriptive_grammar:_e-ANS_(in_Dutch)|Dutch descriptive grammar: e-ANS (in Dutch)]]
* educated speakers frequently lack grammatical knowledge of their native language
* [[Grammar#Grambank|Grambank]]
* Dutch and Afrikaans an important object of study in linguistic theory and related fields of research
 
Taalportaal fills this gap by providing a thorough description of the '''phonology, morphology and syntax''' of the three languages.
 
====Morphosyntax====
*[https://dev.clarin.nl/node/1911 MIMORE]: Microcomparative Morphosyntax Research Tool
*[http://hdl.handle.net/11858/00-395C-0000-0000-6F63-1 MAND/FAND/GTRP-database]
 
====Syntactic Atlas of the Dutch dialects (SAND)====
The Dynamic Syntactic Atlas of the Dutch dialects (DynaSAND) is an on-line tool for dialect syntax research. DynaSAND consists of a database, a search engine, a cartographic component and a bibliography.
 
*[http://hdl.handle.net/11858/00-395C-0000-0000-6EB4-4 Online search]
 
====Dutch descriptive grammar: e-ANS (in Dutch)====
 
The General Dutch Grammar, or ANS (Algemene Nederlandse Spraakkunst), is the go-to reference grammar for the Dutch language. It is the most extensive description of the grammatical aspects of contemporary Dutch. Its target users are both native speakers and foreign speakers learning Dutch. The ANS was born out of a Belgian-Dutch cooperation and was first printed in 1984. The second and revised 1997 edition was digitized, resulting in the e-ANS.
 
Lately, the Dutch Language Institute (INT) has been working on a new, user-friendly website for the ANS, while work was started on the revision of its contents by the Leiden University Center for Linguistics (LUCL), Ghent University, KU Leuven and Radboud University Nijmegen.
 
From 2020 onwards, the further revision of the contents will also be coordinated by the INT. The first revised chapters of the General Dutch Grammar will appear online in 2020, describing prepositions, word order and negations, among other subjects.


===[[Lexicography]]===
===[[Lexicography]]===
* Dutch [[dictionaries]]
* the [[Elexis]] project
*[https://ivdnt.org/wp-content/uploads/2021/02/The-Future-of-Academic-Lexicography-A-White-Paper.pdf White paper]: The Future of Academic Lexicography
===Terminology===
The Centre of Expertise for Dutch Terminology (Expertisecentrum Nederlandstalige Terminologie or ENT) supports people and organisations involved with terminology. They can find terminological information and tools here, on the website of the Dutch Language Institute (INT). A newsletter is sent round several times a year, describing developments and events in the field of terminology.
*[https://ivdnt.org/terminologie/expertisecentrum/ Centre of Expertise for Dutch Terminology]
====Higher Education Terminology====
HOTNeV is an acronym for Hoger Onderwijs Terminologie in Nederland en Vlaanderen (Higher Education Terminology in the Netherlands and Flanders). This project was prompted by a sharp increase in educational terms, generated by the EU’s education policy and implemented by the Tuning Project. HOTNeV has a dual purpose. Until now, Dutch equivalents for the English terminology were created mainly ad hoc, but this project focuses on the need to coordinate the provision of terms that have been approved by parties in the Dutch-speaking educational sector. It also wants to show the feasibility of this ambition.
*[https://ivdnt.org/terminologie/onderwijsterminologie-hotnev/ HOTNEV website]
====Medical Terminology====
The Medical Pilot is an experimental database in which a small part of the medical vocabulary is described at various levels, from scientific to accessible to people with low literacy, and in which differences between Flemish and Dutch terms are also shown.
*[http://hdl.handle.net/10032/tm-a2-s7 MedPilot website]
===Spelling===
====Dutch Word List (‘Groene Boekje’)====
The Dutch Language Institute is an authority in the field of spelling. Since 1995, the institute (then: Institute for Dutch Lexicology) has been compiling the ‘Word List of the Dutch Language’ for the Dutch Language Union: an overview of the official spelling of Dutch words. In its printed form, the Word List is better known as het Groene Boekje (‘the green book’). The most recent edition was released in 2005.


====Woordenlijst.org====
* [[Lexicography#Dutch_dictionaries|Dutch dictionaries]]
* [[Lexicography#Elexis|The Elexis Project]]
* [https://ivdnt.org/wp-content/uploads/2021/02/The-Future-of-Academic-Lexicography-A-White-Paper.pdf White paper]: The Future of Academic Lexicography


The Word List of the Dutch Language is online available for free at woordenlijst.org. In 2015, the online version grew from approximately 100,000 entries to roughly 168,000 entries. All words from the previous printed edition have been retained.
===[[Terminology]]===
*[[Terminology#Centre_of_Expertise_for_Dutch_Terminology|The Centre of Expertise for Dutch Terminology]]
*[[Terminology#Academic_Language|Academic Language]]
*[[Terminology#Medical_Terminology|Medical Terminology]]
*[[Terminology#Dutch_as_a_scientific_language|Dutch as a scientific language]]
*[[Terminology#Legal_Terminology|Legal Terminology]]


The newly added words are derived from text files collected at the Dutch Language Institute, containing newspaper texts, literary texts and texts from the internet. In addition, a selection was made from all words that had been looked up in vain in the online Word List.
===[[Spelling]]===
*[[Spelling#Woordenlijst.org_(Official_Dutch_Word_List)|Woordenlijst.org (Official Dutch Word List)]]
*[[Spelling#Spelling_Certification_Mark|Spelling Certification Mark]]


Since 2015, woordenlijst.org has been updated several times a year with hundreds of new words. At the end of 2019 it contained a total of 186,000 words. With all plural forms, diminutive forms, past tenses and past participles, the digital version of the Word List now contains information about approximately 680,000 word forms.
==Linguistic resources: datasets==
 
===[[Corpora]]===
*[https://woordenlijst.org Online version]
* [[Newspaper corpora]]: corpora exclusively consisting of newspaper text
 
====Spelling Certification Mark====
 
The Spelling Certification Mark (Keurmerk Spelling) is a guarantee given by the Union for the Dutch Language (Nederlandse Taalunie) that a reference work can be used to look up the official spelling.
 
For the automatic spell check of word lists (for example provided by dictionary suppliers), the Dutch Language Institute uses the Spelling Certification Mark, also known as the HulK. Our spelling specialists manually correct the words the HulK does not recognize and add these to our own material. From then on the words can be processed automatically.
 
Any word list compiled in accordance with the rules and principles of the official spelling receives the Spelling Certification Mark.
 
====Spelling tools====
 
*[https://dev.clarin.nl/node/1914 TiCCLops]: Text-Induced Corpus Clean-up online processing system
 
==Linguistic resources: corpora and lexica==
===Corpora===
* [[Newspaper corpora]]
* [[Parliamentary corpora]]
* [[Parliamentary corpora]]
* [[Computer-mediated communication corpora]]
* [[Computer-mediated communication corpora]]
Line 94: Line 49:
* [[Historical corpora]]
* [[Historical corpora]]
* [[L2 learner corpora]]
* [[L2 learner corpora]]
* Literary corpora
* [[Manually annotated corpora]]
* [[Manually annotated corpora]]
* [[Multimodal corpora]]
* [[Multimodal corpora]]
* [[Parallel corpora]]
* [[Parallel corpora]]
* [[Reference corpora]]
* [[Reference corpora]]
* [[Social media corpora]]
* [[Spoken corpora]]
* [[Spoken corpora]]
* [[Sign Language corpora]]
* [[Propbanks]]: contains semantic role labels
* [[Treebanks]]
* [[Other corpora]]


===Lexical Resources===
===Lexical Resources===
Line 106: Line 65:
* [[Conceptual Resources]]
* [[Conceptual Resources]]
* [[Wordlists]]
* [[Wordlists]]
* [[Embeddings]]
* [[Lexica of terminology]]
* [[Ontologies]]
===N-grams===
* [[Character N-grams]]


==Tools for Dutch==
==Tools for Dutch==
Line 111: Line 76:
* [[Format conversion]]
* [[Format conversion]]
* [[Spell checking]]
* [[Spell checking]]
*[https://dev.clarin.nl/node/1914 TiCCLops]: Text-Induced Corpus Clean-up online processing system: no longer available
*[https://lt3.ugent.be/normalisation-demo/ Normalisation Demo]


===Language Learning===
===Language Learning===
Line 117: Line 84:
*[https://www.nedbox.be NedBox]: Online exercises to learn Dutch
*[https://www.nedbox.be NedBox]: Online exercises to learn Dutch
*[https://oefenen.nl/programma/soort/taal Oefenen.nl]: Online exercises to learn Dutch
*[https://oefenen.nl/programma/soort/taal Oefenen.nl]: Online exercises to learn Dutch
*[http://woordcombinaties.ivdnt.org/ Woordcombinaties]: Verbs and how their combination patterns
*[http://woordcombinaties.ivdnt.org/ Woordcombinaties]: Verbs and their combination patterns
*[https://orientplus.ucll.be/ Orient+]: A serious game to enhance academic vocabulary
*[https://www.taalwinkel.nl/ Taalwinkel]: Language Advice


===Automatic linguistic annotation===
===Automatic linguistic annotation===
Line 127: Line 96:


===Speech processing===
===Speech processing===
* Speech recognition
* [[Spoken Language Recognition]]
* [[Speech recognition]]
* Speech synthesis
* Speech synthesis


Line 133: Line 103:
* [[Language Modeling]]
* [[Language Modeling]]
* [[Machine translation]]
* [[Machine translation]]
* [[Stylometry]]
* [[Coreference resolution]]
* [[Compound splitting]]
* [[Word Sense Disambiguation]]
* [[Text classification]]
* [[Sentiment analysis]]
* [[Readability]]
* [[Clinical NLP]]


===Resource querying===
===Resource querying===
* [[Corpus querying]]
* [[Corpus querying]]
* [[Treebank querying]]
* [[Treebank querying]]
===Machine translation===
====Translation Engines====
Publicly available machine translation engines from or to Dutch:
*[https://www.deepl.com/translator DeepL]
*[https://translate.google.com/ Google translate]
*[https://www.bing.com/translator Bing Microsoft translator]
*[https://www.reverso.net/ Reverso]
*[https://webgate.ec.europa.eu/etranslation/public/welcome.html eTranslation from the European Union]
*[https://mateo.ivdnt.org/Translate MATEO No Language Left Behind]
====MT Evaluation====
*[https://mateo.ivdnt.org/Evaluate MATEO Machine Translation Evaluation Online]
===Terminology extraction===
* [https://termtreffer.org/ Termtreffer]. Ask for login at [mailto:terminologie@ivdnt.org terminologie@ivdnt.org].
* [https://lt3.ugent.be/dterminer D-Terminer demo]. Terminology extraction for Dutch, English, French and German. (Rigouts Terryn, A. (2021). D-TERMINE: Data-driven Term Extraction Methodologies Investigated [Doctoral thesis]. Ghent University.)
===Terminology management===
* [https://iate.europa.eu/home IATE] (Interactive Terminology for Europe) is the EU's terminology management system. It’s the shared terminology management system of the institutions of the European Union and it contains more than 7 million terms in 26 languages covering more than 100 domains of the EU legislation.


===Other===
===Other===
* Previously unmentioned [[CLARIN projects]] at INT
* Previously unmentioned [[CLARIN projects]] at INT
* [https://webservices.cls.ru.nl/ Language and Speech Tools] at Radboud Nijmegen
* [https://webservices.cls.ru.nl/ Language and Speech Tools] at Radboud Nijmegen. e.g. [https://webservices.cls.ru.nl/tscan T-scan], an analysis tool for dutch texts to assess the complexity of the text.
* [https://www.opener-project.eu/ OpeNER] is a language analysis toolchain helping (academic) researchers and companies make sense out of natural language analysis”. It consist of easy to install, improve and configure components to e.g. detect the language of a text, determine polarisation of texts (sentiment analysis), detect what topics are included in the text,... The supported language set currently consists of: English, Spanish, Italian, German and Dutch.
* [https://gate.ac.uk/ GATE] (General Architecture for Text Engineering) is a Java suite of tools originally developed at the University of Sheffield and it is used for many natural language processing tasks, including information extraction. ([https://cloud.gate.ac.uk/shopfront#tagged=Dutch Dutch services in GATE Cloud]).
* [https://speech-repository.webcloud.ec.europa.eu/ Speech Repository] is an online e-learning tool. It contains video recordings of real-life speeches and tailor-made pedagogical material speeches which give the interpreter and interpreting students an opportunity to practise and improve their interpretation skills.
* [https://subworkshop.sourceforge.net/ Subtitle Workshop] is a free application for creating, editing, and converting text-based subtitle files.
* [https://youdescribe.org/ YouDescribe] is a free, web-based platform for adding audio description to YouTube content.
* [https://www.audacityteam.org/ Audacity] is an audio recording and editing software application that is open source.
 
==Helpdesk==
For information about Dutch: If you cannot find the answers to your questions on this wiki, you can send your question to [mailto://servicedesk@ivdnt.org servicedesk@ivdnt.org ]. Your questions will be forwarded as soon as possible to the appropriate experts and you should receive an answer within two working days.


==[[Types of services offered]]==
You can also ask us for information and assistance with the use of data and tools.


* Helpdesk for information about Dutch: If you cannot find the answers to your questions on this wiki, you can send your question to [mailto://servicedesk@ivdnt.org servicedesk@ivdnt.org ]. Your questions will be forwarded as soon as possible to the appropriate experts and you should receive an answer within two working days.
==Other Services==
* Helpdesk for information and assistance with the use of data and tools
* [[Best practice documents and guidelines]]
* [[Best practice documents and guidelines]]
* [[Internships]]
* [[Internships]]
Line 152: Line 156:
* [[CLARIN]] for Dutch
* [[CLARIN]] for Dutch


We will store answers to questions we receive in this wiki, which will grow into a repository of K-Dutch answers to your questions.
==Questions and Answers==
On the [[Q&A|Questions and Answers page]] we keep track of all questions we receive concerning Dutch. This will grow into a repository of K-Dutch answers to your questions.
 
Note that there is also a very active Discord server concerning Dutch NLP: https://discord.gg/jn94Ux5j
 
</translate>

Latest revision as of 12:52, 13 March 2024

Other languages:

Mediawiki:Mainpage

Welcome to K-Dutch, the place for anyone who wants to know anything about the Dutch language: linguistic properties, language advice, available tools and resources, etymology, dialects...

K-Dutch is a CLARIN Knowledge Centre. It is hosted by the Instituut voor de Nederlandse Taal (Dutch Language Institute) , which is also a CLARIN-B centre and host of many resources for Dutch, which are, in general, freely available for research purposes. K-Dutch is an initiative of CLARIN-ERIC and CLARIN-BE.

The status of Dutch with respect to language technologies is described in

You are most welcome to contribute to these pages, please contact servicedesk@ivdnt.org with as subject K-Dutch, and we will be in touch.

Linguisitic topics

Grammar

Lexicography

Terminology

Spelling

Linguistic resources: datasets

Corpora

Lexical Resources

N-grams

Tools for Dutch

Normalisation

Language Learning

Automatic linguistic annotation

Speech processing

Natural Language Processing

Resource querying

Machine translation

Translation Engines

Publicly available machine translation engines from or to Dutch:

MT Evaluation

Terminology extraction

  • Termtreffer. Ask for login at terminologie@ivdnt.org.
  • D-Terminer demo. Terminology extraction for Dutch, English, French and German. (Rigouts Terryn, A. (2021). D-TERMINE: Data-driven Term Extraction Methodologies Investigated [Doctoral thesis]. Ghent University.)

Terminology management

  • IATE (Interactive Terminology for Europe) is the EU's terminology management system. It’s the shared terminology management system of the institutions of the European Union and it contains more than 7 million terms in 26 languages covering more than 100 domains of the EU legislation.

Other

  • Previously unmentioned CLARIN projects at INT
  • Language and Speech Tools at Radboud Nijmegen. e.g. T-scan, an analysis tool for dutch texts to assess the complexity of the text.
  • OpeNER is a language analysis toolchain helping (academic) researchers and companies make sense out of natural language analysis”. It consist of easy to install, improve and configure components to e.g. detect the language of a text, determine polarisation of texts (sentiment analysis), detect what topics are included in the text,... The supported language set currently consists of: English, Spanish, Italian, German and Dutch.
  • GATE (General Architecture for Text Engineering) is a Java suite of tools originally developed at the University of Sheffield and it is used for many natural language processing tasks, including information extraction. (Dutch services in GATE Cloud).
  • Speech Repository is an online e-learning tool. It contains video recordings of real-life speeches and tailor-made pedagogical material speeches which give the interpreter and interpreting students an opportunity to practise and improve their interpretation skills.
  • Subtitle Workshop is a free application for creating, editing, and converting text-based subtitle files.
  • YouDescribe is a free, web-based platform for adding audio description to YouTube content.
  • Audacity is an audio recording and editing software application that is open source.

Helpdesk

For information about Dutch: If you cannot find the answers to your questions on this wiki, you can send your question to servicedesk@ivdnt.org . Your questions will be forwarded as soon as possible to the appropriate experts and you should receive an answer within two working days.

You can also ask us for information and assistance with the use of data and tools.

Other Services

Questions and Answers

On the Questions and Answers page we keep track of all questions we receive concerning Dutch. This will grow into a repository of K-Dutch answers to your questions.

Note that there is also a very active Discord server concerning Dutch NLP: https://discord.gg/jn94Ux5j