Parallel Multilingual Corpora: Difference between revisions

From Clarin K-Centre
Jump to navigation Jump to search
(Created page with "==Bible Corpus== A diachronically and synchronically parallel corpus of Bible translations in Dutch, English, German and Swedish, with texts from the 14th century until today. *[https://spraakbanken.gu.se/en/resources/openedges OpenEdges Download] ==PacoMT Parallel Corpora== During the STEVIN project PaCo-MT (Parse and Corpus-based Machine Translation), two existing parallel corpora were enriched with syntactic annotations and node alignments. The annotations were gen...")
 
No edit summary
Line 27: Line 27:
The [https://opus.nlpl.eu/ OPUS corpus] contains a very large collection of parallel corpora, amongst which many contain Dutch.
The [https://opus.nlpl.eu/ OPUS corpus] contains a very large collection of parallel corpora, amongst which many contain Dutch.


==COVID-19 - HEALTH Wikipedia dataset. Bilingual (EN-NL)==
==COVID-19 Corpora==
===COVID-19 - HEALTH Wikipedia dataset. Bilingual (EN-NL)===
Bilingual (EN-NL) corpus acquired from Wikipedia on health and COVID-19 domain (2nd May 2020). The corpus contains 931 translation units.
Bilingual (EN-NL) corpus acquired from Wikipedia on health and COVID-19 domain (2nd May 2020). The corpus contains 931 translation units.


Line 33: Line 34:
* [https://elrc-share.eu/repository/browse/covid-19-health-wikipedia-dataset-bilingual-en-nl/b36eccb88de811ea913100155d0267065632b235f586445aa0c67da0afcdfc0e/ Download page]
* [https://elrc-share.eu/repository/browse/covid-19-health-wikipedia-dataset-bilingual-en-nl/b36eccb88de811ea913100155d0267065632b235f586445aa0c67da0afcdfc0e/ Download page]


==COVID-19 ANTIBIOTIC dataset. Bilingual (EN-NL)==
===COVID-19 ANTIBIOTIC dataset. Bilingual (EN-NL)===
Bilingual (EN-NL) corpus acquired from the website https://antibiotic.ecdc.europa.eu/. The corpus contains 805 translation units.
Bilingual (EN-NL) corpus acquired from the website https://antibiotic.ecdc.europa.eu/. The corpus contains 805 translation units.


Line 39: Line 40:
* [https://elrc-share.eu/repository/browse/covid-19-antibiotic-dataset-bilingual-en-nl/9c5009c0904511ea913100155d026706169da04f5eb448178c8954eb8f874db1/ Download page]
* [https://elrc-share.eu/repository/browse/covid-19-antibiotic-dataset-bilingual-en-nl/9c5009c0904511ea913100155d026706169da04f5eb448178c8954eb8f874db1/ Download page]


== COVID-19 EC-EUROPA v1 dataset. Bilingual (EN-NL)==
=== COVID-19 EC-EUROPA v1 dataset. Bilingual (EN-NL)===
Bilingual (EN-NL) corpus acquired from website (https://ec.europa.eu/*coronavirus-response) of the EU portal (20th May 2020). This corpus contains 2.391 translation units.
Bilingual (EN-NL) corpus acquired from website (https://ec.europa.eu/*coronavirus-response) of the EU portal (20th May 2020). This corpus contains 2.391 translation units.


Line 45: Line 46:
*[https://elrc-share.eu/repository/browse/covid-19-ec-europa-v1-dataset-bilingual-en-nl/c839dc1aa17911ea913100155d0267065bd070800d534300b9a82cbc55176caa/ Download page]
*[https://elrc-share.eu/repository/browse/covid-19-ec-europa-v1-dataset-bilingual-en-nl/c839dc1aa17911ea913100155d0267065bd070800d534300b9a82cbc55176caa/ Download page]


==COVID-19 EU presscorner v2 dataset. Bilingual (EN-NL)==
===COVID-19 EU presscorner v2 dataset. Bilingual (EN-NL)===
Bilingual (EN-NL) corpus acquired from website (https://ec.europa.eu/commission/presscorner/) of the EU portal (8th July 2020). This corpus contains 6.810 translation units.
Bilingual (EN-NL) corpus acquired from website (https://ec.europa.eu/commission/presscorner/) of the EU portal (8th July 2020). This corpus contains 6.810 translation units.


Line 51: Line 52:
* [https://elrc-share.eu/repository/browse/covid-19-eu-presscorner-v2-dataset-bilingual-en-nl/c924966ac5c811ea913100155d0267060010380f855d42b188d6225ace812c61/ Download page]
* [https://elrc-share.eu/repository/browse/covid-19-eu-presscorner-v2-dataset-bilingual-en-nl/c924966ac5c811ea913100155d0267060010380f855d42b188d6225ace812c61/ Download page]


==COVID-19 EUR-LEX dataset. Βilingual (EN-NL)==
===COVID-19 EUR-LEX dataset. Βilingual (EN-NL)===
Bilingual (EN-NL) corpus acquired from website (https://eur-lex.europa.eu/legal-content) of the EU portal (9th July 2020). This corpus contains 22.470 translation units.
Bilingual (EN-NL) corpus acquired from website (https://eur-lex.europa.eu/legal-content) of the EU portal (9th July 2020). This corpus contains 22.470 translation units.


Line 57: Line 58:
* [https://elrc-share.eu/repository/browse/covid-19-eur-lex-dataset-ilingual-en-nl/af906a80c5af11ea913100155d026706dc95cf79c8104ea2b5c9e7143216e8b6/ Download page]
* [https://elrc-share.eu/repository/browse/covid-19-eur-lex-dataset-ilingual-en-nl/af906a80c5af11ea913100155d026706dc95cf79c8104ea2b5c9e7143216e8b6/ Download page]


==COVID-19 EUROPARL v2 dataset. Bilingual (EN-NL) ==
===COVID-19 EUROPARL v2 dataset. Bilingual (EN-NL) ===
Bilingual (EN-NL) corpus acquired from the website (https://www.europarl.europa.eu/) of the European Parliament (9th May 2020). This corpus contains 887 translation units.
Bilingual (EN-NL) corpus acquired from the website (https://www.europarl.europa.eu/) of the European Parliament (9th May 2020). This corpus contains 887 translation units.


Line 63: Line 64:
* [https://elrc-share.eu/repository/browse/covid-19-europarl-v2-dataset-bilingual-en-nl/aca366f4941f11ea913100155d0267066f2c95e65e20479ba769a4ec18bb3373/ Download page]
* [https://elrc-share.eu/repository/browse/covid-19-europarl-v2-dataset-bilingual-en-nl/aca366f4941f11ea913100155d0267066f2c95e65e20479ba769a4ec18bb3373/ Download page]


==COVID-19 Parallel Global Voices dataset. Bilingual (EN-NL)==
===COVID-19 Parallel Global Voices dataset. Bilingual (EN-NL)===
EN-NL Bilingual COVID-19-related corpus acquired from the website (https://globalvoices.org/) of GlobalVoices (28th April 2020). This corpus contains 675 translation units.
EN-NL Bilingual COVID-19-related corpus acquired from the website (https://globalvoices.org/) of GlobalVoices (28th April 2020). This corpus contains 675 translation units.



Revision as of 13:15, 6 December 2023

Bible Corpus

A diachronically and synchronically parallel corpus of Bible translations in Dutch, English, German and Swedish, with texts from the 14th century until today.

PacoMT Parallel Corpora

During the STEVIN project PaCo-MT (Parse and Corpus-based Machine Translation), two existing parallel corpora were enriched with syntactic annotations and node alignments. The annotations were generated automatically.

Language Pairs: English to Dutch, Dutch to English, French to Dutch, Dutch to French.

The Dutch Parallel Corpus

The Dutch Parallel Corpus (DPC) is a 10-million-word, sentence-aligned parallel corpus for the language pairs Dutch-English and Dutch-French, with Dutch as the central language.

The corpus contains five different text types and is balanced with respect to text type and translation direction. The entire corpus has been aligned at sentence level and further enriched with linguistic information (lemmas and PoS-tags). A small subset of the Dutch-English part has also been manually aligned at the sub-sentential level.

The Open Parallel Corpus (OPUS)

The OPUS corpus contains a very large collection of parallel corpora, amongst which many contain Dutch.

COVID-19 Corpora

COVID-19 - HEALTH Wikipedia dataset. Bilingual (EN-NL)

Bilingual (EN-NL) corpus acquired from Wikipedia on health and COVID-19 domain (2nd May 2020). The corpus contains 931 translation units.

COVID-19 ANTIBIOTIC dataset. Bilingual (EN-NL)

Bilingual (EN-NL) corpus acquired from the website https://antibiotic.ecdc.europa.eu/. The corpus contains 805 translation units.

COVID-19 EC-EUROPA v1 dataset. Bilingual (EN-NL)

Bilingual (EN-NL) corpus acquired from website (https://ec.europa.eu/*coronavirus-response) of the EU portal (20th May 2020). This corpus contains 2.391 translation units.

COVID-19 EU presscorner v2 dataset. Bilingual (EN-NL)

Bilingual (EN-NL) corpus acquired from website (https://ec.europa.eu/commission/presscorner/) of the EU portal (8th July 2020). This corpus contains 6.810 translation units.

COVID-19 EUR-LEX dataset. Βilingual (EN-NL)

Bilingual (EN-NL) corpus acquired from website (https://eur-lex.europa.eu/legal-content) of the EU portal (9th July 2020). This corpus contains 22.470 translation units.

COVID-19 EUROPARL v2 dataset. Bilingual (EN-NL)

Bilingual (EN-NL) corpus acquired from the website (https://www.europarl.europa.eu/) of the European Parliament (9th May 2020). This corpus contains 887 translation units.

COVID-19 Parallel Global Voices dataset. Bilingual (EN-NL)

EN-NL Bilingual COVID-19-related corpus acquired from the website (https://globalvoices.org/) of GlobalVoices (28th April 2020). This corpus contains 675 translation units.

Bilingual corpus from the European Vaccination Portal (NL-EN)

NL-EN Bilingual corpus acquired from https://vaccination-info.eu. This corpus contains 494 translation units.

Bilingual corpus from the Publications Office of the EU on the medical domain v.2 (EN-NL)

EEN-NL Bilingual corpus extracted from the Publications Office of the EU on the medical domain. These are sourced from laws, studies, EC announcements, etc. labelled with concepts like epidemiology, epidemic, disease surveillance, health control, public hygiene, freedom of movement, distance learning, etc. This corpus contains 13.191 translation units.

Bilingual corpus made out of PDF documents from the European Medicines Agency, (EMEA) (EN-NL).

EN-NL Bilingual corpus made out of PDF documents from the European Medicines Agency, (EMEA), https://www.ema.europa.eu, (February 2020). This corpus contains 762.433 translation units.

MultiLing EN-NL

The multiLing data set is based on six English source texts which are translated into various languages. Four of them (Texts 1-4) are news articles and the other two are (Texts 5-6) sociological texts from an encyclopedia. The Dutch data consists of two parts. ENDU20: Ten Dutch translations of the multiLing set by ten native Dutch recent master's degree translators and ENDU20-MT: Two Dutch machine translations of the multiLing set by DeepL (P20) and Google Translate (P21).

Dutch Government Website Corpus

Parallel (en-nl) corpus of 6532 translation units.