Parallel corpora: Difference between revisions

From Clarin K-Centre
Jump to navigation Jump to search
No edit summary
No edit summary
 
(9 intermediate revisions by 3 users not shown)
Line 1: Line 1:
Parallel corpora are central to translation studies and contrastive linguistics. Many of the parallel corpora are accessible through easy-to-use concordancers which considerably facilitates the study of interlinguistic phenomena. Such corpora are also a rich source of materials for language teaching. Furthermore, parallel corpora serve as training data for statistical machine translation systems.  
<languages/>
<translate>
<!--T:1-->
Parallel corpora are central to translation studies and contrastive linguistics. Many of the parallel corpora are accessible through easy-to-use concordancers which considerably facilitates the study of interlinguistic phenomena. Such corpora are also a rich source of materials for language teaching. Furthermore, parallel corpora serve as training data for machine translation systems.  


==DAESO Corpus==
<!--T:2-->
The DAESO Corpus is a parallel monolingual treebank of Dutch texts and the corpus contains more than 2.1 million words of parallel and comparable text. About 678,000 words were lined up manually and about 1.5 million words were automatically aligned. A semantic relation was added to the aligned words / phrases.
Monolingual parallel corpora also exist, containing e.g. sentences and their paraphrases, or sentences and their simplified form.


*92.5 MB
<!--T:3-->
*version 1.0 (2010)
*[[Parallel Multilingual Corpora]]
*[http://hdl.handle.net/10032/tm-a2-h9 Download page]


==Bible Corpus==
<!--T:4-->
A diachronically and synchronically parallel corpus of Bible translations in Dutch,English, German and Swedish, with texts from the 14th century until today.
*[[Parallel Monolingual Corpora]]
 
</translate>
*[https://spraakbanken.gu.se/en/resources/openedges OpenEdges Download]
 
==PacoMT Parallel Corpora==
During the STEVIN project PaCo-MT (Parse and Corpus-based Machine Translation), two existing parallel corpora were enriched with syntactic annotations and node alignments. The annotations were generated automatically.
 
Language Pairs: English to Dutch, Dutch to English, French to Dutch, Dutch to French.
 
*version 1.0
*data set from 2014
*38.8 MB
*[http://hdl.handle.net/10032/tm-a2-f7 Download page]
*[http://www.ccl.kuleuven.be/Projects/PACO/paco.php Project website]
 
==The Dutch Parallel Corpus==
 
The Dutch Parallel Corpus (DPC) is a 10-million-word, sentence-aligned parallel corpus for the language pairs Dutch-English and Dutch-French, with Dutch as the central language.
 
The corpus contains five different text types and is balanced with respect to text type and translation direction. The entire corpus has been aligned at sentence level and further enriched with linguistic information (lemmas and PoS-tags). A small subset of the Dutch-English part has also been manually aligned at the sub-sentential level.
 
*[http://hdl.handle.net/10032/tm-a2-h3 Download page]
*[https://www.kuleuven-kulak.be/dpc/en/ Project website]
 
==The Open Parallel Corpus (OPUS)==
The [https://opus.nlpl.eu/ OPUS corpus] contains a very large collection of parallel corpora, amongst which many contain Dutch.
 
==COVID-19 - HEALTH Wikipedia dataset. Bilingual (EN-NL)==
Bilingual (EN-NL) corpus acquired from Wikipedia on health and COVID-19 domain (2nd May 2020). The corpus contains 931 translation units.
 
* Version 1.0 (2020)
* [https://elrc-share.eu/repository/browse/covid-19-health-wikipedia-dataset-bilingual-en-nl/b36eccb88de811ea913100155d0267065632b235f586445aa0c67da0afcdfc0e/ Download page]
 
==COVID-19 ANTIBIOTIC dataset. Bilingual (EN-NL)==
Bilingual (EN-NL) corpus acquired from the website https://antibiotic.ecdc.europa.eu/. The corpus contains 805 translation units.
 
* Version 1.0 (2020)
* [https://elrc-share.eu/repository/browse/covid-19-antibiotic-dataset-bilingual-en-nl/9c5009c0904511ea913100155d026706169da04f5eb448178c8954eb8f874db1/ Download page]
 
== COVID-19 EC-EUROPA v1 dataset. Bilingual (EN-NL)==
Bilingual (EN-NL) corpus acquired from website (https://ec.europa.eu/*coronavirus-response) of the EU portal (20th May 2020). This corpus contains 2.391 translation units.
 
* Version 1.0 (2020)
*[https://elrc-share.eu/repository/browse/covid-19-ec-europa-v1-dataset-bilingual-en-nl/c839dc1aa17911ea913100155d0267065bd070800d534300b9a82cbc55176caa/ Download page]
 
==COVID-19 EU presscorner v2 dataset. Bilingual (EN-NL)==
Bilingual (EN-NL) corpus acquired from website (https://ec.europa.eu/commission/presscorner/) of the EU portal (8th July 2020). This corpus contains 6.810 translation units.
 
* Version 2.0 (2020)
* [https://elrc-share.eu/repository/browse/covid-19-eu-presscorner-v2-dataset-bilingual-en-nl/c924966ac5c811ea913100155d0267060010380f855d42b188d6225ace812c61/ Download page]
 
==COVID-19 EUR-LEX dataset. Βilingual (EN-NL)==
Bilingual (EN-NL) corpus acquired from website (https://eur-lex.europa.eu/legal-content) of the EU portal (9th July 2020). This corpus contains 22.470 translation units.
 
* Version 1.0 (2020)
* [https://elrc-share.eu/repository/browse/covid-19-eur-lex-dataset-ilingual-en-nl/af906a80c5af11ea913100155d026706dc95cf79c8104ea2b5c9e7143216e8b6/ Download page]
 
==COVID-19 EUROPARL v2 dataset. Bilingual (EN-NL) ==
Bilingual (EN-NL) corpus acquired from the website (https://www.europarl.europa.eu/) of the European Parliament (9th May 2020). This corpus contains 887 translation units.
 
* Version 2.0 (2020)
* [https://elrc-share.eu/repository/browse/covid-19-europarl-v2-dataset-bilingual-en-nl/aca366f4941f11ea913100155d0267066f2c95e65e20479ba769a4ec18bb3373/ Download page]
 
==COVID-19 Parallel Global Voices dataset. Bilingual (EN-NL)==
EN-NL Bilingual COVID-19-related corpus acquired from the website (https://globalvoices.org/) of GlobalVoices (28th April 2020). This corpus contains 675 translation units.
 
* Version 1.0 (2020)
* [https://elrc-share.eu/repository/browse/covid-19-parallel-global-voices-dataset-bilingual-en-nl/df312cf0895211ea913100155d02670693358ccdbdf24ae79e142e3999159478/ Download page]
 
 
==Bilingual corpus from the European Vaccination Portal (NL-EN)==
NL-EN Bilingual corpus acquired from https://vaccination-info.eu. This corpus contains 494 translation units.
 
* Version 1.0 (2020)
* [https://elrc-share.eu/repository/browse/bilingual-corpus-from-the-european-vaccination-portal-nl-en/416f3388864e11ea913100155d026706f6cf8712d2304ecfa917aac7e5eb6731/ Download page]
 
==Bilingual corpus from the Publications Office of the EU on the medical domain v.2 (EN-NL) ==
EEN-NL Bilingual corpus extracted from the Publications Office of the EU on the medical domain. These are sourced from laws, studies, EC announcements, etc. labelled with concepts like epidemiology, epidemic, disease surveillance, health control, public hygiene, freedom of movement, distance learning, etc. This corpus contains 13.191 translation units.
 
* Version 2.0 (2020)
* [https://elrc-share.eu/repository/browse/bilingual-corpus-from-the-publications-office-of-the-eu-on-the-medical-domain-v2-en-nl/0795a5328ac411ea913100155d02670661b540c3ab9b437baf5a6c579c7edb3b/ Download page]
 
==Bilingual corpus made out of PDF documents from the European Medicines Agency, (EMEA) (EN-NL).==
EN-NL Bilingual corpus made out of PDF documents from the European Medicines Agency, (EMEA), https://www.ema.europa.eu, (February 2020). This corpus contains 762.433 translation units.
 
* Version 1.0 (2020)
* [https://elrc-share.eu/repository/browse/bilingual-corpus-made-out-of-pdf-documents-from-the-european-medicines-agency-emea-httpswwwemaeuropaeu-february-2020-en-nl/93284c8e862411ea913100155d026706d3313f47bec143cd98cc4ba1aa62b4b5/ Download page]
 
==MultiLing EN-NL==
The multiLing data set is based on six English source texts which are translated into various languages. Four of them (Texts 1-4) are news articles and the other two are (Texts 5-6) sociological texts from an encyclopedia. The Dutch data consists of two parts. ENDU20: Ten Dutch translations of the multiLing set by ten native Dutch recent master's degree translators and ENDU20-MT: Two Dutch machine translations of the multiLing set by DeepL (P20) and Google Translate (P21).
 
* [https://lt3.ugent.be/resources/multiling-en-nl/ Project information and download instructions]
* [https://sites.google.com/site/centretranslationinnovation/tpr-db/public-studies#h.p_iVVuCQOHJx2O MultiLing information]

Latest revision as of 15:50, 19 March 2024

Other languages:

Parallel corpora are central to translation studies and contrastive linguistics. Many of the parallel corpora are accessible through easy-to-use concordancers which considerably facilitates the study of interlinguistic phenomena. Such corpora are also a rich source of materials for language teaching. Furthermore, parallel corpora serve as training data for machine translation systems.

Monolingual parallel corpora also exist, containing e.g. sentences and their paraphrases, or sentences and their simplified form.