Handmatig geannoteerde corpora

From Clarin K-Centre
Revision as of 15:09, 14 March 2024 by Floyd (talk | contribs) (Created page with "* [https://taalmaterialen.ivdnt.org/wp-content/uploads/documentatie/sonar_verschillendecorpora.txt Verscheidene versies van het SoNaR Corpus] * [http://hdl.handle.net/10032/tm-a2-m9 Download pagina]")
Jump to navigation Jump to search

Handmatige corpora zijn verzamelingen van teksten die manueel geverifieerde of manueel aangebrachte taalkundige informatie bevatten, zoals morfosyntactische tags, lemma's, syntactische parseringen, named entities etc. Deze corpora kunnen worden gebruikt bij het trainen van nieuwe taalannotatiehulpmiddelen, als ook bij het testen van de nauwkeurigheid van bestaande annotatiehulpmiddelen.

Corpus Gesproken Nederlands

Het Corpus Gesproken Nederlands (CGN) is een verzameling van 900 uur (bijna 9 miljoen woorden) hedendaagse Nederlandse spraak, afkomstig van Vlamingen en Nederlanders. De spraakfragmenten (spontaan en voorbereid) zijn opgelijnd met diverse transcripties (o.a. orthografisch, fonetisch) en annotaties (syntactisch, POS-tags). Metadata, lexica, frequentielijsten en de corpusexploratiesoftware Corex behoren ook tot het CGN.

Eindhoven Corpus

Het Eindhoven-corpus is de eerste verzameling van Nederlandstalige geschreven en (getranscribeerde) gesproken teksten die voor onderzoeksdoeleinden is gemaakt. Het corpus dateert uit de periode 1960-1973 en bevat ongeveer 768.000 tekens.

Lassy Klein

Het Lassy Klein-corpus is een corpus van ongeveer 1 miljoen woorden met manueel geverifieerde syntactische annotaties. Lemma’s en POS-tags werden automatisch toegevoegd aan het corpus m.b.v. Tadpole (nu: Frog). De syntactische dependentiestructuren werden toegevoegd m.b.v. Alpino. De lemma’s, POS-tags en syntactische boomstructuren werden geverifieerd en gecorrigeerd.

SoNaR Klein-corpus

Het SoNaR Klein-corpus Commercieel is een tekstcorpus dat ongeveer 825.000 woorden tekst bevat die voorzien werden van verschillende soorten semantische annotaties, nl. named entity labelling, coreferentieannotatie, sematische rollen en de annotatie van spatiële en temporele relaties. Alle annotaties werden manueel geverifieerd.

ACTER: Annotated Corpora for Term Extraction Research

ACTER is een handmatig geannoteerde dataset voor termextractie, die drie talen omvat (Engels, Frans en Nederlands), en vier domeinen (corruptie, dressuur, hartfalen en windenergie).

  • CLARIN pagina
  • Github pagina
  • Rigouts Terryn, Ayla, 2019, ACTER (Annotated Corpora for Term Extraction Research) v1.3, Eurac Research CLARIN Centre

Dutch Archaeology NER Training Dataset

A manually annotated NER dataset, consisting of Dutch archaeological excavation reports. The following entity types are labelled: Artefacts, Time periods, Materials, Places (geographical locations), Archaeological contexts and Species. The dataset is provided in the BIO format, with each token on 1 line and empty lines denoting sentence boundaries. On each line you can find the token, PoS tag, morphological segmentation and finally the label, separated by spaces. The PoS tag and morphological segmentation are assigned by Frog.

StylesNMT

This data repository contains an English-Dutch machine translation (MT) of the detective novel "The Mysterious Affair at Styles" by Agatha Christie. The translation was generated in May 2019 by Google's neural MT system. The complete novel (5,276 sentence pairs) has been manually annotated with translation errors using an adapted version of the SCATE MT error taxonomy (Tezcan et al. 2017).

  • Download page
  • Tezcan, A., Hoste, V., & Macken, L. (2017). SCATE taxonomy and corpus of machine translation errors. In G. C. Pastor & I. Durán-Muñoz (Eds.), Trends in E-tools and resources for translators and interpreters (Vol. 45, pp. 219–244). Brill | Rodopi.

Pilot Annotation Corpus PLATOS NL-EN

This annotated corpus consists of 100 user-comments sourced on Facebook in the Summer of 2020, on the Facebook page of a popular flemish newspaper (Het Laatste Nieuws, https://www.facebook.com/hln.be).This corpus contains both the original comments in Dutch and a parallel English translation (Google Translate output lightly edited for correctness by a native speaker). The annotation covers topic and aspect labelling, stance labelling, argumentativeness detection and claim identification.

  • Download link
  • Bauwelinck, N., & Lefever, E. (2020, December). Annotating Topics, Stance, Argumentativeness and Claims in Dutch Social Media Comments: A Pilot Study. In Proceedings of the 7th Workshop on Argument Mining (pp. 8-18).

EventDNA

The EventDNA corpus is a Dutch-language corpus comprising 1,773 news documents in which news events, entities, IPTC Media Topic codes and coreference links have been manually annotated.

EmotioNL

The EmotioNl corpus is an emotion-annotated corpus of Dutch texts. It consists of 1,000 Dutch tweets and 1,000 captions from reality TV-shows, annotated with the categories anger, fear, joy, love, sadness and neutral, and scores (real-valued, between 0 and 1) for the emotional dimensions valence, arousal and dominance.

EEmoWOZ-CS EN-NL

The EmoWOZ corpus is a text-based conversational corpus in the domain of customer service, collected through the Wizard of Oz technique. In our Wizard of Oz experiment, participants believed to be interacting with different versions of an autonomous chatbot (called Chatty), while the system was in reality fully controlled by a human operator (henceforth: wizard). Each dialogue was grounded in an event description associated with a begin sentiment (neutral or negative), and wizards were instructed to navigate the conversation to a predefined end sentiment (positive, neutral or negative). Each participant had 12 conversations which were subsequently annotated for emotions with emotion categories and dimensional valence-arousal-dominance scores. In total, the corpus contains 2,148 text-based dialogues between 179 participants and wizards. While the original version of the corpus was collected in Dutch (NL), a translated version to English (EN) is also made available.

  • Project page
  • Labat, S., Ackaert, N., Demeester, T., & Hoste, V. (2022). Variation in the Expression and Annotation of Emotions: a Wizard of Oz Pilot Study. In G. Abercrombie, V. Basile, S. Tonelli, V. Rieser, & A. Uma (Eds.), Proceedings of the 1st Workshop on Perspectivist Approaches to NLP @LREC2022 (pp. 66–72). Marseille, France: European Language Resources Association (ELRA)

EmoTwiCS

EmoTwiCS is a corpus of 9,489 Dutch customer service dialogues that were scraped from Twitter.

Labat, S., Demeester, T., & Hoste, V. (2023). EmoTwiCS : a corpus for modelling emotion trajectories in Dutch customer service dialogues on Twitter. Labat, S., Hadifar, A., Demeester, T., & Hoste, V. (2022). An emotional journey : detecting emotion trajectories in Dutch customer service dialogues Request access

Retrieved from "https://kdutch.ivdnt.org/mediawiki/index.php?title=Manually_annotated_corpora/nl&oldid=7148"