deWaC – German corpus from the .de domain
The German web corpus (deWaC) is a German corpus made up of texts collected from the Internet. The corpus was prepared according to standards described in the document A Corpus Factory for Many Languages (Kilgarriff et al. at LREC 2010).
Data was crawled by the SpiderLing web spider in 2009 and comprises more than 1.34 billion words.
sdeWaC: Parsed German web corpus
The sdeWaC corpus is a 755-million-word subset of German web corpus prepared by Getrud Faaß and Kerstin Eckart and later automatically annotated by Janina Kopp and Niels Ott in 2012. The sdeWaC does not contain duplications. It was parsed by TreeTagger and FSPar dependency parser which carried out sentence analysis.
Part-of-speech tagset
The corpus is tagged with TreeTagger using the Stuttgart-Tubingen tagset.
Tools to work with the German corpus
A complete set of Sketch Engine tools is available to work with this German corpus from the web to generate:
- word sketch – German collocations categorized by grammatical relations
- thesaurus – synonyms and similar words for every word
- keywords – terminology extraction of one-word and multi-word units
- word lists – lists of German nouns, verbs, adjectives etc. organized by frequency
- n-grams – frequency list of multi-word units
- concordance – examples in context
- text type analysis – statistics of metadata in the corpus
Changelog
sdeWaC (2012)
- without duplications
- parsed by TreeTagger and FSPar dependency parser
deWaC (2009)
- initial version 1,3 billion words
- tagged by TreeTagger
Bibliography
BARONI, Marco, et al. The WaCky wide web: a collection of very large linguistically processed web-crawled corpora. Language resources and evaluation, 2009, 43.3: 209-226.
Corpus factory method
Adam Kilgarriff, Siva Reddy, Jan Pomikálek, and Avinesh PVS. A corpus factory for many languages. In LREC workshop on Web Services and Processing Pipelines, Malta, May 2010.
sDeWaC corpus
FAAß, Gertrud; ECKART, Kerstin. Sdewac–a corpus of parsable sentences from the web. In: Language processing and knowledge in the Web. Springer, Berlin, Heidelberg, 2013. p. 61-68.
German word sketch (sdeWaC)
Ivanova, K., Heid, U., Im Walde, S. S., Kilgarriff, A., & Pomikálek, J. (2008, May). Evaluating a German Sketch Grammar: A Case Study on Noun Phrase Case. In LREC.
Search the German corpus
Sketch Engine offers a range of tools to work with this German corpus.
Use Sketch Engine in minutes
Generating collocations, frequency lists, examples in contexts, n-grams or extracting terms is easy with Sketch Engine. Use our Quick Start Guide to learn it in minutes.
