teWaC: Telugu web corpus
The Telugu web corpus (teWaC) is a language corpus made up of texts collected from the Internet. The corpus was prepared according to standards described in the document A Corpus Factory for Many Languages (Kilgarriff et al. at LREC 2010).
Data was crawled by the SpiderLing web spider in 2010 with the total size 3.6 million words.
Part-of-speech tagset
The teWaC is POS tagged by Telugu POS tagger from Siva Reddy website using the following part-of-speech tags.
Tools to work with the Telugu Web corpus
A complete set of Sketch Engine tools is available to work with this TeluguWaC corpus to generate:
- word sketch – Telugu collocations categorized by grammatical relations
- thesaurus – synonyms and similar words for every word
- word lists – lists of Telugu nouns, verbs, adjectives etc. organized by frequency
- n-grams – frequency list of multi-word units
- concordance – examples in context
Changelog
v2.0 (17th Jan 2012)
- The corpus is tagged using a new POS tagger (90.73% accuracy), lemmatizer and morph analyser downloaded from http://sivareddy.in/downloads
- simple sketch grammar for Telugu and generated word sketches and distributional thesaurus for Telugu
Bibliography
Corpus factory method
Kilgarriff, A., Reddy, S., Pomikálek, J., & Avinesh, P. V. S. (2010, May). A corpus factory for many languages. In LREC.
Search the Telugu Web corpus
Sketch Engine offers a range of tools to work with the Telugu Web corpus.
or
Use Sketch Engine in minutes
Generating collocations, frequency lists, examples in contexts, n-grams or extracting terms is easy with Sketch Engine. Use our Quick Start Guide to learn it in minutes.
