urWaC: Urdu corpus from the web
The Urdu web corpus (urWaC) is an Urdu corpus made up of texts collected from the Internet. The corpus was prepared according to standards described in the document A Corpus Factory for Many Languages (Kilgarriff et al. at LREC 2010).
Data was crawled by the SpiderLing web spider in 2015 and comprised of more than 53 million. The UrduWaC corpus has not tagged yet.
Tools to work with the Urdu corpus
A complete set of tools is available to work with this UrduWaC corpus to generate:
- word lists – lists of Urdu nouns, verbs, adjectives etc. organized by frequency
- n-grams – frequency list of multi-word units
- concordance – examples in context
- keywords– terminology extraction of one-word
- text type analysis – statistics of metadata in the corpus
Bibliography
Corpus factory method
Adam Kilgarriff, Siva Reddy, Jan Pomikálek, and Avinesh PVS. A corpus factory for many languages. In LREC workshop on Web Services and Processing Pipelines, Malta, May 2010.
Search the Urdu corpus
Sketch Engine offers a range of tools to work with this Urdu corpus.
Use Sketch Engine in minutes
Generate collocations, frequency lists, examples in contexts, n-grams or extract terms. Use our Quick Start Guide to learn it in minutes.
