haWaC: Hausa corpus from the Web
The Hausa web corpus (haWaC) is a Hausa corpus made up of texts collected from the Internet. The corpus was prepared according to standards described in the document A Corpus Factory for Many Languages (Kilgarriff et al. at LREC 2010).
Data was crawled by the SpiderLing web spider and the WebBootCat tool in June 2015 and comprised of more than 5 million words. Texts are written in Boko, a Latin script of the Hausa Language. The corpus has not a part-of-speech tagging yet.
Tools to work with the Hausa corpus
A complete set of Sketch Engine tools is available to work with this Hausa corpus from the web to generate:
- word lists – lists of Hausa words etc. organized by frequency
- n-grams – frequency list of multi-word units
- concordance – examples in context
- keywords– terminology extraction of one-word
- text type analysis – statistics of metadata in the corpus
Changelog
version 3 (March 2017)
- corpus tagged by the RFTagger tool with the NKJP tagset
- created lempos
version 2 (1 July 2013)
- corpus tagged by the WCRFT tagger
version 1 (23 July 2012)
- initial version – 7.7 billion words, untagged
a sample for Cesar (25 October 2012)
- 640 million words sample
- tagged by WCRFT (source: Wayback Machine) with the NKJP tagset
Bibliography
TenTen corpora
Jakubíček, M., Kilgarriff, A., Kovář, V., Rychlý, P., & Suchomel, V. (2013, July). The TenTen corpus family. In 7th International Corpus Linguistics Conference CL (pp. 125-127).
Suchomel, V., & Pomikálek, J. (2012). Efficient web crawling for large text corpora. In Proceedings of the seventh Web as Corpus Workshop (WAC7) (pp. 39-43).
Word Sketches
Radziszewski, A., Kilgarriff, A., & Lew, R. (2011). Polish word sketches.
Search the Hausa corpus
Sketch Engine offers a range of tools to work with this Hausa corpus.
Use Sketch Engine in minutes
Generate collocations, frequency lists, examples in contexts, n-grams or extract terms. Use our Quick Start Guide to learn it in minutes.
