guTenTen: Corpus of the Gujarati Web

The Gujarati Web Corpus (guTenTen) is a Gujarati corpus made up of texts collected from the Internet. The corpus belongs to the TenTen corpus family. Sketch Engine currently provides access to TenTen corpora in more than 40 languages. The corpora are built using technology specialized in collecting only linguistically valuable web content.

For detailed information about TenTen corpora, see Common TenTen corpora attributes.

The most recent version of the guTenTen corpus consists of 88 million words. The texts were downloaded March and April 2021 and from April to September 2017. The sample texts of the biggest web domains which account for 96% of all corpus texts were checked manually and content with poor quality text and spam was removed.

Part-of-speech tagset and stemming

The Gujarati Web corpora are part-of-speech tagged with the following Tagset for Indian Languages indicating the part of speech. The corpus texts also contain stemming when each word form from the corpus is assigned to its word stem. In this case, stems replace lemma attributes.

Search the Gujarati corpus guTenTen

Sketch Engine offers a range of tools to work with this Gujarati corpus.

open in Sketch Engine
about Sketch Engine

Overview of Gujarati TenTen corpora

These web corpora were crawled and processed repeatedly during the years:

  • Gujarati Web corpus 2021 (guTenTen21) – 88 million words

Basic information

Frequency
Tokens 99,743,610
Words 88,574,710
Sentences 6,352,593
Web pages 296,248

Preloaded subcorpora

A list of preloaded subcorpora (based on the top-level domains or genre annotation and topic classification) that are available in the Gujarati Web 2021 corpus.

Subcorpus Tokens % of the whole corpus
Gujarati Web 2017 55,976,865 56.121
Gujarati Web 2021 38,459,219 38.558
Gujarati Wikipedia 2021 5,307,526 5.321
Indian domain .in 10,088,657 10.115

Tools to work with the Gujarati corpora from the web

A complete set of Sketch Engine tools is available to work with these Gujarati corpora to generate:

  • word sketch – Gujarati collocations categorized by grammatical relations
  • thesaurus – synonyms and similar words for every word
  • keywords – terminology extraction of one-word units
  • word lists – lists of Gujarati nouns, verbs, adjectives etc. organized by frequency
  • n-grams – frequency list of multi-word units
  • concordance – examples in context
  • text type analysis – statistics of metadata in the corpus

Gujarati Web 2021 (guTenTen21)

version gutenten21_gnt (July 2023)

  • 88 million words
  • further cleaning and spam removing

TenTen corpora

SUCHOMEL, Vít. Better Web Corpora For Corpus Linguistics And NLP. 2020. Available also from: https://is.muni.cz/th/u4rmz/. Doctoral thesis. Masaryk University, Faculty of Informatics, Brno. Supervised by Pavel RYCHLÝ.

Jakubíček, M., Kilgarriff, A., Kovář, V., Rychlý, P., & Suchomel, V. (2013, July). The TenTen corpus family. In 7th International Corpus Linguistics Conference CL (pp. 125-127).

Suchomel, V., & Pomikálek, J. (2012). Efficient web crawling for large text corpora. In Proceedings of the seventh Web as Corpus Workshop (WAC7) (pp. 39-43).

Other Gujarati corpora

Explore our Gujarati Web corpus (guWaC) with 17+ million words.

available Gujarati corpora

Use Sketch Engine in minutes

Generate collocations, frequency lists, examples in contexts, n-grams or extract terms. Use our Quick Start Guide to learn it in minutes.

Quick Start Guide