sqTenTen: Corpus of the Albanian Web

The Albanian Web Corpus (sqTenTen) is an Albanian corpus made up of texts collected from the Internet. The corpus belongs to the TenTen corpus family. Sketch Engine currently provides access to TenTen corpora in more than 40 languages. The corpora are built using technology specialized in collecting only linguistically valuable web content.

For detailed information about TenTen corpora, see Common TenTen corpora attributes.

The Albanian Web 2020 corpus consists of 500+ million words. The texts were downloaded in 2020. The sample texts of the biggest web domains which account for 90% of all corpus texts were checked semi-manually and content with poor quality text and spam was removed.

Part-of-speech tagset

The sqTenTen corpus was tagged by Universal part-of-speech tags. The corpus texts also contain lemmatization when each word form from the corpus is assigned to its base form (lemma). This part of speech tagging and lemmatization was carried out using the Turku neural parser pipeline (available from webarchive).

Statistics of Albanian Web 2020 corpus

Basic statistics about the Albanian corpus from the web.

Frequency
Tokens 616,599,025
Words 528,084,150
Sentences 25,820,161
Web pages 1,334,982

Search the Albanian corpus sqTenTen

Sketch Engine offers a range of tools to work with this Albanian corpus.

open in Sketch Engine
about Sketch Engine

Tools to work with the Albanian corpus from the web

A complete set of Sketch Engine tools is available to work with this Albanian Web 2020 corpus to generate:

  • word sketch – Albanian collocations categorized by grammatical relations
  • thesaurus – synonyms and similar words for every word
  • keywords – terminology extraction of one-word units
  • word lists – lists of Albanian nouns, verbs, adjectives etc. organized by frequency
  • n-grams – frequency list of multi-word units
  • concordance – examples in context
  • text type analysis – statistics of metadata in the corpus

TenTen corpora

SUCHOMEL, Vít. Better Web Corpora For Corpus Linguistics And NLP. 2020. Available also from: https://is.muni.cz/th/u4rmz/. Doctoral thesis. Masaryk University, Faculty of Informatics, Brno. Supervised by Pavel RYCHLÝ.

Jakubíček, M., Kilgarriff, A., Kovář, V., Rychlý, P., & Suchomel, V. (2013, July). The TenTen corpus family. In 7th International Corpus Linguistics Conference CL (pp. 125-127).

Suchomel, V., & Pomikálek, J. (2012). Efficient web crawling for large text corpora. In Proceedings of the seventh Web as Corpus Workshop (WAC7) (pp. 39-43).

Other text corpora

Sketch Engine offers 800+ language corpora.

available corpora

Use Sketch Engine in minutes

Generate collocations, frequency lists, examples in contexts, n-grams or extract terms. Use our Quick Start Guide to learn it in minutes.

Quick Start Guide