isTenTen — Icelandic corpus from the web

isTenTen: Corpus of the Icelandic Web

The Icelandic Web Corpus (isTenTen) is an Icelandic corpus made up of texts collected from the Internet. The corpus belongs to the TenTen corpus family. Sketch Engine currently provides access to TenTen corpora in more than 40 languages. The corpora are built using technology specialized in collecting only linguistically valuable web content.

For detailed information about TenTen corpora, see Common TenTen corpora attributes.

The isTenTen corpus consists of 518 million words. The texts were downloaded between August and September 2020 and the Wikipedia part is from August 2020. The sample texts of the 500 biggest web domains which account for 70% of all corpus texts were checked manually and content with poor quality text and spam was removed.

Part-of-speech tagset

The isTenTen Icelandic corpus was part-of-speech tagged by IceNLP toolkit with IFD Tagset.

isTenTen20 corpus statistics in detail

Basic information

	Frequency
Tokens	595,127,701
Words	518,620,759
Sentences	32,655,862
Web pages	1,301,814

Tools to work with the Icelandic corpus from the web

A complete set of Sketch Engine tools is available to work with this Icelandic corpus to generate:

word sketch – Icelandic collocations categorized by grammatical relations
thesaurus – synonyms and similar words for every word
keywords – terminology extraction of one-word units
word lists – lists of Icelandic nouns, verbs, adjectives etc. organized by frequency
n-grams – frequency list of multi-word units
concordance – examples in context
text type analysis – statistics of metadata in the corpus

Bibliography

TenTen corpora

Jakubíček, M., Kilgarriff, A., Kovář, V., Rychlý, P., & Suchomel, V. (2013, July). The TenTen corpus family. In 7th International Corpus Linguistics Conference CL (pp. 125-127).

Suchomel, V., & Pomikálek, J. (2012). Efficient web crawling for large text corpora. In Proceedings of the seventh Web as Corpus Workshop (WAC7) (pp. 39-43).