fiTenTen: Corpus of the Finnish Web
The Finnish Web Corpus (fiTenTen) is a Finnish corpus made up of texts collected from the Internet. The corpus belongs to the TenTen corpus family which is a set of the web corpora built using the same method with a target size 10+ billion words. Sketch Engine currently provides access to TenTen corpora in more than 40 languages.
The Finnish Web 2024 corpus contains texts downloaded in 2019, 2020 and 2024. The whole Finnish corpus comprises 4.4 billion words. The sample texts of the largest web domains which account for 49% of all corpus texts were checked semi-automatically and content with poor quality text and spam was removed.
Detailed information about TenTen corpora is on the separate page Common TenTen corpora attributes.
Part-of-speech tagset
The fiTenTen corpus was POS annotated by TreeTagger using FinnTreebank tagset.
Overview of Finnish TenTen corpora
This is a list of Finnish Web corpora available in Sketch Engine:
- Finnish Web corpus 2024 (fiTenTen24) – 4.4 billion words
- Finnish Web corpus 2014 (fiTenTen14) – 1.4 billion word
Basic frequency statistics of the Finnish Web 2024 corpus
| Tokens | 5,428,940,906 |
| Words | 4,417,192,749 |
| Sentences | 400,633,946 |
| Web pages | 14,800,473 |
Genre annotation and topic classification
A part of the Finnish Web 2024 corpus contains genre annotation and topic classification. These can be displayed as corpus structures in Concordance or in the Text type Analysis tool. Genres refer to writing styles and are divided into four groups (blog, discussion, fiction, legal, news, reference/encyclopedia) whereas topic classification is inspired by categories used by https://curlie.org/ (formerly dmoz.org).
- genres cover 20.7% of the corpus, i.e. 1.1 billion tokens
- topic classification covers 7.5% of the corpus, i.e. 400 million tokens
Please refer to our article on topic and genre classification for more information: https://www.sketchengine.eu/blog/topics-and-genres-in-corpora/
Hover over the chart to display a number of tokens of the particular topic.
Tools to work with the Finnish Web corpus
A complete set of Sketch Engine tools is available to work with this Finnish corpus to generate:
- word sketch – Finnish collocations categorized by grammatical relations
- thesaurus – synonyms and similar words for every word
- keywords – terminology extraction of one-word and multi-word units
- word lists – lists of Finnish nouns, verbs, adjectives etc. organized by frequency
- n-grams – frequency list of multi-word units
- concordance – examples in context
- text type analysis – statistics of metadata in the corpus
Changelog
fiTenTen24_tt3 (2024-12-03)
- bad content removed
- topic and genre classification
2.0 (8 August 2014)
- Lemma, lempos added. Thanks to Josh Waxman for the Finnish TreeTagger model.
1.0 (21 May 2014)
- created – 1.4 billion words
Bibliography
TenTen corpora
Jakubíček, M., Kilgarriff, A., Kovář, V., Rychlý, P., & Suchomel, V. (2013, July). The TenTen corpus family. In 7th International Corpus Linguistics Conference CL (pp. 125-127).
Suchomel, V., & Pomikálek, J. (2012). Efficient web crawling for large text corpora. In Proceedings of the seventh Web as Corpus Workshop (WAC7) (pp. 39-43).
Search the Finnish corpus
Sketch Engine offers a range of tools to work with this Finnish corpus.
Use Sketch Engine in minutes
Generating collocations, frequency lists, examples in contexts, n-grams or extracting terms is easy with Sketch Engine. Use our Quick Start Guide to learn it in minutes.
