noTenTen: Corpus of the Norwegian Web
The Norwegian Web Corpus (noTenTen, nnTenTen) is a Norwegian corpus made up of texts collected from the Internet. Sketch Engine provides access to two separate corpora for both written standards of the Norwegian language: Bokmål and Nynorsk. These Norwegian corpora belong to the TenTen corpus family which is a set of web corpora built using the same method with a target size 10+ billion words. Sketch Engine currently provides access to TenTen corpora in more than 50 languages. Data was crawled by the SpiderLing web spider. The Norwegian Web 2023 corpus (Bokmål) consists of 2.4 billion words whereas the Norwegian corpus of the Nynorsk variant contains 150 million words. The texts (for both corproa) were downloaded in December 2020 and September–November 2023. The Wikipedia part is from 2023.
Detailed information about TenTen corpora is on the separate page Common TenTen corpora attributes.
Nynorsk part-of-speech tagset
The nnTenTen (Nynorsk) corpus was POS annotated by Oslo-Bergen Tagger using this tagset summary.
The tags are available in two corpus attributes:
- tag – a part of speech
- tag_attrs – a morphological detail
For instance, where the original tag is “pron ent pers hum nom 1” (pronoun singular personal human nominative 1):
- tag = “pron”
- tag_attrs = “ent pers hum nom 1”
Bokmål part-of-speech tagset
The noTenTen (Bokmål) corpus was POS annotated by Tree Tagger using the Norwegian Universal Dependencies tagset.
Overview of Norwegian TenTen corpora
This is a list of Norwegian Web corpora available in Sketch Engine:
- Norwegian Web 2023 (Bokmål) – 2.45 billion words
- Norwegian Web 2023 (Nynorsk) – 150 million words
- Norwegian Web 2017 (both language variants) – 2.63 billion words
- Norwegian Web 2017 (Bokmål) – 2.46 billion words
- Norwegian Web 2017 (Nynorsk) – 169 million words
- Norwegian Web 2015 (both language variants) – 1.69 billion words
- Norwegian Web 2015 (Bokmål) – 1.17 billion words
- Norwegian Web 2015 (Nynorsk) – 44 million words
- Norwegian Web 2012 (both language variants) – 669 million words
Basic frequency statistics of the Norwegian Web 2023 corpus (Bokmål)
| Tokens | 2.8+ billion |
| Words | 2.4+ billion |
| Sentences | 170+ million |
| Web pages | 8+ million |
Genre annotation and topic classification
A part of the Norwegian Web 2023 (bokmål) corpus contains topic and genre annotation. These can be displayed as corpus structures in Concordance or in the Text type Analysis tool. Genres refer to writing styles and are divided into several groups (blog, discussion, fiction, legal, news, reference/encyclopedia) whereas topic classification is inspired by categories used by https://curlie.org/ (formerly dmoz.org).
- genres cover 18.7% of the corpus, i.e. 540 million tokens
- topics cover 7.6% of the corpus, i.e. 220 million tokens
Please refer to our article on topic and genre classification for more information: https://www.sketchengine.eu/blog/topics-and-genres-in-corpora/
Hover over the chart to display a number of tokens of the particular genre.
Tools to work with the Norwegian corpus from the web
A complete set of Sketch Engine tools is available to work with this Norwegian corpus to generate:
- word sketch – Norwegian collocations categorized by grammatical relations
- thesaurus – synonyms and similar words for every word
- keywords – terminology extraction of one-word and multi-word units
- word lists – lists of Norwegian nouns, verbs, adjectives etc. organized by frequency
- n-grams – frequency list of multi-word units
- concordance – examples in context
- text type analysis – statistics of metadata in the corpus
Changelog
notenten23, nntenten23 (January 2025)
- notenten23 (bokmål)
- nntenten23 (nynorsk)
- both corpora were cleaned, POS annotated, classified into genres and topics
- Bokmål variant newly uses Universal Dependencies tagset
notenten17
version 2 (August 2022)
- 2.9 billion tokens
- processed by the Oslo-bergen tagger Bokmal pipeline version 2
version 1 (September 2018)
- 2.8 billion tokens
- deep cleaning of foreign languages, especially Danish
- two separate language version
- subcorpus of Norwegian Wikipedia
notenten15 version 4 (2016)
- Danish removed
- Bokmål and Nynorsk separated
notenten15 version 2 (February 2015)
- crawled new version – 1.7 billion words
notenten12 version 1 (21 February 2012)
- initial version – 770 million tokens
Bibliography
TenTen corpora
SUCHOMEL, Vít. Better Web Corpora For Corpus Linguistics And NLP. 2020. Available also from: https://is.muni.cz/th/u4rmz/. Doctoral thesis. Masaryk University, Faculty of Informatics, Brno. Supervised by Pavel RYCHLÝ.
Jakubíček, M., Kilgarriff, A., Kovář, V., Rychlý, P., & Suchomel, V. (2013, July). The TenTen corpus family. In 7th International Corpus Linguistics Conference CL (pp. 125-127).
Suchomel, V., & Pomikálek, J. (2012). Efficient web crawling for large text corpora. In Proceedings of the seventh Web as Corpus Workshop (WAC7) (pp. 39-43).
Genre annotation
SUCHOMEL, Vít. Genre Annotation of Web Corpora: Scheme and Issues. In Kohei Arai, Supriya Kapoor, Rahul Bhatia. Proceedings of the Future Technologies Conference (FTC) 2020, Volume 1. Vancouver, Canada: Springer Nature Switzerland AG, 2021. s. 738-754. ISBN 978-3-030-63127-7. doi:10.1007/978-3-030-63128-4_55.
Search the Norwegian corpus
Sketch Engine offers a range of tools to work with the Norwegian corpus.
Use Sketch Engine in minutes
Generating collocations, frequency lists, examples in contexts, n-grams or extracting terms is easy with Sketch Engine. Use our Quick Start Guide to learn it in minutes.
