Search the Spanish corpus (esTenTen)
The Spanish Web corpus (esTenTen) is a text corpus created from the collected internet texts. The corpus belongs to the TenTen corpus family which is a set of the same processed web corpora with the target size 10+ billion words. Sketch Engine currently provides access to TenTen corpora in more than 40 languages.
The corpus contains subcorpora based on the language varieties – European Spanish and American Spanish. Particular Spanish varieties were downloaded from web domains in the respective continents.
Detailed information about TenTen corpora is on the separate page Common TenTen corpora attributes.
Part-of-speech tagset
Part-of-speech tagging and lemmatisation were performed using FreeLing analyser with Spanish configuration, see Spanish FreeLing tagset.
Overview of Spanish TenTen corpora
A list of Spanish TenTen corpora available in the Sketch Engine database:
- Spanish Web corpus 2023 (esTenTen23) – 28.6 billion words (European Spanish Web, American Spanish Web, whole Spanish Wikipedia) with topic classification for the biggest web domains based on a semi-manual check of sample texts
- Spanish Web corpus 2018 (esTenTen18) – 16.9 billion words (European Spanish Web, American Spanish Web, whole Spanish Wikipedia) with topic classification for the biggest web domains based on a semi-manual check of sample texts
- Spanish Web corpus 2011 (esTenTen11) – 9.5 billion words (European Spanish Web, American Spanish Web, small part of Spanish Wikipedia)
Basic frequency statistics of the Spanish Web 2023 corpus
| Tokens | 33,135,276,527 |
| Words | 28,652,392,686 |
| Sentences | 1,326,647,524 |
| Web pages | 82,021,635 |
Genre annotation and topic classification
A part of the Spanish Web 2023 corpus contains genre annotation and topic classification. These can be displayed as corpus structures in Concordance or in the Text type Analysis tool. Genres refer to writing styles and are divided into four groups (blog, discussion, fiction, legal, news, reference/encyclopedia) whereas topic classification is inspired by categories used by https://curlie.org/ (formerly dmoz.org).
- genres cover 15.2% of the corpus, i.e. 5 billion tokens
- topic classification covers 5.7% of the corpus, i.e. 1.9 billion tokens
Please refer to our article on topic and genre classification for more information: https://www.sketchengine.eu/blog/topics-and-genres-in-corpora/
Hover over the chart to display a number of tokens of the particular topic.
Top-level domains distribution in the Spanish Web 2023 corpus
A list of top level domains
| Argentinian (.ar) | Bolivian (.bo) | Chilean (.cl) | Colombian (.co) |
| Costa Rican (.cr) | Cuban (.cu) | Dominican (.do) | Ecuadorian (.ec) |
| Guatemalan (.gt) | Honduran (.hn) | Mexican (.mx) | Nicaraguan (.ni) |
| Panama (.pa) | Paraguayan (.py) | Peruvian (.pe) | Salvadoran (.sv) |
| Spanish (.es) | Uruguayan (.uy) | Venezuelan (.ve) |
Tools to work with the Spanish corpus
A complete set of tools is available to work with these Spanish corpora from the Web to generate:
- word sketch – Spanish collocations categorized by grammatical relations
- thesaurus – synonyms and similar words for every word
- keywords – terminology extraction of one-word and multi-word units
- word lists – lists of Spanish nouns, verbs, adjectives etc. organized by frequency
- n-grams – frequency list of multi-word units
- concordance – examples in context
- text type analysis – statistics of metadata in the corpus
Changelog
Spanish Web 2023 (esTenTen23)
version estenten23_fl6 (October 2023)
- 33 billion tokens
- samples from the biggest web domains were manually checked and content with poor linguistic quality was removed.
- topics and genres added to manually checked websites
- data downloaded in June 2020 – September 2020 and December 2022 – January 2023
Spanish Web 2018 (esTenTen18)
version estenten18_fl5_1 (October 2021)
- 19.6 billion tokens
- samples from the biggest web domains were manually checked and content with poor linguistic quality was removed.
- topics and genres added to manually checked websites
version estenten18_fl5 (June 2019)
version estenten18_fl5 (November 2018)
- the initial version of estenten18 with 20.3 billion tokens
- tagged by the FreeLing pipeline version 5
Spanish Web 2011 (esTenTen11)
version estenten11_fl5 (spring 2017)
- re-tagged using FreeLing 4 in Sketch Engine pipeline version 5
version estenten11 (January 2016)
- re-tagged using Freeling 4
version estenten11 (11 February 2015)
- re-tagged using Freeling 3.1
version estenten11 (2 April 2014)
- fixed encoding issues
version estenten11 (29 July 2013)
- re-tagged using Freeling 3.0
version estenten11 (17 October 2012)
- American and European parts from 2011 put together
- subcorpora can be used to query the parts separately now
version estenten11 (12 January 2012)
- American Spanish data crawled by web crawler SpiderLing in December 2011
- these documents were put into a separate corpus “esAmTenTen”
version estenten11 (30 September 2011)
- removed Catalan and Galician texts
- corpus size reduced by 79 million tokens
version estenten11 (13 April 2011)
- Initial version – 2.5 billion tokens.
- Crawled by web crawler Heritrix.
- Tagged by TreeTagger with UTF-8 Spanish parameter file applying Stuttgart Spanish tagset.
Bibliography
Kilgarriff, A., & Renau, I. (2013). esTenTen, a vast web corpus of Peninsular and American Spanish. Procedia-Social and Behavioral Sciences, 95, 12-19.
SUCHOMEL, Vít. Better Web Corpora For Corpus Linguistics And NLP. 2020. Available also from: https://is.muni.cz/th/u4rmz/. Doctoral thesis. Masaryk University, Faculty of Informatics, Brno. Supervised by Pavel RYCHLÝ.
Jakubíček, M., Kilgarriff, A., Kovář, V., Rychlý, P., & Suchomel, V. (2013, July). The TenTen corpus family. In 7th International Corpus Linguistics Conference CL (pp. 125-127).
Suchomel, V., & Pomikálek, J. (2012). Efficient web crawling for large text corpora. In Proceedings of the seventh Web as Corpus Workshop (WAC7) (pp. 39-43).
Genre annotation
SUCHOMEL, Vít. Genre Annotation of Web Corpora: Scheme and Issues. In Kohei Arai, Supriya Kapoor, Rahul Bhatia. Proceedings of the Future Technologies Conference (FTC) 2020, Volume 1. Vancouver, Canada: Springer Nature Switzerland AG, 2021. s. 738-754. ISBN 978-3-030-63127-7. doi:10.1007/978-3-030-63128-4_55.
Search the Spanish corpus
Sketch Engine offers a range of tools to work with this Spanish corpus.
Use Sketch Engine in minutes
Generate collocations, frequency lists, examples in contexts, n-grams or extract. Use our Quick Start Guide to learn it in minutes.
