{"format_version":"lexandry.http.v1","guide_url":"/agents.json","notice":"Contributor supplied; source control is verified only where a listing's provenance says so.","id":"046d9c2fea8bcccf1633b71fab199b9c15bea726be03039dfacc291249bcd998","title":"Common Crawl Corpus","url":"https://commoncrawl.org/overview","category":"Datasets","description":"A regularly collected corpus of public web snapshots, maintained as large downloadable crawl releases. It gives researchers and developers access to web-scale material without requiring each project to run its own crawler. Useful for studies of the web, information retrieval and language-data processing; the official overview identifies crawl releases so a project can record exactly which snapshot underlies its analysis.","updated":"2026-11-03","link_checked":"2026-11-03","search_context":{}}