Jump to content

Common Crawl is Awesome: Revision history

Diff selection: Mark the radio buttons of the revisions to compare and hit enter or the button at the bottom.
Legend: (cur) = difference with latest revision, (prev) = difference with preceding revision, m = minor edit.

15 May 2026

  • curprev 17:2317:23, 15 May 2026 1G-N15 talk contribs 14,098 bytes +14,098 Created page with "The Common Crawl Foundation is little known outside of Silicon Valley. For more than a decade, the nonprofit has been scraping billions of webpages to build a massive archive of the internet. This database—large enough to be measured in petabytes—is made freely available for research. In recent years, however, this archive has been put to a controversial purpose: AI companies including OpenAI, Google, Anthropic, Nvidia, Meta, and Amazon have used it to train large la..."
Retrieved from "https://1gn15.com/index.php/Common_Crawl_is_Awesome"