Qortora · Search · Indexed page
commoncrawl.orgFetched 2026-08-13T19:30:21Z
Common Crawl - Web Graphs
Detailing Common Crawl's Web Graph releases, the technology behind them, and how to use them.
Open original source · Full cached text
Common Crawl - Web Graphs The Data OverviewCDXJ IndexURL IndexWeb GraphsLatest CrawlCrawl StatsGraph StatsErrata Resources Get StartedAI AgentBlogExamplesCCBotInfra StatusOpt-Out LedgerFAQ Community Research PapersMailing List ArchiveHugging FaceDiscordCollaborators About AboutTeamJobsPrivacy PolicyTerms of Use Search AI Agent Contact Us Web Graphs Choose a Web Graph... cc-main-2026-may-jun-jul cc-main-2026-apr-may-jun cc-main-2026-mar-apr-may cc-main-2026-feb-mar-apr cc-main-2026-jan-feb-mar cc-main-2025-26-dec-jan-feb cc-main-2025-26-nov-dec-jan cc-main-2025-oct-nov-dec cc-main-2025-sep-oct-nov cc-main-2025-aug-sep-oct cc-main-2025-jul-aug-sep cc-main-2025-jun-jul-aug cc-main-2025-may-jun-jul cc-main-2025-apr-may-jun cc-main-2025-mar-apr-may cc-main-2025-feb-mar-apr cc-main-2025-jan-feb-mar cc-main-2024-25-dec-jan-feb cc-main-2024-25-nov-dec-jan cc-main-2024-oct-nov-dec cc-main-2024-sep-oct-nov cc-main-2024-aug-sep-oct cc-main-2024-jul-aug-sep cc-main-2024-jun-jul-aug cc-main-2024-may-jun-jul cc-main-2024-apr-may-jun cc-main-2024-feb-apr-may cc-main-2024-nov-feb-apr cc-main-2023-24-sep-nov-feb cc-main-2023-may-sep-nov cc-main-2023-mar-may-oct cc-main-2022-23-sep-nov-jan cc-main-2022-may-jun-aug cc-main-2021-22-oct-nov-jan cc-main-2021-jun-jul-sep cc-main-2021-feb-apr-may cc-main-2020-21-oct-nov-jan cc-main-2020-jul-aug-sep cc-main-2020-feb-mar-may cc-main-2019-20-nov-dec-jan cc-main-2019-aug-sep-oct cc-main-2019-may-jun-jul cc-main-2019-feb-mar-apr cc-main-2018-19-nov-dec-jan cc-main-2018-aug-sep-oct cc-main-2018-may-jun-jul cc-main-2018-feb-mar-apr cc-main-2018-jan cc-main-2017-18-nov-dec-jan cc-main-2017-aug-sep-oct cc-main-2017-may-jun-jul cc-main-2017-feb-mar-apr-hostgraph Common Crawl regularly releases host- and domain-level graphs, for visualising the crawl data. You can browse all available releases on our Web Graphs Index page. Hostnames in the graph are in reverse domain name notation and all types of links are listed, including purely “technical” links pointing to images, JavaScript libraries, web fonts, etc. However, only hostnames with a valid IANA TLD are used. As a result, URLs with an IP address as host component are not taken into account for building the host-level graph. The domain graph is built by aggregating the host graph at the pay-level domain (PLD) level based on the public suffix list maintained on publicsuffix.org. The list of graph releases is also available via graphinfo.json. For more information please see cc-webgraph on GitHub, and our Web Graph Statistics page. Credits Thanks to the authors of the WebGraph Framework, whose software made the computation of graph properties and ranks possible. We hope you find the data useful for any kind of research on ranking, graph analysis, link spam detection, etc. Let us know about your results via Common Crawl’s Google Group! The Data Overview CDXJ Index URL Index Web Graphs Latest Crawl Crawl Stats Graph Stats Errata Resources Get Started AI Agent Blog Examples CCBot Infra Status Opt-Out Ledger FAQ Community Research Papers Mailing List Archive Hugging Face Discord Collaborators About About Team Jobs Privacy Policy Terms of Use © 2026 Common Crawl