Common Crawl - Terms of Use The Data OverviewCDXJ IndexURL IndexWeb GraphsLatest CrawlCrawl StatsGraph StatsErrata Resources Get StartedAI AgentBlogExamplesCCBotInfra StatusOpt-Out LedgerFAQ Community Research PapersMailing List ArchiveHugging FaceDiscordCollaborators About AboutTeamJobsPrivacy PolicyTerms of Use Search AI Agent Contact Us Terms of Use LAST UPDATED: March 7, 2024 Welcome to the commoncrawl.org website (the "Site"). The Common Crawl Foundation ("CC", "we", or "us") established the Site and the databases, tools and information we collected and developed using the ccBot crawler, including the Crawled Content (as defined below) (all of the foregoing, collectively with the Site, the "Service") for anyone to access a comprehensive crawl of the Internet for the purpose of enabling a new wave of innovation, education and research. To help us preserve our mission statement and to properly balance the interests of our users and the owners of the websites that the Service has crawled, we have established these Terms of Use ("ToU"). The ToU describe the terms and conditions applicable to your access and use of the Site and the Service. Your use of the Site, the Service, or the Crawled Content signifies that you agree to the ToU and constitutes your binding acceptance of the ToU, including any modifications that we make from time to time. We may include links to the ToU in the Crawled Content, and, for the avoidance of doubt, your use of the Crawled Content signifies your binding acceptance of the ToU. We may amend the ToU at any time by posting the amended Terms of Use on the Site, and, by continuing to use the Service or Crawled Content after we make such modifications, you agree that you will be subject to the modified ToU.  If you do not agree to the modified terms, you should discontinue your use of the Service and the Crawled Content. For your convenience, the date of last revision is included at the top of this page. We may make changes to the Site and/or the Service at any time. You understand that we may discontinue or restrict your use of the Site and/or Service for any reason or no reason with or without notice.  If additional terms or conditions are available with or applicable to the relevant portion(s) of the Service, then those additional terms become part of your agreement with us if you use any such portion(s) of the Service. YOU ACKNOWLEDGE AND AGREE THAT THESE TERMS LIMIT OUR LIABILITY AND THAT YOU ARE RELEASING US FROM VARIOUS CLAIMS IN SECTIONS 6 AND 7 BELOW. THESE TERMS ALSO CONTAIN A BINDING ARBITRATION PROVISION IN SECTION 11 THAT AFFECT YOUR RIGHTS UNDER THESE TERMS WITH RESPECT TO THE SERVICES. 1. LIMITED LICENSE CC grants you a limited, non-assignable, non-transferable, non-sublicensable, non-exclusive, limited license to access and use the Service subject to the terms and conditions of these ToU. You may not use the Service or the Site in any manner except as authorized under these ToU. CC reserves all other rights not otherwise expressly granted in these ToU. 2. UNLAWFUL AND PROHIBITED USE AND CONDUCT You agree that your use of the Service and Crawled Content  must comply with all applicable local, state, national, and international laws, and that you will not use the Service for any illegal purpose. You also acknowledge and agree that all information, data, text, scripts, web pages, web sites, software, html page links, open data APIs, metadata or other materials contained in, or otherwise made accessible to you in, the Service (collectively the "Crawled Content") may be subject to separate terms of use or terms of service from the owners of such Crawled Content. In addition to the foregoing restrictions, you hereby agree that you will not use or access the Service or Crawled Content for or to engage in any of the following: (a) engaging in harmful, defamatory, threatening, abusive, harassing, tortious, vulgar, libelous, hateful or otherwise offensive or objectionable activities; (b) invading other people's privacy; (c) exploiting children or otherwise harming minors; (d) violating the rights of another individual or entity, including but not limited to such party's intellectual property rights or other proprietary rights; (e) circumventing copy-protected devices and software; (f) interfering with or disrupting the Service and/or the servers or networks connected to the Service or circumventing, disabling or interfering with security features on the Site; (g) displaying, distributing or transmitting unsolicited advertisements, promotional materials, "spam", "junk mail", "chain letters", and "pyramid schemes"; (h) stalking or otherwise harassing another person; (i) impersonating any person or entity or falsely stating or otherwise misrepresenting your affiliation with a person or entity; (j) forging or intentionally modifying headers or other information for the purpose of disguising the origin of any Crawled Content available through the Service; (k) violating any applicable local, state, national or international law, and any applicable regulations having the force of law; (l) collecting or harvesting any personally identifiable information or personal information for use separately from the Crawled Content; or (m) using the communication systems provided by the Site for any commercial solicitation purposes. 3. CONTENT DISCLAIMERS AND RESTRICTIONS You understand and agree that the Crawled Content made available through the Service is the sole responsibility of the individual or entity from which such Crawled Content originated. We are not responsible for any Crawled Content accessible through the Service. CC cannot guarantee the truthfulness, authenticity, quality, lawfulness or accuracy of the Crawled Content. By using the Service, you agree that under no circumstances will CC be liable to you or to any third parties in any way for any Crawled Content, including, without limitation, for any errors or omissions in any Crawled Content, or for any loss or damage of any kind incurred as a result of the use of any Crawled Content made available via the Service. In addition, the Site or Crawled Content may contain links to third party websites that are not owned or controlled by CC. By using the Service, you agree that we shall not be liable in any manner from your use of any third party website, including, without limitation, web sites linked from the Site, the Service or the Crawled Content. You acknowledge that we and our designees shall have the right (but not the obligation) in our sole discretion to refuse, change, delete, or recategorize any Crawled Content that is available via the Service. Without limiting the foregoing, we and our designees shall have the right to remove any Crawled Content at any time and for any reason in our sole discretion, including, without limitation, because certain Crawled Content violates this ToU or is otherwise illegal or objectionable.You understand and agree that CC may, in its sole discretion and without prejudice to CC's rights to seek any redress available to it under applicable laws and/or file any claims that may be available to CC, terminate your use of the Service and/or the Crawled Content at any time and for any reason, and without prior notice to you.  For the further avoidance of doubt, in the event that your use of the Service and/or Crawled Content gives rise to any liability and/or third-party claims, nothing in this ToU or elsewhere shall be construed as limiting any rights that may be available to CC to seek redress and/or file claims against you as a result of such liability and/or third-party claims. You further agree that any improper, abusive, fraudulent, and/or illegal activity or violation of the ToU may be grounds for immediate termination of your right to continue to use the Site, the Service or Crawled Content. You further agree that you must evaluate, and bear all risks associated with the use of any Crawled Content, including any reliance on the accuracy, completeness, lawfulness or usefulness of such Crawled Content. In this regard, you acknowledge that you may not rely on any Crawled Content created or accumulated by CC.  CC strongly recommends that you obtain the advice of legal counsel before making any use, including commercial use, of the Service and/or the Crawled Content.  BY USING THE CRAWLED CONTENT, YOU AGREE TO RESPECT THE COPYRIGHTS AND OTHER APPLICABLE RIGHTS OF THIRD PARTIES IN AND TO THE MATERIAL CONTAINED THEREIN. 4. INTELLECTUAL PROPERTY The Site and the Service are protected by copyrights, trademarks, service marks, and/or other proprietary rights under the laws of the U.S. and other countries. By using or accessing the Site or the Service you agree to comply with all state and federal laws that protect our proprietary interest in the material appearing on the Site. 5. NOTIFICATION AND PROCEDURE FOR MAKING CLAIMS OF COPYRIGHT INFRINGEMENT OR INTELLECTUAL PROPERTY INFRINGEMENT We will take appropriate actions in response to notice of copyright infringement. If you believe that your work has been used or copied in a way that constitutes copyright infringement and such infringement is occurring on or through this site or the Service, please provide Notice to our Copyright Agent.  PLEASE NOTE THAT YOU MUST PROVIDE A DETAILED DESCRIPTION OF THE CONTENT YOU ALLEGE IS INFRINGING WITH SUFFICIENT SPECIFICITY TO ALLOW CC TO RESPOND TO YOUR REQUEST. Pursuant to Title 17, United States Code, Section 512I(3), a notification of claimed infringement must be a written communication addressed to the designated agent as set forth below (the "Notice"), and must include substantially all of the following: (a) a physical or electronic signature of the person authorized to act on behalf of the owner of the copyright interest that is alleged to have been infringed; (b) a description of the copyrighted work or works that you claim have been infringed ("infringed work") and identification of what material in such work(s) is claimed to be infringing ("infringing work") and which you request to be removed or access to which is to be disabled; (c) a description of the exact name of the infringing work on the Site or the Service (and the location of the infringing work, if it appears on the Site or the Service) or if the infringing work appears on a site linked to from the Site or the Service where the material that you claim is infringing is located on such site; (d) information sufficient to permit us to contact you, such as your physical address, telephone number, and email address; (e) a statement by you that you have a good faith belief that the use of the material identified in your Notice in the manner complained of is not authorized by the copyright owner, its agent, or the law; and (f) a statement by you that the information in your Notice is accurate and, under penalty of perjury that you are the copyright owner or authorized to act on the copyright owner's behalf. To reach our Copyright Agent for Notice of claims of copyright infringement:    Common Crawl Foundation     9663 Santa Monica Blvd., #425     Beverly Hills, CA 90210 The Copyright Agent should only be contacted if you believe that your work has been used or copied in a way that constitutes copyright infringement and such infringement is occurring on or through the Site or the Service. The Copyright Agent will not respond to any other inquiries. Notwithstanding anything to the contrary, CC reserves the right, in its sole discretion and judgment, to take no action in response to Notices where CC has a bona fide basis to believe that the Notice is not being made by the copyright owner or by an individual or entity that is authorized to act on the copyright owner's behalf. 6. DISCLAIMER OF WARRANTIES YOU EXPRESSLY UNDERSTAND AND AGREE THAT: YOUR USE OF THE SITE, SERVICE, AND CRAWLED CONTENT IS AT YOUR SOLE RISK. THE SITE, SERVICE, AND CRAWLED CONTENT ARE PROVIDED ON AN "AS IS" AND "AS AVAILABLE"…