Crawler

Request a crawl

Suggest a public web page for Qortora to fetch and consider for the index. Submissions are validated server-side — private networks, credentials, odd ports, and non-http schemes are rejected.

What we accept

• Public http / https pages only
• Standard web ports (80 or 443)
• Real hostnames (not bare single labels like intranet)
• Crawlable document types (HTML and similar — not raw binaries)

What we reject

• Private / loopback / link-local / cloud-metadata addresses
• URLs with usernames or passwords embedded
• javascript:, data:, file:, and other non-web schemes
• Operator blocklisted hosts or paths
• Garbage input that is not a well-formed URL

Expectations

• Acceptance means the URL was queued, not that it is already searchable.
• Robots.txt, rate limits, quality filters, and capacity still apply after enqueue.
• This form is rate-limited. Bulk discovery should use the operator crawl APIs, not this page.