Check crawler rules against a public URL.
Your result appears below. No email or payment required.
Create explicit crawl rules and a sitemap reference.
Find your sitemap and inspect its structure, URLs, and sampled index files.
Trace status codes, destinations, and redirect loops.
