Ecommet

XML Sitemap Generator

Crawl a website and build a sitemap.xml of its indexable pages, following robots.txt, noindex and canonical tags.

Loading the tool…

How to use it

Enter the address of the home page and start. The crawl follows links on the same site, skips pages that are blocked, redirected, noindex or canonicalised elsewhere, and builds the sitemap from the rest.

Questions

Does my store need this?

Magento, Shopify and WooCommerce (with an SEO plugin) already make a sitemap. This tool is for other sites, and for checking which pages a crawler can actually reach.

Why is a page missing from my sitemap?

Look at the Left out list: the page may be blocked by robots.txt, marked noindex, point its canonical tag elsewhere, redirect, or return an error. Pages no other page links to cannot be found by any crawler.

Where do I put sitemap.xml?

Upload it to the root of your site so it opens at /sitemap.xml, add a Sitemap: line to robots.txt, and submit it in Google Search Console.

Is there a limit?

Up to 500 pages per crawl, and a fair-use limit on requests per hour.

Have a project in mind?

Tell me what you need, even in a few lines, and I’ll come back with questions or a quote.