Home› Generators› XML Sitemap Generator
XML Sitemap Generator
Crawl a site and download a ready sitemap.xml.
About the XML Sitemap Generator
The crawler starts at the address you give it, follows internal links only, respects robots.txt and stops at the page limit or the time limit, whichever comes first. What comes back is a valid sitemap.xml with lastmod, changefreq and priority set from crawl depth.
Be realistic about what changefreq and priority do: Google treats both as weak hints and largely ignores priority. The genuinely valuable part of a sitemap is the list of URLs itself, especially for pages that are not well linked from your navigation.
If the crawl finds far fewer pages than you expect, that is a finding rather than a bug. It usually means the navigation is built in JavaScript after load, so neither this crawler nor a search engine's first pass can see it. Paginated archives with links added by script are the classic case.
Common questions
Why did it find fewer pages than my site actually has?
The crawler follows links it can see in the HTML. If your navigation is built with JavaScript after the page loads, neither this crawler nor a search engine's first pass can find those links.
Does changefreq or priority actually influence crawling?
Google treats both as weak hints at best and has said priority is largely ignored. The list of URLs itself is the valuable part of a sitemap.
What do I do with the file after downloading it?
Upload it to your site's root so it answers at /sitemap.xml, reference it in robots.txt, then submit the address in Google Search Console under Sitemaps.