blog Release 2024-02-28

We’ve made some changes to our crawler to better extract URLs from your site. We’ve also got an initial view on the URLs as listed in your sitemap and if they are indexed or not.

• Improved crawler (this may be a can of worms but feel it’s important to reviewing all your site content)
• Only crawl up to 1k site URLs by default; we’ll crawl more if requested
• View your sitemap URLs (from Google) and the indexing status of those URLs