Crawler sitemap |

Hello. I have shop with 15k products. Half is out of stock. I understand it doesn’t make sense to crawl all these products. Moreover, there are totally 400 subcategories in funnel. Main category or “shop all” category, can have hundreds of subpages. It also most likely doesn’t make sense to crawl (they’re noindex for google).

I’m thinking of making own sitemap with in stock products only and as for categories, include only first 3 pages. Does it make sense and wouldn’t crawler follow canonical link to next page anyway?


This site will teach you how to build a WordPress website for beginners. We will cover everything from installing WordPress to adding pages, posts, and images to your site. You will learn how to customize your site with themes and plugins, as well as how to market your site online.

Buy WordPress Transfer