Skip to main content


Learn how Google crawls large e-commerce websites, allocates crawl budget, handles faceted navigation and filters, and decides which product pages to index. This guide also explains how to identify and fix crawl waste at scale, so your most valuable pages get discovered, indexed, and ranked efficiently.