Crawl
Filter URLs multiply
Every color, size, material and price range on every collection creates a new URL. Shopify's default robots.txt blocks multi-filter combinations, but single filters and sort orders still add up fast.
Large catalog SEO
Shopify faceted navigation SEO for catalogs in the thousands
With 1,000 to 100,000 SKUs, filters, variants and tags can create far more URLs than you have products. We decide which ones deserve to rank, build those properly and keep crawlers away from the rest.
At scale
What breaks when a Shopify catalog gets big
Indexing
Important pages sit undiscovered
In Search Console you see thousands of URLs "Discovered, currently not indexed", and many of them are the products and collections you need.
Variants
Variants hide search demand
A table in six finishes is one URL. If people search "walnut dining table" and "white oak dining table" separately, one product page cannot rank for both.
Links
Deep products get no links
Products on page 12 of a collection are five or six clicks from the homepage, and infinite scroll can hide them from crawlers entirely.
The method
Decide which facets become pages
Every filter value gets one of three outcomes. It becomes a real, indexable collection because people search for it. It stays a crawlable filter because shoppers need it. Or it is kept out of the crawl because it only creates noise.
Decisions
How we treat each type of URL
| Compare | Treatment | Why |
|---|---|---|
| Facet with search demand ("leather sectional") | Build as its own collection | Needs unique copy, title and links to rank |
| Single-filter URL (?filter.v.option.color=) | Crawlable, canonical to the parent, or blocked | Depends on how many exist and whether demand exists |
| Multi-filter and sort URLs | Blocked (Shopify default) | Pure crawl waste |
| Tag pages (/collections/x/tag) | Noindex, or rebuild as a collection | Reuse parent content, look thin |
| Variant URLs (?variant=) | Canonical to product | Split into products only when variants have their own demand |
| Collection-product paths | Internal links fixed to /products/ | Removes one duplicate per collection per product |
Process
How we run a large catalog project
- Weeks 1 to 2
Map the URL inventory
Crawl, Search Console indexing data and server-side patterns combined, so we know how many URLs exist, which get crawled and which earn clicks.
- Weeks 2 to 3
Match attributes to demand
Every filterable attribute is checked against keyword data. Material, size and use case usually carry demand. Color sometimes. Price range rarely.
- Month 1 to 2
Structure the data
Attributes move into metafields and metaobjects so collections, filters and page content can be generated from them.
- Monthly
Build collections in batches
Programmatic collections go live in batches, each with unique copy, then get linked in through menus, parent collections and related-collection blocks.
- Ongoing
Watch the crawl
Crawl stats and indexing reports tell us whether Googlebot is spending more time on the pages that sell. We adjust robots rules and links from there.
Deliverables
What large catalog SEO includes
Facet map: which attributes become collections, filters or nothing
robots.txt.liquid rules tuned to your filter setup
Metafield and metaobject schema for product attributes
Automated collections built from metafield and metaobject conditions
Variant strategy: when to split into separate products
Crawlable pagination and related-collection link blocks
500 to 3,000 internal links a month, planned by keyword
Sitemap hygiene using Unlisted status and seo.hidden
Deeper
Variants, metaobjects and crawl budget on Shopify
Variants: more room, same trade-off#
Shopify now allows up to 2,048 variants per product, up from the old limit of 100, still across a maximum of three options. That makes it easier to keep big configurable products together, and every variant still shares one indexable product URL. The SEO question is unchanged: do people search for this variant on its own? If "walnut dining table" and "oak dining table" each have real demand, you are usually better off with separate products or dedicated collections than one product with 40 finishes.
Worth knowing for very large catalogs: stores with 500,000 or more variants face a daily limit of 10,000 new variants unless they are on Shopify Plus. That affects how fast a migration or import can land, so we plan batches around it. See Shopify Plus SEO if you are weighing the upgrade.
Metaobjects make collections programmatic#
Automated collections can use conditions on metafields and on metaobject reference metafields. That means a structured attribute, like "compatible vehicle" or "seating capacity", can drive hundreds of collections that stay accurate as products change. The same metaobject can hold the copy, FAQs and specs that make each collection page unique, instead of copy-pasting text into 400 descriptions.
Crawl budget is a real issue here#
For a 50-product store, crawl budget rarely matters. At 20,000 SKUs with filters, it does. The fixes are the ones on our technical SEO page, applied at scale: link to canonical URLs, keep filter combinations out of the crawl, make pagination followable, and hide dead or duplicate products with the Unlisted status or the seo.hidden metafield.
Internal linking at scale#
Menus cannot hold 800 collections. We build related-collection blocks, breadcrumb trails and article links driven by the same metafields, so every collection gets several links in and passes strength on to its products. If you are coming from Magento or another platform with a big catalog, pair this with migration SEO. And every collection built here follows the same page rules as our collection page SEO.
FAQ
Large catalog and faceted navigation questions
Should Shopify filter URLs be indexed?
Rarely. Filter URLs share the parent collection's title, description and copy, so they look like thin duplicates. When a filter value has real search demand, such as "leather sectional", build it as a dedicated collection with its own content. Leave the filter for shoppers, and keep large volumes of filter URLs out of the crawl with robots.txt.liquid rules or canonical tags.
How many variants can a Shopify product have?
Up to 2,048 variants per product, across a maximum of three options such as size, color and material. The old limit was 100. Going beyond three options or 2,048 variants still requires an app or custom line item properties. For SEO, remember that all variants share one indexable URL, so split products when individual variants have their own search demand.
Does crawl budget matter for Shopify stores?
For small stores, almost never. For stores with thousands of products and filterable collections, yes. Filters, sort orders, tag pages and collection-product paths can create many times more URLs than you have products. Signs of a problem include thousands of "Discovered, currently not indexed" URLs in Search Console and new products taking weeks to appear in Google.
What are Shopify metaobjects and how do they help SEO?
Metaobjects are custom structured content types in Shopify, such as a "material" or "vehicle model" with its own fields. Products can reference them through metafields, and automated collections can use those references as conditions. That lets you generate large numbers of accurate collections and give each one unique copy and specs, without editing hundreds of pages by hand.
Is Shopify a good platform for 100,000 SKU catalogs?
Yes, with planning. Shopify handles large catalogs, and Plus removes the daily variant upload limit for stores above 500,000 variants. The SEO work is in controlling filters and variants, structuring attributes in metafields and building internal links that reach deep products. Stores that skip that planning end up with most of their catalog unindexed.
Find out how much of your catalog Google ignores
We will compare your product count with what Google has indexed and show you where the crawl is going.