# Faceted navigation on an online shop. # One product listing with filters can generate millions of URLs that all # show roughly the same goods. The rules below close the combinations and # keep plain pagination open, because that is how deep pages get discovered. User-agent: * # Filters and sorting: closed Disallow: /*?color= Disallow: /*?size= Disallow: /*?brand= Disallow: /*?price= Disallow: /*?sort= Disallow: /*?orderby= Disallow: /*?view= Disallow: /*&color= Disallow: /*&size= Disallow: /*&sort= # # Session and tracking parameters Disallow: /*?sid= Disallow: /*?sessionid= Disallow: /*?utm_ # # Pagination: open on purpose Allow: /*?page= # # Personal pages Disallow: /cart Disallow: /checkout Disallow: /account Sitemap: https://example.com/sitemap.xml