/collections/*/products/* internal links, faceted tag-filter bloat, robots.txt.liquid directives, AI crawler WAF blocks, and canonical drift. Delivered via our $1,200 USD Audit and from $2,900 USD Implementation Sprint on an isolated staging theme.AI Search Practice · Shopify Crawl & Index Hygiene
Crawler access, canonicals, sitemap lastmod, and index hygiene on Shopify’s own surfaces.
Shopify creates specific technical SEO traps out of the box: `/collections/*/products/*` duplicate product URLs, tag-filter crawl explosions, unlinked variant URLs, and WAF rules that silently block AI search bots. We fix them at the Liquid and edge layers.
Commercial Terms (USD)
- Published Fee
- Audit $1,200 · Sprint from $2,900 USD
- Turnaround
- 2–3 weeks (Fixed Scope)
- Deliverable
- Liquid Template Diff + Crawl Verification Log
- Audit Fee Credit
- Up to $1,200 USD (30 days)
Payments processed by Stripe. Card details never reach Ecompanda systems. · All prices in USD.
01 · Scope Boundary & Equal-Weight Exclusions
Written in black and white before any work starts.
Every Ecompanda engagement lists what is excluded at equal visual weight to what is included. We ship on an isolated staging theme (`git` branch) and never modify production without your explicit sign-off.
Included in Scope
- ✓Elimination of `/collections/*/products/*` duplicate internal linking across all collection grids, predictive search, and carousels (`| within: collection` removal)
- ✓Custom `robots.txt.liquid` engineering to block faceted sort/filter crawl traps while allowing verified search and AI answer bots
- ✓Pagination (`rel="next"` / `rel="prev"` / canonical self-referencing) and variant parameter canonical hygiene
- ✓Orphaned URL, redirect chain (`301 -> 301`), and soft-404 remediation across legacy products
- ✓International hreflang and currency/country canonical verification for Shopify Markets stores
Explicitly Excluded (Never in Scope)
- ✕Paid backlink buying, PBNs, or off-page guest-post link schemes
- ✕Automated AI blog content spinning
- ✕Modification of Shopify core `/sitemap.xml` generator behavior beyond supported Shopify surfaces
Sample Deliverable Register
Standard Shopify Technical SEO Defects & Liquid Fixes
| Defect | Where It Lives in Shopify | Crawl / Index Cost | Liquid Engineering Fix |
|---|---|---|---|
| Collection-scoped PDP links | `product.url | within: collection` in card-product.liquid | Multiplies every PDP URL by N collections; dilutes link equity | Replace with canonical `{{ product.url }}` across all snippets |
| Tag & filter crawl traps | `/collections/all/tag1+tag2` & `?filter.v.price=` | Thousands of thin duplicate URLs exhausting crawl budget | `robots.txt.liquid` disallow rules + `noindex,follow` on multi-tag |
| AI Bot 403 Blocks | Cloudflare / custom WAF bot fight mode | OAI-SearchBot & PerplexityBot cannot read live product pages | Verified crawler allowlist + HTTP 200 verification matrix |
| Discontinued SKU 404s | Deleted seasonal products with backlinks/citations | Lost ranking equity & broken assistant citations | Single-hop 301 redirect map to successor SKU or parent collection |
02 · Execution Cadence
How the engagement runs from Day 1.
Full Screaming Frog + Log/GSC Crawl Audit
We crawl 100% of your Shopify URLs, cross-reference Google Search Console indexation states, and test HTTP responses across Googlebot, OAI-SearchBot, and PerplexityBot.
Liquid Template & robots.txt Refactor
We strip `within: collection` link wrappers, configure `robots.txt.liquid`, fix canonical tags on paginated/filtered views, and deploy single-hop 301 redirects.
Post-Deploy Crawl Verification
We re-crawl the staging and production environments to confirm 0 non-canonical internal links, 0 redirect chains, and 100% crawler reach.
Related Practice Lines
Adjacent diagnostics and fixed-scope sprints
03 · Frequently Asked Questions
Questions buyers ask before signing.
Every engagement is governed by our published Terms & Conditions, Refund Policy, and Delivery Policy under Ecom Panda LLC.
Can you edit `robots.txt` on Shopify?
Yes. Shopify supports `templates/robots.txt.liquid`, which allows us to customize disallow rules for faceted search parameters, internal search routes, and tag combinations while explicitly managing access for search and AI crawlers.
Why is `product.url | within: collection` still hurting our Shopify store?
Many Shopify themes link product cards to `/collections/shoes/products/boot` while setting the canonical tag to `/products/boot`. That forces Googlebot and AI crawlers to treat every internal product link on your store as a non-canonical hint, wasting crawl budget and splitting signals.