Robots.txt

A small file at your domain root that tells crawlers which parts of the site to stay out of. Correctly configured, it protects crawl budget from cart pages and filter chaos. Misconfigured — one bad line — it can block your entire catalog from Google. It's the first file we check on any store with indexing problems.