# Global access User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php # Keep core rendering assets crawlable Allow: /wp-content/uploads/ Allow: /wp-includes/js/ # Block low-value/system areas Disallow: /trackback/ Disallow: /comments/ # WooCommerce crawl hygiene Disallow: /cart/ Disallow: /checkout/ Disallow: /my-account/ Disallow: /*?add-to-cart= Disallow: /*&add-to-cart= Disallow: /*?orderby= # Faceted/filter parameter blocking Disallow: /*?filter_* Disallow: /*&filter_* Disallow: /*?yith_wcan= Disallow: /*&yith_wcan= Disallow: /*?query_type_ Disallow: /*&query_type_ Disallow: /*?min_price= Disallow: /*&min_price= Disallow: /*?max_price= Disallow: /*&max_price= # Meta crawlers (added 2026-10-19, Fix 4). A crawler that matches a named group # ignores the * group, so the * rules are repeated here. Only filter and # add-to-cart URLs (plus the existing system areas) are blocked; the rest of the site stays open. User-agent: meta-externalagent Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Allow: /wp-content/uploads/ Allow: /wp-includes/js/ Disallow: /trackback/ Disallow: /comments/ Disallow: /cart/ Disallow: /checkout/ Disallow: /my-account/ Disallow: /*?orderby= Disallow: /*?add-to-cart= Disallow: /*&add-to-cart= Disallow: /*?filter_* Disallow: /*&filter_* Disallow: /*?yith_wcan= Disallow: /*&yith_wcan= Disallow: /*?query_type_ Disallow: /*&query_type_ Disallow: /*?min_price= Disallow: /*&min_price= Disallow: /*?max_price= Disallow: /*&max_price= User-agent: meta-webindexer Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Allow: /wp-content/uploads/ Allow: /wp-includes/js/ Disallow: /trackback/ Disallow: /comments/ Disallow: /cart/ Disallow: /checkout/ Disallow: /my-account/ Disallow: /*?orderby= Disallow: /*?add-to-cart= Disallow: /*&add-to-cart= Disallow: /*?filter_* Disallow: /*&filter_* Disallow: /*?yith_wcan= Disallow: /*&yith_wcan= Disallow: /*?query_type_ Disallow: /*&query_type_ Disallow: /*?min_price= Disallow: /*&min_price= Disallow: /*?max_price= Disallow: /*&max_price= # Sitemap Sitemap: https://www.dtgweb.com/sitemaps.xml