User-agent: * Disallow: /wp-content/uploads/wc-logs/ Disallow: /wp-content/uploads/woocommerce_transient_files/ Disallow: /wp-content/uploads/woocommerce_uploads/ Disallow: /*?add-to-cart= Disallow: /*?*add-to-cart= Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php # Stupor speed: keep crawlers out of endless shop filter URLs User-agent: * Disallow: /*?*per_page= Disallow: /*?*per_row= Disallow: /*?*shop_view= Disallow: /*?*stock_status= Disallow: /*?*orderby= Disallow: /*?*min_price= Disallow: /*?*max_price= Disallow: /*?*rating_filter= Disallow: /*?*filter_ Disallow: /*?*query_type_ User-agent: Bytespider User-agent: PetalBot User-agent: MJ12bot User-agent: DotBot User-agent: DataForSeoBot User-agent: BLEXBot User-agent: serpstatbot User-agent: Barkrowler User-agent: ImagesiftBot User-agent: Timpibot Disallow: / # START YOAST BLOCK # --------------------------- User-agent: * Disallow: Sitemap: https://stuporbedsandmattresses.co.uk/sitemap_index.xml # --------------------------- # END YOAST BLOCK