User-agent: * Disallow: /store/skin1/ Disallow: /store/how-to-shop/ Disallow: /notification.php Disallow: /notification_pre29jan13_17395.php Disallow: /notification*.php Disallow: /blog/ Disallow: /newstore/admin/ Disallow: /prbl Sitemap: https://www.oakleysign.com/sitemap.xml #block from SE while working on these carts Disallow: /cnrt Disallow: /wholesale #12may15 - ZN - https://trello.com/c/lOvOdgbw/2125-weird-nexthome-link Disallow: /NextHome/KoenigRubloff-Panels.html # 02mar13 ZN - Block due to SEO or pseudo-SEO which is not useful to me. # 29sept22 CS - Needed now for current SEO provider, will allow - #User-agent: AhrefsBot #Disallow: / User-agent: 360Spider Disallow: / User-agent: Zeus Disallow: / #commented out because John/SEO uses the SEOmoz tool which is rogerbot #--#User-agent: rogerbot/1.0 #--#Disallow: / # 02mar13 ZN User-agent: Baiduspider Disallow: / # 6132022 CS User-agent: PetalBot Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: similarweb Disallow: /