User-agent: * Allow: / Disallow: /blog/archive/ Disallow: /blog/tags/ User-agent: Googlebot Disallow: *?lightbox= Disallow: *?lightbox=* # Optimization for Google Ads Bot User-agent: AdsBot-Google-Mobile User-agent: AdsBot-Google Disallow: /_api/* Disallow: /_partials* Disallow: /pro-gallery-webapp/v1/galleries/* # Block PetalBot User-agent: PetalBot Disallow: / User-agent: DataForSeoBot/1.0 Disallow: / User-agent: SemrushBot Disallow: / User-agent: GeedoBot Disallow: / User-agent: MJ12bot/v1.4.8 Disallow: / User-agent: Bytespider Disallow: / # Crawl delay for overly enthusiastic bots User-agent: AhrefsBot Crawl-delay: 10 Sitemap: https://www.sweetmana.com/sitemap.xml