milknet/pages
1
0
Fork 0
mirror of https://github.com/milk-net/milk-net.github.io.git synced 2025-04-19 17:43:42 -05:00
Code Issues Projects Releases Packages Wiki Activity Actions

Update robots.txt

Browse source
This commit is contained in:
Voxel 2025-04-14 10:51:41 -04:00 • committed by GitHub
parent 7c7ba32314
commit 101e47a1e8
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 7 additions and 2 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

9
robots.txt
View file

@ -1,9 +1,14 @@
User-agent: AhrefsBot Sitemap: https://milk.servemp3.com/sitemap.xml
Disallow: /
User-agent: SemrushBot User-agent: SemrushBot
Disallow: / Disallow: /
User-agent: DataForSeoBot
Disallow: /
User-agent: AdsBot-Google
Disallow: /
User-agent: MJ12bot User-agent: MJ12bot
Disallow: / Disallow: /