ari.lt/robots.txt
2021-10-27 02:33:43 +03:00

6 lines
112 B
Text

User-agent: *
Disallow: /data/*
Disallow: /content/*
Allow: *
Sitemap: https://ari-web.netlify.app/sitemap.xml