ari.lt/robots.txt

mirror of https://git.ari.lt/ari.lt/ari.lt.git synced 2025-02-04 17:49:24 +01:00
User-agent: *
Disallow: /data/*
Disallow: /content/*
Allow: *
Sitemap: https://ari-web.netlify.app/sitemap.xml
update @ Sat 23 Oct 00:39:59 EEST 2021 2021-10-23 00:39:59 +03:00			`User-agent: *`
			`Disallow: /data/*`
update @ Sat 23 Oct 00:44:37 EEST 2021 2021-10-23 00:44:37 +03:00			`Disallow: /content/*`
update @ Sat 23 Oct 10:09:23 EEST 2021 2021-10-23 10:09:23 +03:00			`Allow: *`
update @ Wed 27 Oct 02:33:43 EEST 2021 2021-10-27 02:33:43 +03:00			`Sitemap: https://ari-web.netlify.app/sitemap.xml`