ari.lt/robots.txt

User-agent: *
Disallow: /data/*
Disallow: /content/*
Allow: *
Sitemap: https://ari-web.xyz/sitemap.xml
update @ Sat 23 Oct 00:39:59 EEST 2021 2021-10-23 00:39:59 +03:00			`User-agent: *`
			`Disallow: /data/*`
update @ Sat 23 Oct 00:44:37 EEST 2021 2021-10-23 00:44:37 +03:00			`Disallow: /content/*`
update @ Sat 23 Oct 10:09:23 EEST 2021 2021-10-23 10:09:23 +03:00			`Allow: *`
update @ Sat 29 Jan 22:20:52 EET 2022 Signed-off-by: Ari Archer <ari@mail.ari-web.xyz> 2022-01-29 22:20:52 +02:00			`Sitemap: https://ari-web.xyz/sitemap.xml`
update @ Wed 27 Oct 02:33:43 EEST 2021 2021-10-27 02:33:43 +03:00