ari/blog.ari.lt
1
0
Fork 0
mirror of https://git.ari.lt/ari.lt/blog.ari.lt.git synced 2025-02-04 09:39:25 +01:00
Code Issues Projects Releases Packages Wiki Activity Actions

update @ Thu Jan 2 12:12:12 EET 2025

Browse source 
Signed-off-by: Ari Archer <ari@ari.lt>
This commit is contained in:
Arija A. 2025-01-02 12:12:12 +02:00
parent 3a52a82b15
commit bd5b53f352
WARNING! Although there is a key with this ID in the database it does not verify this commit! This commit is SUSPICIOUS.
GPG key ID: A50D5B4B599AF8A2
1 changed files with 29 additions and 27 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

56
scripts/blog.py
View file

@ -1479,34 +1479,36 @@ Sitemap: {config["blog"]}/sitemap.xml
# We are not slaves for machines.
User-agent: Amazonbot
User-agent: anthropic-ai
User-agent: Applebot-Extended
User-agent: Bytespider
User-agent: CCBot
User-agent: ChatGPT-User
User-agent: ClaudeBot
User-agent: Claude-Web
User-agent: cohere-ai
User-agent: Diffbot
User-agent: FacebookBot
User-agent: facebookexternalhit
User-agent: FriendlyCrawler
User-agent: Google-Extended
User-agent: GPTBot
User-agent: ICC-Crawler
User-agent: ImagesiftBot
User-agent: img2dataset
User-agent: meta-externalagent
User-agent: OAI-SearchBot
User-agent: Omgili
User-agent: Omgilibot
User-agent: PerplexityBot
User-agent: PetalBot
User-agent: Scrapy
User-agent: Timpibot
User-agent: VelenPublicWebCrawler
User-agent: YouBot
User-agent: Omgili
User-agent: PerplexityBot
User-agent: CCBot
User-agent: facebookexternalhit
User-agent: Amazonbot
User-agent: ChatGPT-User
User-agent: ImagesiftBot
User-agent: AI2Bot
User-agent: GPTBot
User-agent: PetalBot
User-agent: Diffbot
User-agent: Bytespider
User-agent: ClaudeBot
User-agent: OAI-SearchBot
User-agent: Applebot-Extended
User-agent: cohere-ai
User-agent: Claude-Web
User-agent: ICC-Crawler
User-agent: VelenPublicWebCrawler
User-agent: Omgilibot
User-agent: anthropic-ai
User-agent: FriendlyCrawler
User-agent: Scrapy
User-agent: img2dataset
User-agent: Google-Extended
User-agent: Timpibot
User-agent: meta-externalagent
User-agent: FacebookBot
User-agent: Ai2Bot-Dolma
Disallow: /"""
)