[CollEc] PetalBot
Thomas Krichel
krichel at openlib.org
Sun May 14 21:45:49 UTC 2023
Thomas Krichel writes
> Lars Vilhuber writes
> > User-agent: PetalBot
> > Disallow: /
> >
>
> This is done, but it does not help.
And they just read the location
114.119.151.113 - - [14/May/2023:21:24:42 +0000] "GET /robots.txt HTTP/1.1" 301 162 "-" "Mozilla/5.0 (compatible;PetalBot;+https://webmaster.petalsearch.com/site/petalbot)"
but don't stop.
--
Written by Thomas Krichel http://openlib.org/home/krichel on his 21163rd day.
More information about the CollEc-run
mailing list