[CollEc] PetalBot

Thomas Krichel krichel at openlib.org
Sun May 14 21:45:49 UTC 2023


Thomas Krichel writes
>   Lars Vilhuber writes
> > User-agent: PetalBot
> > Disallow: /
> > 
> 
>   This is done, but it does not help.

  And they just read the location
  
114.119.151.113 - - [14/May/2023:21:24:42 +0000] "GET /robots.txt HTTP/1.1" 301 162 "-" "Mozilla/5.0 (compatible;PetalBot;+https://webmaster.petalsearch.com/site/petalbot)"

  but don't stop.

-- 
  Written by Thomas Krichel http://openlib.org/home/krichel on his 21163rd day.



More information about the CollEc-run mailing list