[CollEc] PetalBot

[Düben, Christian]

Instead of querying CollEc in one user session, Petalbot opens lots of different user sessions, each coming with its own Docker container.

I am now working on upgrading the middleware and adding a cron job that removes crashed Docker containers every few minutes. The cron job is not an elegant fix, but could stop Helos from crashing due to too many containers.

Christian Düben
Doctoral Candidate
Chair of Macroeconomics
Hamburg University
Germany
christian.dueben at uni-hamburg.de
https://www.christian-dueben.com

-----Original Message-----
From: CollEc-run <collec-run-bounces at lists.openlib.org> On Behalf Of Thomas Krichel
Sent: Sonntag, 14. Mai 2023 15:39
To: CollEc Run <collec-run at lists.openlib.org>
Subject: [CollEc] PetalBot


  I have just dogged another crisis.

  Seemingly PetalBut make requests at accelerating speed. Then we hit
  a problem where I may not be able to kill nginx

root at helos ~ # systemctl stop nginx
Failed to allocate directory watch: Too many open files

  After that,

root at helos ~ # ps axf | grep nginx
 804800 pts/2    S+     0:00      \_ grep nginx

  so it may not run any more, but repeating the nginx shoutdown shows
  the same warning

  And then, a few minutes after that, helos starts runing again.
  I added

   # case sensitive matching
   if ($http_user_agent ~ (PetalBot)) {
      return 403;
   }

  to

/etc/nginx/sites-available/collec.repec.org

  That may keep them out. Then killing the containers (????)

root at helos ~ # killall -9 containerd-shim-runc-v2

   and

root at helos ~ # systemctl start nginx

-- 
  Written by Thomas Krichel http://openlib.org/home/krichel on his 21163rd day.

_______________________________________________
CollEc-run mailing list
CollEc-run at lists.openlib.org
http://lists.openlib.org/cgi-bin/mailman/listinfo/collec-run