[CollEc] your hits on https://collec.repec.org

[Thomas Krichel]

  hi PetalBot gang,

  https://collec.repec.org is a shiny app. Recently it has been
  overloading the machine. I suspect is your reqests. From what I
  understand at my last overload, about 90 minutes ago, you made a
  request with less than 3 seconds delay but my robots.txt had
  Crawl-delay: 5. I now set it to Disallow: / in an act of dispair.
  Can we please respect indications in robot.txt?

--

  Written by Thomas Krichel http://openlib.org/home/krichel on his 21163rd day.