For me at least, for months now, this instance is unavailable for multiple hours a day. Given the recent posts about the lemmy eco system being on a slight downwards trend, I don’t think this additional load is caused by more users using this instance. Rather, I think that AI scrapers are using this instance to scrape lemmy. If I am correct, though only someone with access to the logs can check, I’d like to kindly ask for some sort of protection from AI scrapers. Both because I like being able to actually browse the instance and because I hate AI companies.

  • partial_accumen@lemmy.world
    link
    fedilink
    arrow-up
    8
    ·
    3 hours ago

    Some Lemmy instances use Cloudflare for protection. I know that sopuli.xyz uses Anubis instead. Both these approaches would offer scraper protection without a captcha which would certainly be a high friction event for human users. Does shitjustworks use something like this?

  • sbv@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    1
    ·
    2 hours ago

    I’ve noticed the slowness too. It’s lousy, because this is the instance I recommend to normies.

    But picking a solution without knowing the problem is a bit premature.