Honestly they all suck

Holy setup batman. Was thinking it was going to be another container I spin up, but it’s enabling kernel modules, needs IOMMU, needs a ton of setup and then it looks like you still have to compile it? For now at least that’s above my needs

Honestly think finally found common ground, and I appreciate the thought out response here. This is the sort of discussion and comment I want to see more of here on Lemmy, thought out good discussion instead of “He’s literally hitler”. That’s really the point I was trying to make, I don’t care about Bill Gates, what I am tired of is everyone demonizing everyone else in the comments and us devolving into reddit comment sections. We’ve been better than Reddit in our comments until recently.

And ad hominem attacks are empty and hollow to me.

The fact that you don’t get the nuance that I’m trying to show and going right to comparing to literally Hitler is exactly my point. That’s not discussion, it’s quite literally the Moral Equivalence fallacy. There have been a few good comments here that made me stop and think, actual discussion, weighing pros and cons. Jumping right to Hitler was not one of them.

I remember when it was required that cameras give a little shutter noise to take a picture, I wish they still did. Would deter a lot of people.

Again, no nuance and going right to black and white

Nothing wrong with eating alone. As I said, I have a new fear of some asshole taking a picture of me eating alone now.

Image is exactly why I’m afraid to eat alone, have some asshole take a picture of me and post it online

It’s just every thread man, every one of them devolves into it and I’m so tired. It’s quite literally like the Good Place where even the act of buying a tomato will get people raging in the comments about how apparently you support climate change, slavery, and every other bad thing involved in the growing of it. Or, hear me out, I just bought a tomato. I’m just so tired of it here

Your take is more nuanced than most I see here and I appreciate that, see the other comment as a prime example.

God you hit the nail on the head, and why I’m getting very annoyed here on Lemmy. People refuse to have nuanced takes and just comment incessantly about how people are evil and doing anything makes you a bad person. Turns out people are nuance, and we can judge them as such. You can say he did some terrible things to make Microsoft successful while also saying he has done some very good things with his fortune. It is not black and white.

Thank God they put the sarcasm there at the bottom

I think part of life is learning that there’s nothing wrong with living a simple/normal life, and that there is a beauty in it too.

but the vast majority of crawlers don’t care to do that. That’s a very specific implementation for this one problem. I actually did work at a big scraping farm, and if they encounter something like this,they just give up. It’s not worth it to them. That’s where the “worthiness” check is, you didn’t bother to do anything to gain access.

Great, other companies have thought the same and they’re sheepishly realizing that’s not realistic. Let us know how it goes

That’s counting on one machine using the same cookie session continuously, or they code up a way to share the tokens across machines. That’s now how the bot farms work

I was a single server with only me and 2 others or so, and then saw that I had thousands of requests per minutes at times! Absolutely nuts! My cloud bill was way higher. Adding anubis and it dropped down to just our requests, and bills dropped too. Very very strong proponent now.

This dance to get access is just a minor annoyance for me, but I question how it proves I’m not a bot. These steps can be trivially and cheaply automated.

I don’t think the author understands the point of Anubis. The point isn’t to block bots completely from your site, bots can still get in. The point is to put up a problem at the door to the site. This problem, as the author states, is relatively trivial for the average device to solve, it’s meant to be solved by a phone or any consumer device.

The actual protection mechanism is scale, the scale of this solving solution is costly. Bot farms aren’t one single host or machine, they’re thousands, tens of thousands of VMs running in clusters constantly trying to scrape sites. So to them, a calculating something that trivial is simple once, very very costly at scale. Say calculating the hash once takes about 5 seconds. Easy for a phone. Let’s say that’s 1000 scrapes of your site, that’s now 5000 seconds to scrape, roughly an hour and a half. Now we’re talking about real dollars and cents lost. Scraping does have a cost, and having worked at a company that does professionally scrape content they know this. Most companies will back off after trying to load a page that takes too long, or is too intensive - and that is why we see the dropoff in bot attacks. It’s that it’s not worth it for them to scrape the site anymore.

So for Anubis they’re “judging your value” by saying “Are you willing to put your money where your mouth is to access this site?” For consumer it’s a fraction of a fraction of a penny in electricity spent for that one page load, barely noticeable. For large bot farms it’s real dollars wasted on my little lemmy instance/blog, and thankfully they’ve stopped caring.

Check out Anubis. If you have a reverse proxy it is very easy to add, and for the bots stopped spamming after I added it to mine