cm0002@lemmy.world to Technology@lemmy.worldEnglish · 6 days agoOpen Source devs say AI crawlers dominate traffic, forcing blocks on entire countriesarstechnica.comexternal-linkmessage-square25fedilinkarrow-up1390arrow-down14cross-posted to: opensource@programming.devtechnology@lemmy.zip
arrow-up1386arrow-down1external-linkOpen Source devs say AI crawlers dominate traffic, forcing blocks on entire countriesarstechnica.comcm0002@lemmy.world to Technology@lemmy.worldEnglish · 6 days agomessage-square25fedilinkcross-posted to: opensource@programming.devtechnology@lemmy.zip
minus-squarezonnewin@feddit.nllinkfedilinkEnglisharrow-up12·6 days agoSo don’t support them. Block them!
minus-squarePlutoniumAcid@lemmy.worldlinkfedilinkEnglisharrow-up21·6 days agoSure, but the challenge is how to block them without putting undue load on humans. In the olden days, you’d just host a webserver and be done with it. Today you need elaborate setups to trick bots. It’s a losing proposition.
minus-squarewhyNotSquirrel@sh.itjust.workslinkfedilinkEnglisharrow-up5·6 days agoIs there a tools to not have to manually block them? Like an updated list of AIshit IP?
So don’t support them. Block them!
Sure, but the challenge is how to block them without putting undue load on humans.
In the olden days, you’d just host a webserver and be done with it. Today you need elaborate setups to trick bots. It’s a losing proposition.
Is there a tools to not have to manually block them? Like an updated list of AIshit IP?