mylittleinsanities@reddthat.com to Memes@lemmy.mlEnglish · 1 year agoHuman on the internet vs bot on the internetlemmy.mlimagemessage-square15linkfedilinkarrow-up1357arrow-down15
arrow-up1352arrow-down1imageHuman on the internet vs bot on the internetlemmy.mlmylittleinsanities@reddthat.com to Memes@lemmy.mlEnglish · 1 year agomessage-square15linkfedilink
minus-squarekautau@lemmy.worldlinkfedilinkarrow-up28·1 year agohttps://en.wikipedia.org/wiki/Anubis_(software)
minus-squarebrbposting@sh.itjust.workslinkfedilinkEnglisharrow-up15·1 year ago It was created by Xe Iaso in response to Amazon’s web crawler overloading their Git server, as it did not respect the robots.txt exclusion protocol and would work around restrictions. Jeff wouldn’t do that!
minus-squareAbnormalHumanBeing@lemmy.abnormalbeings.spacelinkfedilinkarrow-up19·1 year agohttps://anubis.techaro.lol/
What software is this?
https://en.wikipedia.org/wiki/Anubis_(software)
Jeff wouldn’t do that!
Even a wikipedia page lmfao
https://anubis.techaro.lol/