Anubis: using a sha256, protects upstream resources from scraper bots

April 24, 2025anubis.techaro.lol
anubis
scraper bots
sha256
cybersecurity
reverse proxy
nginx
github
web development
Article Page
0 likes

Anubis weighs the soul of your connection using a sha256 proof-of-work challenge in order to protect upstream resources from scraper bots. This program is designed to help protect the small internet from the endless storm of requests that flood in from AI companies. Anubis is as lightweight as possible to ensure that everyone can afford to protect the communities closest to them. Anubis is a bit of a nuclear response. This will result in your website being blocked from smaller scrapers and may inhibit "good bots" like the Internet Archive. You can configure bot policy definitions to explicitly allowlist them and we are working on a curated set of "known good" bots to allow for a compromise between discoverability and uptime.

Comments

No comments yet. Be the first to comment!