Why www.clarin.eu is moving behind Anubis

In recent times, www.clarin.eu has been experiencing a dramatic increase in unwanted automated traffic. These aren’t search engine crawlers or legitimate research tools, they’re high‑volume scrapers that:

  • Ignore robots.txt
  • Bypass rate limits
  • Rotate through residential proxy networks
  • Generate traffic spikes that degrade performance for real users
  • Because we cannot scale our infrastructure indefinitely to feed pathological bots, we’re introducing a protective layer: Anubis.

What Anubis Does
Anubis performs a lightweight verification step to distinguish legitimate human traffic from abusive automated traffic. It does not track users, does not require solving captchas, and does not block normal browsing.

What Users Will See
When accessing www.clarin.eu, users will encounter a short verification page:

  • It appears once per browser session
  • It completes automatically in most cases
  • It adds only a brief delay
  • It ensures the site remains responsive under load

After that, users continue to the website as usual.

This Shouldn’t Worry You

  • No personal data is collected beyond what’s needed for traffic validation
  • No change to your permissions or access
  • No impact on API usage or research workflows
  • No persistent tracking or fingerprinting
  • No change to the content or structure of the website

If Something Goes Wrong
If the verification page loops, blocks you, or behaves unexpectedly, please contact CLARIN support via sysops@clarin.eu. We can whitelist legitimate use cases or investigate misclassifications.

Thank You!
This step helps us keep the CLARIN website stable, fast, and accessible for the community, especially during peak usage periods. We appreciate your understanding as we take measures to protect our shared infrastructure.