v1.21.0-pre1

[Xe]

Minfilia Warde

Please, be at ease. You are among friends here.

In this release, Anubis becomes internationalized, gains the ability to use system load as input to issuing challenges,

This release is brought to you by FreeCAD, an open-source computer aided design tool that lets you design things for the real world.

Big ticket changes

The biggest change is that the "invalid response" after "success" bug is now finally fixed for good by totally rewriting how Anubis' challenge issuance flow works. Instead of generating challenge strings from request metadata (under the assumption that the values being compared against are stable), Anubis now generates random data for each challenge. This data is stored in the active storage backend for up to 30 minutes. This also fixes #746 and other similar instances of this issue.

In order to reduce confusion, the "Success" interstitial that shows up when you pass a proof of work challenge has been removed.

Storage

Anubis now is able to store things persistently in memory, on the disk, or in Valkey (this includes other compatible software). By default Anubis uses the in-memory backend. If you have an environment with mutable storage (even if it is temporary), be sure to configure the bbolt storage backend.

Localization

Anubis now supports localized responses. Locales can be added in lib/localization/locales/. This release includes support for the following languages:

• Brazilian Portugese
• Chinese (Traditional)
• English
• French
• German
• Spanish
• Turkish

If facts or local regulations demand, you can set Anubis default language with the FORCE_LANGUAGE environment variable:

FORCE_LANGUAGE=de

Load-based checks

Anubis can dynamically take action based on the system load average, allowing you to write rules like this:

## System load based checks.
# If the system is under high load for the last minute, add weight.
- name: high-load-average
  action: WEIGH
  expression: load_1m >= 10.0 # make sure to end the load comparison in a .0
  weight:
    adjust: 20

# If it is not for the last 15 minutes, remove weight.
- name: low-load-average
  action: WEIGH
  expression: load_15m <= 4.0 # make sure to end the load comparison in a .0
  weight:
    adjust: -10

Something to keep in mind about system load average is that it is not aware of the number of cores the system has. If you have a 16 core system that has 16 processes running but none of them is hogging the CPU, then you will get a load average below 16. If you are in doubt, make your "high load" metric at least two times the number of CPU cores and your "low load" metric at least half of the number of CPU cores. For example:

Kind	Core count	Load threshold
high load	4	8.0
low load	4	2.0
high load	16	32.0
low load	16	8

Also keep in mind that this does not account for other kinds of latency like I/O latency. A system can have its web applications unresponsive due to high latency from a MySQL server but still have that web application server report a load near or at zero.

Other features and fixes

There are a bunch of other assorted features and fixes too:

• Add COOKIE_SECURE option to set the cookie Secure flag
• Sets cookie defaults to use SameSite: None
• Determine the BIND_NETWORK/--bind-network value from the bind address (#677).
• Implement a development container manifest to make contributions easier.
• Fix dynamic cookie domains functionality (#731)
• Add option for custom cookie prefix (#732)
• Make the Open Graph subsystem and DNSBL subsystem use storage backends instead of storing everything in memory by default.
• Allow Common Crawl by default so scrapers have less incentive to scrape
• The bbolt storage backend now runs its cleanup every hour instead of every five minutes.

Potentially breaking changes

The following potentially breaking change applies to native installs with systemd only:

Each instance of systemd service template now has a unique RuntimeDirectory, as opposed to each instance of the service sharing a RuntimeDirectory. This change was made to avoid the RuntimeDirectory getting nuked any time one of the Anubis instances restarts.

If you configured Anubis' unix sockets to listen on /run/anubis/foo.sock for instance anubis@foo, you will need to configure Anubis to listen on /run/anubis/foo/foo.sock and additionally configure your HTTP load balancer as appropriate.

If you need the legacy behaviour, install this systemd unit dropin:

# /etc/systemd/system/[email protected]/50-runtimedir.conf
[Service]
RuntimeDirectory=anubis

Just keep in mind that this will cause problems when Anubis restarts.

What's Changed

• feat: implement localization system by @lolgzs in feat: implement localization system #716
• fix: determine bind network from bind address by @littlecxm in fix: determine bind network from bind address #714
• Add Brazilian Portuguese translation by @rffontenelle in Add Brazilian Portuguese translation #726
• fix: Dynamic cookie domain not working by @Earl0fPudding in fix: Dynamic cookie domain not working #731
• feat(cmd): Add custom cookie prefix by @Earl0fPudding in feat(cmd): Add custom cookie prefix #732
• build(deps): bump the github-actions group with 2 updates by @dependabot in build(deps): bump the github-actions group with 2 updates #735
• build(deps): bump the gomod group with 2 updates by @dependabot in build(deps): bump the gomod group with 2 updates #736
• feat: dev container support by @Xe in feat: dev container support #734
• Fix translations in pt-BR.json by @rffontenelle in Fix translations in pt-BR.json #729
• Set cookies to have the Secure flag default to true by @victorvalenca in Set cookies to have the Secure flag default to true #739
• fix(web/main): remove the success interstitial by @Xe in fix(web/main): remove the success interstitial #745
• feat(localization): Add option for forcing a language by @Earl0fPudding in feat(localization): Add option for forcing a language #742
• fix(run/[email protected]): unique runtimedir per instance by @Xe in fix(run/[email protected]): unique runtimedir per instance #750
• feat(localization): Add German language translation by @Earl0fPudding in feat(localization): Add German language translation #741
• docs: add BotStopper docs from the git repo by @Xe in docs: add BotStopper docs from the git repo #752
• chore(default-config): allowlist common crawl by @Xe in chore(default-config): allowlist common crawl #753
• feat(localization): Add Turkish language translation by @dcelasun in feat(localization): Add Turkish language translation #751
• docs(known-instances): add ebird.org by @SGHFan in docs(known-instances): add ebird.org #755
• feat(lib): use new challenge creation flow by @Xe in feat(lib): use new challenge creation flow #749
• chore(devcontainer): move playwright to its own devcontainer service by @Xe in chore(devcontainer): move playwright to its own devcontainer service #756
• docs(known-instances): Add Duke University, coinhoards.org (and myself) to known instances by @lotharsm in docs(known-instances): Add Duke University, coinhoards.org (and myself) to known instances #757
• fix: make ogtags and dnsbl use the Store instead of memory by @Xe in fix: make ogtags and dnsbl use the Store instead of memory #760
• fix(lib/store/bbolt): use a multi-bucket flow instead of a single bucket flow by @Xe in fix(lib/store/bbolt): use a multi-bucket flow instead of a single bucket flow #761
• fix(lib/store/bbolt): run cleanup every hour instead of every 5 minutes by @Xe in fix(lib/store/bbolt): run cleanup every hour instead of every 5 minutes #762
• docs: remove proof of work branding by @Xe in docs: remove proof of work branding #763
• feat(localization): Update German language translation by @lotharsm in feat(localization): Update German language translation #764
• docs(known-instances): update list of known instances by @lotharsm in docs(known-instances): update list of known instances #767
• feat(localization): Add Traditional Chinese language translation by @xlionjuan in feat(localization): Add Traditional Chinese language translation #759
• feat(lib/policy/expressions): add system load average to bot expression inputs by @Xe in feat(lib/policy/expressions): add system load average to bot expression inputs #766

New Contributors

• @lolgzs made their first contribution in feat: implement localization system #716
• @littlecxm made their first contribution in fix: determine bind network from bind address #714
• @rffontenelle made their first contribution in Add Brazilian Portuguese translation #726
• @victorvalenca made their first contribution in Set cookies to have the Secure flag default to true #739
• @dcelasun made their first contribution in feat(localization): Add Turkish language translation #751
• @SGHFan made their first contribution in docs(known-instances): add ebird.org #755
• @xlionjuan made their first contribution in feat(localization): Add Traditional Chinese language translation #759

Full Changelog: v1.20.0...v1.21.0-pre1

---

This discussion was created from the release v1.21.0-pre1.

[xlionjuan]

Those are 404

[Xe]

I copied from the changelog file! I'll fix those links after dinner. Sorry!

[JasonLovesDoggo]

Fixed!