Migrate to new s3.haiku-os.org

[kallisti5]

s3.haiku-os.org is almost ready for usage. Here's a list of things to do :-)

Notes:

• encrypted s3 backups continue to go to wasabi as usual. (maybe we should use backblaze though.. need to examine costs)

Task list:

• Migrate Concourse builds over to new s3 system (as this is done, we stop syncing to new cdn)
• Migrate downloads.haiku-os.org over to new s3 system
• Add hpkgbouncer haikuports
• Migrate current hpkgbouncer over to new s3 system
• Attach haikuporter buildmaster to new s3 system (big task)
• Make rsync adjustments and notify mirror hosts
• Improve our mirror selection tooling
• Improve automation around repository cryptographic verification

Cleanup:

• Discontinue bunny.net cdn. It sucked.
• Reduce to one 3rd party cdn provider

[kallisti5]

We have added a testing hpkgbouncer for haikuports under /haikuports-test on the hpkg repo. it's working as expected and redirecting to cdn.haiku-os.org

[kallisti5]

Ok. I'm in a good place to start this change:

• The buildmaster with s3 support is running as expected now with some bug fixes and cleanup
• The s3 server is ready and contains a current mirror of up to date packages and releases from all over.
• I have a backup locally of everything that can be synced to any location
• I have the yaml definitions for buildmaster done