Integration tests

[lloesche]

Yesterday a patch that was supposed to fix something unrelated broke compatibility with BepInEx/Valheim Plus. We need a better testing harness that builds the server and then runs through a matrix of different configurations, ensuring that all of them still work as expected. We can't (legally) run the Valheim Client itself, but at least checking whether the server successfully downloads and starts, all the hooks are run and all the crons work would be a start.

[chrisl8]

Is there any sort of pre-release "system"?
If we knew you had some new updates to test some of us could test them out on our home servers before you fully release it to everybody.
I don't see a Release section on this repo, but if there was you could maybe announce pre-releases there and we could subscribe to the updates on GitHub.
Or maybe I am the only person who would actually do that?

[lloesche]

There is a dev branch that used to result in :dev tags. The last time we used that was a couple of years ago.

I now added a test matrix that builds the image, then starts a vanilla, V+ and BepInEx enabled container and runs a test harness inside each (/usr/local/bin/valheim-tests). This script currently just waits up to 15m for the server (and plugins) to be downloaded and started. Once the server process is listening on the UDP port it returns "success".

That's probably a good foundation to catch the most obvious bugs and something where we can now add more tests to ensure crons are working properly, hooks get executed, etc.

[lloesche]

I have now made dev the main branch and synced it to main. I was surprised to learn that Github doesn't support fast-forward PRs out of the box.

There are now :dev tagged images again that should be the same as or newer than :latest.