With the changes introduced in #1991 it is technically possible for contributors to add a test that does not get run on any of the test runners. We need a way to verify that all vmm_tests are run on at least one host and also inform developers if this condition is not met (ideally before the new test has been checked in).