Should keep it enabled by default, but we might want to allow custom tolerances or allow to disable the tolerance enforcement altogether. Can be useful if you want to verify old payloads or if you have a bad clock.