These are expected as ARM contributors optimize VPP build process for specific hardware. Trending shows both progressions and regressions all caused by this [0] change.
[0] 41259: vppinfra: add ARM neoverse-v2 support | https://gerrit.fd.io/r/c/vpp/+/41259