Header trait could likely be more efficient

[Fishrock123]

... which may require small api changes

@yoshuawuyts Sorry I hadn't gotten fully to this, here's a work in progress follow-up commit I never finished: #335

[yoshuawuyts]

Oh fascinating, yeah I think that direction could be worthwhile!