Performance regression for out of bounds memory accesses

[LeoRiether]

Commit f29d7dc is associated with a performance regression. We should see if there's a way to improve UX for out of bounds accesses without a performance penalty.