I'm likely to get caned for writing this, but I don't think, for the relatively modest stuff we do (in general...), latency is a huge issue. It's true that I don't, often, record listening to a fully-loaded backing, with tons of Fx; I've never found any need to even check what the latency on my simple set-up is. With today's decent gear, it's not a Big Deal, I reckon.
(Dons tin hat and ducks, though...)