But, to be honest, it's that way in real flying. I understand what you're saying, I have a TrackIR, but don't have VR yet. I know as gamers we've kind of cheated through that with gaming RE: camera views and whatnot. Flipping a tophat to check your six is 100% easier than what it would have been historically and honestly should be in-game.
I'm always reminded of cockpit videos where you see pilots straining to see as far back behind them as possible, as well as checking rear view mirrors in jets, etc. We're spoiled playing air sims, to be honest. Nice to hear the view center key trick, though.
How is VR on view scaling for distance? Is there any mismatch of head tracking to direction within the game, either temporarily or over time (i.e. does it get skewed sometimes?)