That’s solvable with good pass through, I am speaking from experience. It’s kind of surprising how little focus that aspect got, even most modern headsets still lack proper stereo-correct passthrough and instead just fudge something together via tracking cameras (e.g. Pico4 looks like a butchered photogrammetry scan due to having only a single RGB camera).
With Apple VisionPro that will hopefully change and motivate the rest of the industry to catch up.
A version of it that looks and feels like glasses would be less of a problem.
BigScreenBeyond gets pretty close (but no passthrough at all). Some AR headsets like Xreal Air get even closer, though those come with tiny FOV.