This feels like one of those activities that's so drastically different that there may be serious health concerns about it. Wearing a VR headset to play a few hours of games a week still lets your eyes mostly exist in a natural light setting. When you're wearing a VR display the light is right up against your eyes with no possibility for them to look away to relax. When we're normally working we can glance out at a horizon (hopefully - sometimes you don't have a window) or at least let your eyes wander off to the ceiling and defocus. It seems like giving your eyes a chance to relax (i.e. having narrow glasses where part of your view field is out of focus) can be beneficial at delaying the onset of Myopia. The idea of wearing one of these for eight hours a day feels much worse than even staring at a phone in your hand when it comes to eye health.
That's entirely a consequence of the made-for-marketing headstrap instead of the headset itself. Check out companies like BOBOVR that make more ergonomic headstraps (not for AVP yet, but they've hinted at working on it).