Connections/network are indeed fundamental to career growth and learning, accomplishments, etc.. but those don't have to be in-person at all. I mean, I have been learning, building new things, making connections with new people, and I've been 100% remote for the past 3 years. There has been no discernible adverse effect on any career-related criterion I can think of. The literal only downside for me is not being in the super-awesome building I got to work in before, and maybe random off-topic chatter with people. I have that "off-topic chatter" on chat/videocall now, which is just fine anyways. And I don't have to donate 1-2 hours a day to my employer by driving to/from an office.