I understand the anxiety but based on your experience you won't have any trouble finding a fully remote job, probably that pays more.
I've been mostly to fully remote since 2009 and the time I've had with my kids is worth more than anything I could have found in an office. Best of luck in your search!