I left government for museums! Best decision I ever made. But I had to go back to school (at 50, fyi) to get a masters in museum studies. It was scary but worth it. I am lucky because I have a partner who could support our family while I was in school. I realize it is much more difficult otherwise. Seek out mentors. Ask your friends to help you make connections. Join industry networking groups. It's boring advice, but I think it's the right advice. Best of luck to you.