I've been married for 39 years. I told my wife on our second date that I fished, hunted, sailed and spent time hanging out with some old friends partying. That she would always be invited but regardless, I'm going to do what I'm going to do. She doesn't like to camp, fish in cold weather, gets seasick and has always given me maximum slackage to do what I want because she accepted that as a condition of our relationship.
So, it comes down to whether you want to just cut bait on your relationship or give it one more shot by you both talking to a 3rd party. Whattever you do, do it before kids are part of the picture 'cause it ain't gonna get better until you hit it head on. Every couple has adjustment problems. Staying married to the same person is not easy for a lot of reasons. A basic question to answer - are you better with her or without her? Good luck.