I feel the same way. I don't have a good group of male friends, what male friends I have tend to be the exception rather than the rule. There's a ridiculous male doctor who has the belief that men and women cannot and should not be platonic friends. He claims that he hasn't met anyone who disagrees with him and I say, I haven't met anyone who agrees with him. And, if he met some autistic people (okay, I've met him and as you know, I can't stand him) he would see that his theory is wrong, at least for autistic people.
To give an example of how I lose common ground with men. On December 23, 1989, my father bought a Ford Maverick (a rebadged Nissan Patrol (Nissan Safari in Japan, and it was the model after the orange one George Michael was in, in his video, Last Christmas)) and a colleague of my father's husband bought one, too. My father put a long-range fuel tank on his, American springs and tyres on his and an Australian bull-bar and Austrian driving lights. If I was going to buy one, too, I would have said to the dealer, "Is it made in Japan?" "Yes." "Okay, can I have one in automatic, please?" and left it stock standard. If someone had said to me, "How come you haven't got a bull bar, driving lights and his and that?" I would have said, "It's a Ford, and it's made in Japan, and I want to keep it as a Japanese vehicle."
Many of my interests, such as that one, are viewed by some men as more feminine. I mean, I did Japanese at high school and university, and more women and girls did Japanese than boys (out of my year, only seven boys did Japanese). One ultra-alpha male told me that the f-word that rhymes with maggots do Japanese, but when another rougher boy said, "Hey, I did Japanese in Years Eight, Nine and Ten," he shut up.
Also, I'm not interested in sport, and my go to answer if someone asks me who's going to win the football is, "The team that finishes the match with the higher score."
I can more readily discuss things with females than males and I only have one male doctor I'm comfortable with, and a few male nurses.