I'm not saying that you are autistic, however, I believe it was wrong for the psychiatrist to dismiss out of hand that possibility. A more professional approach would have been, "I'm not sure that I'm the right person to diagnose, but what I can do is refer to a colleague who has some expertise in this field."
I can't say that I understand how you feel, but I have had an experience that I would like to share with you. I was sexually abused and harassed by other boys I went to school with. And, at 28, I had a male doctor who had no tact perform a non-consensual prostate exam. Now, he was a complete ass-hat, firstly, by noting that I was tall and asking my height and when I answered in metric, replied, "Talk in English!" A more diplomatic way would have been, "So, what's that, about six foot three, in old money?" As a result, I am more comfortable with a female doctor (okay, I saw one female doctor was so rude it was beyond a joke, and even some of her long-term patients have said of her, "Usually, she is good, however, last time I saw her she was just like others have described. Rude, dismissive.") and I was advised by the Health Rights Commission, when I made a complaint about one place, after they asked me if my GP was male or female, that what is best is if you have your doctor contact the specialist by phone, email or fax and have the doctor note on the form that you're to see a female doctor and why, and not to palm you off to somebody else.
Ironically, though, with RAT tests when I go to hospital for another condition, I have had a number of male nurses do them (they're never alone with me) and I have a rapport with some of the more effeminate ones.
I am autistic, and I don't relate to the rough male. Like I don't watch football, cricket or other such things. I can relate to a more feminine male who likes cats and things like that. I have a rapport with an effeminate guy who works at the local supermarket who has a really high-pitched voice.
I was really disgusted with a male doctor I had the misfortune of seeing, and he made me want to go home and jump in the shower, who spoke to me in a condescending voice and gave me a huge dose of asthma medication that made me feel sick. He now markets himself as a GP with a special interest in mental health and weight loss, and has the preposterous belief that men and women cannot be platonic friends!