I had a male gynecologist before and didn't have any issues at all. They're all professionals and chances are I'm just one of those thousands of women he has taken cared of. I prefer credentials and experience over gender so this thing isn't much of a biggie for me.
You have a point emphasizing your choice of credentials over gender.