I'd say it depends on the commentator. There are some who do really well. Generalizations can get you in trouble because there are exceptions all around. But many women don't think or observe things in the same way men do, so men want to hear details about the game, statistics, observations about unique plays and athletic plays, and commentary about the players, coaches, and their history. And they want to hear from an authority or an expert, like a former player or coach, or a sports broadcaster who knows the game well.
So, I don't care if I'm listening to a woman or a man. I just want to know I'm hearing from someone who knows and understands the game, the teams and players, the coaches, and so on. I've seen a few women who could do that. But I've seen a few who clearly weren't there for their knowledge of the game but maybe other reasons.