I find voices, in general, quite important. Yes, a nice male voice can elicit a few swoons, and a high-pitched or annoying male voice can do just the opposite. I have a friend, for example, who is quite handsome and super nice but who has an irritating voice. It isn't particularly high pitched, although higher than one would imagine given his physique. Instead, it has a scratchy, jerky quality that I can't quite describe. I sometimes wonder if listening to that voice day in and day out for many years wasn't one of the things that caused his wife to leave him a few years back. I mean, who wants to be "sweet-talked" with a voice that grates on one's nerves?? To be fair to men, I suppose they probably find very high-pitched, grating voices on women a real turn off as well.
Speaking of voices, here's something I find totally amazing. We all know that Kris Kristofferson can't carry a tune in a bucket, but who doesn't like to listen to him anyway because he has such a nice, manly voice and is one of the best song writers of our generation. I personally think Bob Dylan has a horrible singing voice, but I like to listen to him anyway because his music spoke/speaks volumes to my generation. So, I suppose, it depends on what we want a voice to "do for us."

I do know that I'm with Gaer in that certain men's voices certainly have that swoon value.