You probably would get more traffic, but I don't think it would be significant enough to justify the change. I'll admit that I've clicked on a hubber before because they had a pretty face, but the amount of times I've done that doesn't compare to the amount of times I've clicked on something based on the subject matter. Also, like Uninvited Writer said; search engines will not display your profile picture, so it won't help you in that regard.
I do want to say, however, that I wouldn't find you untrustworthy to be a man with a female avatar. A lot of artists and photographers prefer to draw the opposite gender, and thus they prefer to display that as their picture rather than a real one. I don't think there is anything wrong with it. Plus Phil could be short for Phillis.
Anyway, it comes down to three bullet points that you need to assess for yourself:
-Does the picture relate to the subject of my hubs? Or, does it need to?
-Which picture do I like the most?
-Do I like this picture enough to keep it forever? (Branding is very real and very important. You want to be recognized at a glance.)
Once you go through these questions, I think you'll have your answer.