No. He may not even notice. In any case it's normal for breasts to be slightly different from eachother (One nipple could be bigger than the other too). It may bother the women, but it's very unlikely that a man would care about it.
You can help the HubPages community highlight top quality content by ranking this answer up or down.