IMO - Yes, both ways.
Most men will feel intense jealousy if they are dating a very beautiful woman, which is why women see very attractive guys marrying only "so-so" woman.
Most women feel safer dating a guy who is average over someone who is very hansom for the same reason, jealousy.
In most cases, both sexes feel threat to their own self-esteem when dating very attractive people.
At least, that's what I think.