Appearance is very important to both men and women. If I have to answer your question straight I would like to say that appearance is very important to men.
Looking ugly or shabby or ill groomed affects us before affecting anybody else. If we wake up in the morning and look in the mirror and find a person who has not shaved and not had a hair cut for days the first person to be affected is ourselves. This is a very extreme example.
However even otherwise one has to take care of how one looks to others. This is because we do not carry our qualifications and certificates written on our foreheads. People tend to judge us by our looks. As such we have to look as close to our actual personalities as possible. A scientist should look like a scientist, a writer should look like a writer, a hermit should look like a hermit and a dance should like one.