Depends on the heart of the crossdresser entering... IF it is so He is unresponsive to both the Gospel's message of repentence as necessary part of the path to Christ and some reason to attack the Body of the community, then YES he should remove himself.
As for the typically unaware, political correct or insidious misuse of the PARTIAL quote 'JUDGE NOT LEST YE BE JUDGED' so often taken out of context, Christ FINISHES the admonition,
'first take the plank out of your own eye [sincerely ask the Lord for forgiveness and learn and live the Truth and Light by His Word], and then you will see clearly [be in a righteous position] to remove the speck from your brother's eye [to judge and to help him out of his bondage to sin].'
Clearly, Christ has a vehement distaste for sin (the reason for His death and resurrection and ascension) and the speck (the sin) STILL must ultimately be removed to stand in presence before and with God. Sin STILL IS SIN and CAN be forgiven, not excused yet MUST be removed ... NO sin can ever be said of well, it's 'Okay' I'll deal with it later, but ignore it for now.
Then there's also those who misuse the 'cast the first stone' without finishing his admonishment to the adultress,
"GO AND SIN NO MORE'
Yes, ALL have sinned, yes ALL who do not truly repent of sin and accept Christ shall perish...
ps.. 'people person' Holy Handshakes that sounds like someone who prays to Barney (the purple critter, not the Frank.)
PPS Not a pastor either... just a sinner saved by the grace of His shed blood.