There are two causes for that.
One is because of the difference in luminosity, outside being brighter than inside.
The second cause is the keyhole effect. When you look from inside to outside, you are closer to the curtain and you can see more. When you look from outside the distance from you to the curtain is greater and you cannot see very clear.
The two effects combined give you more privacy.