I really don't care unless it infringes on my personal property or activities. Thus my son and his friends all staring around in the church parking lot at a Pokemon they found didn't matter as long as it didn't put them in the way of traffic.
I have heard businesses and non profits complain about people wandering through. For the non-profits, I suggest treating them as visitors to be educated. Tell them about your mission. You might educate someone, and if the players don't like it, your group will get removed from the Pokemon map faster than if you demand that the company take you off.
For businesses that don't like wanderers through, charge them or make them be customers, just like saying only paying customers can use your bathroom. This is reasonable if only as s precaution for the shoplifters who will pretend to be Pokemon players while wandering in, lifting items and leaving.