Hmmm this is interesting, I guess once in a while we have to think like the subject.
Let's say you personally don't want, and then you saw someone took a picture of you in a public property (and let's say nothing wrong with that according to the law). What action will you take?
Well as much as I dont like my picture to be taken I would never confront someone for taking my picture I just avoid being in front of the lens (includes me moving away whenever i see a lens pointed at me). Guess that is what being a good street photographer is. Taking a picture without your subject becoming aware of it or making them comfortable to pose for you