Yeah but those rich people don't live in the city the same way regular people do. Like you said they have armed guards/security/etc.; they take cars everywhere so don't have to worry about crime on the street, and can avoid crime ridden areas entirely.

Even in a crime ridden shithole city there will always be at least a few blocks of the downtown/financial district/etc. that are well policed and protected. The rich stay wherever it's safe and let the rest of the city go to shit to do the scam the OP mentioned.